Jul 24 13:45:20.206147 ip-10-0-131-103 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 13:45:20.617161 ip-10-0-131-103 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:45:20.617161 ip-10-0-131-103 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 13:45:20.617161 ip-10-0-131-103 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:45:20.617161 ip-10-0-131-103 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 13:45:20.617161 ip-10-0-131-103 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:45:20.617878 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.617177    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 13:45:20.621563 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621546    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:45:20.621563 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621562    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621566    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621569    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621572    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621576    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621579    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621582    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621586    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621588    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621591    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621594    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621597    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621599    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621602    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621604    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621607    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621609    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621612    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621615    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:45:20.621627 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621617    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621620    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621622    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621625    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621628    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621631    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621634    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621636    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621639    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621642    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621644    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621649    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621652    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621656    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621660    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621662    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621666    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621669    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621671    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:45:20.622091 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621674    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621678    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621680    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621683    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621685    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621688    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621690    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621693    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621695    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621698    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621700    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621703    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621705    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621710    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621714    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621717    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621720    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621723    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621726    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621729    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:45:20.622538 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621732    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621735    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621738    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621740    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621743    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621745    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621748    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621751    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621753    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621756    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621759    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621762    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621765    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621767    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621770    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621773    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621776    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621778    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621781    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621783    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:45:20.623051 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621785    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621788    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621791    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621793    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621796    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621799    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621802    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621804    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621807    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621810    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621828    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621833    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621837    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621842    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621845    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621847    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621850    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621852    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621855    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.621857    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:45:20.623521 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622540    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622546    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622549    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622552    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622555    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622558    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622561    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622563    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622576    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622579    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622582    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622585    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622587    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622590    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622593    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622595    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622598    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622602    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622606    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622609    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:45:20.624004 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622611    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622614    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622617    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622619    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622622    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622625    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622627    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622630    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622632    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622635    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622637    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622644    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622646    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622649    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622651    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622654    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622656    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622659    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622661    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:45:20.624497 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622664    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622667    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622669    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622672    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622675    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622677    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622680    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622682    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622684    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622687    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622690    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622693    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622695    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622698    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622700    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622703    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622705    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622708    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622710    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622713    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:45:20.624966 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622715    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622718    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622720    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622723    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622726    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622728    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622731    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622733    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622736    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622739    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622742    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622744    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622747    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622749    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622752    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622755    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622757    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622760    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622763    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622765    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622768    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:45:20.625522 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622770    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622773    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622776    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622780    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622783    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622787    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622790    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622792    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622795    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622798    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622800    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622803    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622807    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622827    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622830    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622833    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622836    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622838    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:45:20.626320 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.622843    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623194    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623199    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623202    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623205    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623209    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623212    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623215    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623218    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623221    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623224    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623227    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623230    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623233    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623235    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623238    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623241    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623243    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623246    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623248    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:45:20.626802 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623251    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623253    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623256    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623259    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623262    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623264    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623267    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623269    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623272    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623274    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623277    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623282    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623284    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623287    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623289    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623292    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623294    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623297    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623300    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623304    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:45:20.627308 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623306    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623309    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623311    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623314    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623317    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623319    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623322    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623324    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623327    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623330    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623332    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623334    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623337    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623339    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623342    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623344    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623347    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623349    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623352    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:45:20.627796 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623355    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623357    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623360    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623362    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623367    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623370    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623372    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623375    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623377    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623380    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623383    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623385    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623390    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623394    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623397    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623401    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623404    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623407    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623410    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:45:20.628286 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623412    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623415    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623419    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623422    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623425    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623428    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623431    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623434    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623437    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623439    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623442    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623445    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623448    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623451    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623453    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623456    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623458    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623462    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623465    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:45:20.628779 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623467    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623470    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.623472    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623551    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623561    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623570    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623578    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623584    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623588    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623592    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623597    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623600    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623603    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623607    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623610    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623613    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623616    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623619    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623622    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623625    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623627    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623632    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623635    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623638    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 13:45:20.629264 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623641    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623644    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623647    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623650    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623654    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623657    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623661    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623664    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623667    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623670    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623673    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623677    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623680    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623683    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623688    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623691    2563 flags.go:64] FLAG: --enable-server="true"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623694    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623699    2563 flags.go:64] FLAG: --event-burst="100"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623702    2563 flags.go:64] FLAG: --event-qps="50"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623705    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623708    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623711    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623715    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623718    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623720    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 13:45:20.629867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623723    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623726    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623729    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623732    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623735    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623737    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623740    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623743    2563 flags.go:64] FLAG: --feature-gates=""
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623746    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623749    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623752    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623755    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623758    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623762    2563 flags.go:64] FLAG: --help="false"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623764    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-103.ec2.internal"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623767    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623770    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623774    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623777    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623781    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623784    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623787    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623790    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 13:45:20.630448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623793    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623796    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623799    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623802    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623805    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623808    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623824    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623828    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623830    2563 flags.go:64] FLAG: --lock-file=""
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623833    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623836    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623839    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623844    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623847    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623850    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623852    2563 flags.go:64] FLAG: --logging-format="text"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623855    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623859    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623861    2563 flags.go:64] FLAG: --manifest-url=""
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623864    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623868    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623871    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623876    2563 flags.go:64] FLAG: --max-pods="110"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623879    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623882    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 13:45:20.631068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623885    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623888    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623891    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623893    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623896    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623904    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623907    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623910    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623913    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623916    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623921    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623923    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623927    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623930    2563 flags.go:64] FLAG: --port="10250"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623933    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623936    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0402d2afb1f94c912"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623939    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623942    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623945    2563 flags.go:64] FLAG: --register-node="true"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623948    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623951    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623954    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623957    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623960    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623963    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 13:45:20.631666 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623966    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623969    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623972    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623975    2563 flags.go:64] FLAG: --runonce="false"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623978    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623981    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623984    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623987    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623990    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623993    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623996    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.623999    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624001    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624005    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624008    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624011    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624014    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624017    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624020    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624026    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624029    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624032    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624036    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624039    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624041    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 13:45:20.632285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624044    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624047    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624050    2563 flags.go:64] FLAG: --v="2"
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624053    2563 flags.go:64] FLAG: --version="false"
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624057    2563 flags.go:64] FLAG: --vmodule=""
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624061    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.624064    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624957    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624962    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624966    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624971    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624974    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624977    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624980    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624983    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624986    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624988    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624991    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624994    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.624996    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625000    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625002    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:45:20.632903 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625005    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625007    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625010    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625013    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625015    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625018    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625021    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625023    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625026    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625028    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625031    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625033    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625036    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625038    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625041    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625043    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625046    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625048    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625051    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625053    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:45:20.633469 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625057    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625060    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625062    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625065    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625068    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625071    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625073    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625076    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625078    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625080    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625084    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625087    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625089    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625092    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625094    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625097    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625099    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625102    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625106    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:45:20.633975 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625111    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625115    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625118    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625121    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625124    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625127    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625130    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625133    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625135    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625138    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625140    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625143    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625145    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625149    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625152    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625154    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625157    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625160    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625162    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:45:20.634442 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625165    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625167    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625170    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625172    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625175    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625178    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625180    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625183    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625185    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625188    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625191    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625193    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625196    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625198    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625203    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625206    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625209    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625212    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625214    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625217    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:45:20.634925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625220    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625223    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625225    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625228    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625231    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.625233    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.625239    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.632163    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.632179    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.632200    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.632205    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632259    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632264    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632267    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632270    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:45:20.635398 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632273    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632276    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632278    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632281    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632284    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632287    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632290    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632292    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632297    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632301    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632304    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632308    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632311    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632313    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632316    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632319    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632322    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632325    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632327    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:45:20.635769 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632330    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632333    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632336    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632338    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632341    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632343    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632346    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632349    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632352    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632354    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632357    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632360    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632362    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632365    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632368    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632370    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632373    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632375    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632377    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632380    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:45:20.636239 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632382    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632385    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632388    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632391    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632393    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632395    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632398    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632400    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632403    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632405    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632408    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632410    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632413    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632415    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632418    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632421    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632423    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632426    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632429    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632432    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:45:20.636756 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632434    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632437    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632441    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632444    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632447    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632450    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632453    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632455    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632458    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632461    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632464    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632466    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632469    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632472    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632474    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632477    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632480    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632482    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632485    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:45:20.637301 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632487    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632490    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632492    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632494    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632497    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632501    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632504    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632507    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632510    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632512    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632515    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632518    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632521    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632523    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632526    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632528    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:45:20.637745 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632531    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.632536    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632659    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632665    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632669    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632672    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632675    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632678    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632681    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632683    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632686    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632688    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632691    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632695    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632698    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:45:20.638190 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632700    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632703    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632705    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632708    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632710    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632713    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632715    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632717    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632720    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632722    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632725    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632728    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632730    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632733    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632735    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632738    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632740    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632743    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632745    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632747    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:45:20.638546 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632750    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632752    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632755    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632757    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632759    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632762    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632764    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632767    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632769    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632772    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632774    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632777    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632780    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632782    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632784    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632787    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632789    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632792    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632795    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632798    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:45:20.639045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632801    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632804    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632807    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632809    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632830    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632833    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632835    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632838    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632841    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632843    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632846    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632848    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632851    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632853    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632856    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632858    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632861    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632863    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632866    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632869    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:45:20.639510 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632871    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632874    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632876    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632879    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632883    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632885    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632888    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632890    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632893    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632895    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632898    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632900    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632903    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632906    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632910    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632913    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632916    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632920    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632923    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:45:20.639990 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632925    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632928    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632930    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632933    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632935    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632938    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:20.632941    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.632945    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.633045    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.634920    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.636260    2563 server.go:1019] "Starting client certificate rotation"
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.636359    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.636389    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 13:45:20.640438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.639472    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 13:45:20.645847 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.645834    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 13:45:20.651655 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.651640    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 24 13:45:20.655275 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.655258    2563 log.go:25] "Validated CRI v1 image API"
Jul 24 13:45:20.656066 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.656048    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 13:45:20.659081 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.659062    2563 fs.go:135] Filesystem UUIDs: map[0ada63cc-b4d9-479b-add3-f6ae474ff727:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ed14e6c8-c661-49b7-a144-a3ec0a0f5efd:/dev/nvme0n1p3]
Jul 24 13:45:20.659155 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.659080    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 13:45:20.665488 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.665382    2563 manager.go:216] Machine: {Timestamp:2026-07-24 13:45:20.664041583 +0000 UTC m=+0.324874733 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098626 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2971ff3a1437a38638f2763ea68d40 SystemUUID:ec2971ff-3a14-37a3-8638-f2763ea68d40 BootID:6ff0f105-88f8-4aa3-8c3f-7a2e1d4bc55b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:60:5a:9b:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:60:5a:9b:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:a7:64:29:83:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 13:45:20.665488 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.665482    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 13:45:20.665614 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.665557    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 13:45:20.668968 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.668935    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 13:45:20.669112 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.668970    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 13:45:20.669256 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.669240    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 13:45:20.670432 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.670419    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 13:45:20.670470 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.670435    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 13:45:20.670470 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.670443    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 13:45:20.671057 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.671046    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 13:45:20.671949 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.671939    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 13:45:20.673942 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.673930    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 13:45:20.674049 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674040    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 13:45:20.674083 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674070    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 13:45:20.674083 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674079    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 13:45:20.674133 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674094    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 13:45:20.674133 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674102    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 24 13:45:20.674133 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674112    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 13:45:20.674468 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674454    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 13:45:20.674532 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.674472    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 13:45:20.676996 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.676977    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 13:45:20.678697 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.678680    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 13:45:20.678784 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.678718    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 13:45:20.680277 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680263    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 13:45:20.680341 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680288    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 13:45:20.680341 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680304    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 13:45:20.680341 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680316    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 13:45:20.680341 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680336    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 13:45:20.680499 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680348    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 13:45:20.680499 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680366    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 13:45:20.680499 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680376    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 13:45:20.680499 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680386    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 13:45:20.680499 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680395    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 13:45:20.680499 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680408    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 13:45:20.680499 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.680417    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 13:45:20.683015 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.683001    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 13:45:20.683070 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.683018    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 13:45:20.683070 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.683035    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 13:45:20.683070 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.683063    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 13:45:20.686094 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.686079    2563 server.go:1268] "Started kubelet"
Jul 24 13:45:20.686207 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.686168    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 13:45:20.686302 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.686221    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 13:45:20.686366 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.686311    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 13:45:20.686960 ip-10-0-131-103 systemd[1]: Started Kubernetes Kubelet.
Jul 24 13:45:20.689806 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.689756    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 13:45:20.690670 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.690654    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 13:45:20.692345 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.692323    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 13:45:20.693495 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.693249    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 13:45:20.693882 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.693866    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lt6lq"
Jul 24 13:45:20.698103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.698077    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 13:45:20.698103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.698091    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 13:45:20.698233 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.698164    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:20.698781 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.698729    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 13:45:20.698781 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.698775    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 13:45:20.698936 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.698744    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 13:45:20.698936 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.698919    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 13:45:20.698936 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.698930    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 13:45:20.699200 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.699183    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 13:45:20.699200 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.699201    2563 factory.go:55] Registering systemd factory
Jul 24 13:45:20.699303 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.699210    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 24 13:45:20.699464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.699451    2563 factory.go:153] Registering CRI-O factory
Jul 24 13:45:20.699509 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.699465    2563 factory.go:223] Registration of the crio container factory successfully
Jul 24 13:45:20.699509 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.699486    2563 factory.go:103] Registering Raw factory
Jul 24 13:45:20.699509 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.699498    2563 manager.go:1196] Started watching for new ooms in manager
Jul 24 13:45:20.700060 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.700037    2563 manager.go:349] Starting recovery of all containers
Jul 24 13:45:20.701284 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.701259    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lt6lq"
Jul 24 13:45:20.704441 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.703281    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-103.ec2.internal.18c53dbfa7d4b108  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-103.ec2.internal,UID:ip-10-0-131-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-103.ec2.internal,},FirstTimestamp:2026-07-24 13:45:20.686051592 +0000 UTC m=+0.346884742,LastTimestamp:2026-07-24 13:45:20.686051592 +0000 UTC m=+0.346884742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-103.ec2.internal,}"
Jul 24 13:45:20.704553 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.704528    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 13:45:20.704642 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.704618    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 13:45:20.709218 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.709204    2563 manager.go:354] Recovery completed
Jul 24 13:45:20.713710 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.713600    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:45:20.715630 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.715614    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:45:20.715630 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.715642    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:45:20.715737 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.715653    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:45:20.716129 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.716114    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 13:45:20.716129 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.716126    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 13:45:20.716254 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.716139    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 13:45:20.716254 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.716161    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:45:20.716852 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.716839    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:45:20.716887 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.716864    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:45:20.716887 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.716873    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:45:20.717749 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.717738    2563 policy_none.go:49] "None policy: Start"
Jul 24 13:45:20.717788 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.717753    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 13:45:20.717788 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.717763    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 13:45:20.718871 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.718860    2563 policy_none.go:47] "Start"
Jul 24 13:45:20.750408 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.750390    2563 manager.go:337] "Starting Device Plugin manager"
Jul 24 13:45:20.750520 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.750424    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 13:45:20.750520 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.750435    2563 server.go:87] "Starting device plugin registration server"
Jul 24 13:45:20.750703 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.750691    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 13:45:20.750760 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.750705    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 13:45:20.751261 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.750891    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 13:45:20.751261 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.750969    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 13:45:20.751261 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.750976    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 13:45:20.751441 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.751378    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 13:45:20.751441 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.751433    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:20.851296 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.851240    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:45:20.852479 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.852462    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:45:20.852562 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.852499    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:45:20.852562 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.852514    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:45:20.852562 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.852549    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-103.ec2.internal"
Jul 24 13:45:20.856842 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.856799    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 13:45:20.858160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.858140    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 13:45:20.858262 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.858183    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 13:45:20.858262 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.858205    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 13:45:20.858262 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.858240    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 13:45:20.859135 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.859105    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-103.ec2.internal"
Jul 24 13:45:20.859225 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.859137    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-103.ec2.internal\": node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:20.860971 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.860954    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:45:20.887334 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.887272    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:20.959123 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.959090    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal"]
Jul 24 13:45:20.959254 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.959173    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:45:20.961543 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.961529    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:45:20.961613 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.961559    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:45:20.961613 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.961570    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:45:20.962834 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.962806    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:45:20.962969 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.962955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:20.963029 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.962991    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:45:20.963512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.963497    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:45:20.963576 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.963497    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:45:20.963576 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.963530    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:45:20.963576 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.963544    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:45:20.963576 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.963544    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:45:20.963576 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.963571    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:45:20.964653 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.964641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:20.964699 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.964663    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:45:20.965285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.965268    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:45:20.965381 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.965302    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:45:20.965381 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:20.965319    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:45:20.987332 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.987309    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:20.994377 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.994360    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-103.ec2.internal\" not found" node="ip-10-0-131-103.ec2.internal"
Jul 24 13:45:20.998905 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:20.998888    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-103.ec2.internal\" not found" node="ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.088435 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.088412    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:21.100339 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.100318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf606796bd1786382e0c767b5c288c1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal\" (UID: \"bf606796bd1786382e0c767b5c288c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.100404 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.100345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7345f365a424f5fd3d9488d8c14814f8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-103.ec2.internal\" (UID: \"7345f365a424f5fd3d9488d8c14814f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.100404 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.100362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf606796bd1786382e0c767b5c288c1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal\" (UID: \"bf606796bd1786382e0c767b5c288c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.189455 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.189385    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:21.200724 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.200707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf606796bd1786382e0c767b5c288c1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal\" (UID: \"bf606796bd1786382e0c767b5c288c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.200776 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.200730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf606796bd1786382e0c767b5c288c1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal\" (UID: \"bf606796bd1786382e0c767b5c288c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.200776 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.200748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7345f365a424f5fd3d9488d8c14814f8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-103.ec2.internal\" (UID: \"7345f365a424f5fd3d9488d8c14814f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.200858 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.200786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7345f365a424f5fd3d9488d8c14814f8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-103.ec2.internal\" (UID: \"7345f365a424f5fd3d9488d8c14814f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.200858 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.200845    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf606796bd1786382e0c767b5c288c1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal\" (UID: \"bf606796bd1786382e0c767b5c288c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.200918 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.200842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf606796bd1786382e0c767b5c288c1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal\" (UID: \"bf606796bd1786382e0c767b5c288c1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.289879 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.289857    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:21.298040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.298020    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.302310 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.302153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.390054 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.390019    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:21.490581 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.490490    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-103.ec2.internal\" not found"
Jul 24 13:45:21.553013 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.552992    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:45:21.599271 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.599248    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.611634 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.611616    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 13:45:21.613916 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.613902    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal"
Jul 24 13:45:21.620906 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.620891    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 13:45:21.636150 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.636128    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 13:45:21.636262 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.636246    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 13:45:21.636314 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.636296    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 13:45:21.675112 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.675083    2563 apiserver.go:52] "Watching apiserver"
Jul 24 13:45:21.689529 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.689498    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 13:45:21.690428 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.690403    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-772jm","openshift-network-operator/iptables-alerter-h4sdt","kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal","openshift-multus/multus-additional-cni-plugins-cnsdl","openshift-multus/multus-nvr92","openshift-network-diagnostics/network-check-target-sfz8b","openshift-ovn-kubernetes/ovnkube-node-cdkxt","kube-system/global-pull-secret-syncer-wk5nd","kube-system/konnectivity-agent-j9ft7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x","openshift-cluster-node-tuning-operator/tuned-cpjfl","openshift-dns/node-resolver-kwxst","openshift-image-registry/node-ca-bfcdt"]
Jul 24 13:45:21.691957 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.691939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:21.693369 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.693348    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.694304 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.694278    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 13:45:21.694425 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.694363    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jmhln\""
Jul 24 13:45:21.694644 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.694625    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 13:45:21.694716 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.694673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.696134 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.696102    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 13:45:21.696237 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.696108    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ddj79\""
Jul 24 13:45:21.696237 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.695939    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 13:45:21.697461 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.697419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.698201 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.698180    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 13:45:21.698537 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.698175    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 13:45:21.698611 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.698542    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 13:45:21.698868 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.698846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 13:45:21.698962 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.698874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.699061 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.699041    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8ghhj\""
Jul 24 13:45:21.699941 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.699924    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 13:45:21.700309 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.700295    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 13:45:21.700593 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.700577    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.701076 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701053    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 13:45:21.701146 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701098    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 13:45:21.701146 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701123    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mhlxc\""
Jul 24 13:45:21.701248 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 13:45:21.701305 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701252    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 13:45:21.701441 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701426    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 13:45:21.701858 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701842    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 13:45:21.701995 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701859    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxn78\""
Jul 24 13:45:21.701995 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701873    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 13:45:21.701995 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701928    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 13:45:21.701995 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.701956    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 13:45:21.702153 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.702145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.702211 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.702190    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:21.703185 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.703168    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 13:45:21.703530 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.703516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:21.703598 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.703580    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:21.704455 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p49bp\""
Jul 24 13:45:21.704816 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-ovnkube-config\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.704946 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-env-overrides\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.704946 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-system-cni-dir\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.704946 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cnibin\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.704946 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-os-release\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.704946 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-tmp-dir\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.704946 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp684\" (UniqueName: \"kubernetes.io/projected/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-kube-api-access-bp684\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.704973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-node-log\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705064    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-system-cni-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-netns\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-cni-multus\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-kubelet\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/090e2288-7ba1-4606-9f4f-6845109b2f21-serviceca\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-kubelet\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.705257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-ovn\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-ovnkube-script-lib\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-hosts-file\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ng4l\" (UniqueName: \"kubernetes.io/projected/090e2288-7ba1-4606-9f4f-6845109b2f21-kube-api-access-4ng4l\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-cni-netd\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccrfv\" (UniqueName: \"kubernetes.io/projected/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-kube-api-access-ccrfv\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-cni-bin\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/442e6b14-6417-445c-af8d-59a6eca71a57-multus-daemon-config\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-etc-kubernetes\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.705639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-systemd-units\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-run-netns\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpnjm\" (UniqueName: \"kubernetes.io/projected/ea48d077-a12f-4416-9805-3b69c544b08d-kube-api-access-wpnjm\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b7k4\" (UniqueName: \"kubernetes.io/projected/442e6b14-6417-445c-af8d-59a6eca71a57-kube-api-access-4b7k4\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7606e18-0654-40a1-9414-adbc29c32dcd-agent-certs\") pod \"konnectivity-agent-j9ft7\" (UID: \"a7606e18-0654-40a1-9414-adbc29c32dcd\") " pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7606e18-0654-40a1-9414-adbc29c32dcd-konnectivity-ca\") pod \"konnectivity-agent-j9ft7\" (UID: \"a7606e18-0654-40a1-9414-adbc29c32dcd\") " pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-systemd\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea48d077-a12f-4416-9805-3b69c544b08d-ovn-node-metrics-cert\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-os-release\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-k8s-cni-cncf-io\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-multus-certs\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-cni-bin\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-cni-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-cnibin\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.705996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-socket-dir-parent\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-hostroot\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706163 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-var-lib-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-etc-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-log-socket\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/442e6b14-6417-445c-af8d-59a6eca71a57-cni-binary-copy\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-conf-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/090e2288-7ba1-4606-9f4f-6845109b2f21-host\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-slash\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.706705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.706209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.707155 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.707137    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:21.707235 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.707217    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:21.707496 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.707477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:45:21.707558 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.707493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q6h2c\""
Jul 24 13:45:21.707558 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.707541    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 13:45:21.707656 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.707637    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 13:45:21.708469 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.708402    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 13:40:21 +0000 UTC" deadline="2028-01-16 08:05:02.58619732 +0000 UTC"
Jul 24 13:45:21.708565 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.708468    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12978h19m40.877733444s"
Jul 24 13:45:21.708644 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.708626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.710001 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.709982    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.710772 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.710747    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 13:45:21.710869 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.710811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8j6h7\""
Jul 24 13:45:21.710967 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.710948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 13:45:21.711071 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.711035    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 13:45:21.712546 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.712530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 13:45:21.712771 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.712757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9ppln\""
Jul 24 13:45:21.713098 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.713083    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:45:21.719270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.719251    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 13:45:21.739770 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.739751    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kknlq"
Jul 24 13:45:21.753737 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.753710    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kknlq"
Jul 24 13:45:21.800327 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.800301    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 13:45:21.806375 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-var-lib-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806459 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-etc-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806459 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-log-socket\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806459 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/442e6b14-6417-445c-af8d-59a6eca71a57-cni-binary-copy\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-var-lib-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-conf-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-etc-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-conf-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6efadae3-0831-458f-80c9-474404403c46-etc-tuned\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-slash\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-env-overrides\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cnibin\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-slash\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-netns\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-log-socket\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-kubelet\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.806623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806630    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cnibin\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-etc-kubernetes\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-kubelet\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-run\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-netns\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-sys-fs\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-etc-kubernetes\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-tmp-dir\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-system-cni-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-var-lib-kubelet\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-system-cni-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-device-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trh6s\" (UniqueName: \"kubernetes.io/projected/427113dd-6614-4114-a9fa-040a35bf26fe-kube-api-access-trh6s\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/090e2288-7ba1-4606-9f4f-6845109b2f21-serviceca\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-kubelet\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-ovn\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.806981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-kubelet\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.807504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-ovn\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrfv\" (UniqueName: \"kubernetes.io/projected/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-kube-api-access-ccrfv\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ng4l\" (UniqueName: \"kubernetes.io/projected/090e2288-7ba1-4606-9f4f-6845109b2f21-kube-api-access-4ng4l\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-kubernetes\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-env-overrides\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysctl-conf\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/442e6b14-6417-445c-af8d-59a6eca71a57-cni-binary-copy\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-tmp-dir\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-systemd-units\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-run-netns\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-systemd-units\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpnjm\" (UniqueName: \"kubernetes.io/projected/ea48d077-a12f-4416-9805-3b69c544b08d-kube-api-access-wpnjm\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-run-netns\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b7k4\" (UniqueName: \"kubernetes.io/projected/442e6b14-6417-445c-af8d-59a6eca71a57-kube-api-access-4b7k4\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94xx4\" (UniqueName: \"kubernetes.io/projected/6efadae3-0831-458f-80c9-474404403c46-kube-api-access-94xx4\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-kubelet-config\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.808510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/090e2288-7ba1-4606-9f4f-6845109b2f21-serviceca\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sffdr\" (UniqueName: \"kubernetes.io/projected/3d9456d5-e757-45b6-8758-de7ff6595915-kube-api-access-sffdr\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7606e18-0654-40a1-9414-adbc29c32dcd-agent-certs\") pod \"konnectivity-agent-j9ft7\" (UID: \"a7606e18-0654-40a1-9414-adbc29c32dcd\") " pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7606e18-0654-40a1-9414-adbc29c32dcd-konnectivity-ca\") pod \"konnectivity-agent-j9ft7\" (UID: \"a7606e18-0654-40a1-9414-adbc29c32dcd\") " pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-systemd\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea48d077-a12f-4416-9805-3b69c544b08d-ovn-node-metrics-cert\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-os-release\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-systemd\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-run-openvswitch\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-k8s-cni-cncf-io\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-k8s-cni-cncf-io\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6efadae3-0831-458f-80c9-474404403c46-tmp\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-cnibin\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-hostroot\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-systemd\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-os-release\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-dbus\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-cnibin\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-hostroot\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d9456d5-e757-45b6-8758-de7ff6595915-host-slash\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807818    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d9456d5-e757-45b6-8758-de7ff6595915-iptables-alerter-script\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-registration-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/090e2288-7ba1-4606-9f4f-6845109b2f21-host\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.807978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-ovnkube-config\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-system-cni-dir\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/090e2288-7ba1-4606-9f4f-6845109b2f21-host\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7606e18-0654-40a1-9414-adbc29c32dcd-konnectivity-ca\") pod \"konnectivity-agent-j9ft7\" (UID: \"a7606e18-0654-40a1-9414-adbc29c32dcd\") " pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-os-release\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.809696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-system-cni-dir\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-cni-multus\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-os-release\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysconfig\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-cni-multus\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp684\" (UniqueName: \"kubernetes.io/projected/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-kube-api-access-bp684\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-node-log\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808274    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-node-log\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-sys\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-ovnkube-script-lib\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-cni-bin\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.810208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-ovnkube-config\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-modprobe-d\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysctl-d\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-var-lib-cni-bin\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-hosts-file\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-cni-netd\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-hosts-file\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/442e6b14-6417-445c-af8d-59a6eca71a57-multus-daemon-config\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-lib-modules\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-cni-netd\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-socket-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-multus-certs\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxlv5\" (UniqueName: \"kubernetes.io/projected/8f166484-6e22-42a7-a142-39336af9517a-kube-api-access-mxlv5\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-cni-bin\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.810718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-host-run-multus-certs\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea48d077-a12f-4416-9805-3b69c544b08d-ovnkube-script-lib\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-cni-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.808997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-socket-dir-parent\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.809020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-host\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.809034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/442e6b14-6417-445c-af8d-59a6eca71a57-multus-daemon-config\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.809115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-socket-dir-parent\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.809125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/442e6b14-6417-445c-af8d-59a6eca71a57-multus-cni-dir\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.809153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea48d077-a12f-4416-9805-3b69c544b08d-host-cni-bin\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.811001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea48d077-a12f-4416-9805-3b69c544b08d-ovn-node-metrics-cert\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.811239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.811102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7606e18-0654-40a1-9414-adbc29c32dcd-agent-certs\") pod \"konnectivity-agent-j9ft7\" (UID: \"a7606e18-0654-40a1-9414-adbc29c32dcd\") " pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:21.819525 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.819497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ng4l\" (UniqueName: \"kubernetes.io/projected/090e2288-7ba1-4606-9f4f-6845109b2f21-kube-api-access-4ng4l\") pod \"node-ca-bfcdt\" (UID: \"090e2288-7ba1-4606-9f4f-6845109b2f21\") " pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:21.819525 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.819518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccrfv\" (UniqueName: \"kubernetes.io/projected/b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66-kube-api-access-ccrfv\") pod \"multus-additional-cni-plugins-cnsdl\" (UID: \"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66\") " pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:21.820357 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.820009    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b7k4\" (UniqueName: \"kubernetes.io/projected/442e6b14-6417-445c-af8d-59a6eca71a57-kube-api-access-4b7k4\") pod \"multus-nvr92\" (UID: \"442e6b14-6417-445c-af8d-59a6eca71a57\") " pod="openshift-multus/multus-nvr92"
Jul 24 13:45:21.820357 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.820294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp684\" (UniqueName: \"kubernetes.io/projected/dba78e9a-afcb-4a83-ba48-0b7cdba7f480-kube-api-access-bp684\") pod \"node-resolver-kwxst\" (UID: \"dba78e9a-afcb-4a83-ba48-0b7cdba7f480\") " pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:21.821058 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.821038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpnjm\" (UniqueName: \"kubernetes.io/projected/ea48d077-a12f-4416-9805-3b69c544b08d-kube-api-access-wpnjm\") pod \"ovnkube-node-cdkxt\" (UID: \"ea48d077-a12f-4416-9805-3b69c544b08d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:21.877772 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:21.877741    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7345f365a424f5fd3d9488d8c14814f8.slice/crio-52aab49911aa5a26050f58435fe13f5a72887f2347b22a82e22c3b51de09f28c WatchSource:0}: Error finding container 52aab49911aa5a26050f58435fe13f5a72887f2347b22a82e22c3b51de09f28c: Status 404 returned error can't find the container with id 52aab49911aa5a26050f58435fe13f5a72887f2347b22a82e22c3b51de09f28c
Jul 24 13:45:21.880297 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.880264    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:45:21.883641 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.883626    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:45:21.909300 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysctl-d\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.909481 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-lib-modules\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.909481 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.909481 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysctl-d\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.909663 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-socket-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.909663 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxlv5\" (UniqueName: \"kubernetes.io/projected/8f166484-6e22-42a7-a142-39336af9517a-kube-api-access-mxlv5\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:21.909663 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-host\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.909663 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.909586    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:21.909663 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-lib-modules\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.909663 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6efadae3-0831-458f-80c9-474404403c46-etc-tuned\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.909663 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-run\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-host\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-run\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.909697    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret podName:f7eadae5-68df-4f23-b0ee-36f6973a1b9b nodeName:}" failed. No retries permitted until 2026-07-24 13:45:22.409638827 +0000 UTC m=+2.070471972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret") pod "global-pull-secret-syncer-wk5nd" (UID: "f7eadae5-68df-4f23-b0ee-36f6973a1b9b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-socket-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-sys-fs\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-var-lib-kubelet\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-device-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trh6s\" (UniqueName: \"kubernetes.io/projected/427113dd-6614-4114-a9fa-040a35bf26fe-kube-api-access-trh6s\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-sys-fs\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-var-lib-kubelet\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-device-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-kubernetes\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.909956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysctl-conf\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-kubernetes\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94xx4\" (UniqueName: \"kubernetes.io/projected/6efadae3-0831-458f-80c9-474404403c46-kube-api-access-94xx4\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-kubelet-config\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysctl-conf\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sffdr\" (UniqueName: \"kubernetes.io/projected/3d9456d5-e757-45b6-8758-de7ff6595915-kube-api-access-sffdr\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6efadae3-0831-458f-80c9-474404403c46-tmp\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-systemd\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-kubelet-config\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-dbus\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d9456d5-e757-45b6-8758-de7ff6595915-host-slash\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-systemd\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d9456d5-e757-45b6-8758-de7ff6595915-iptables-alerter-script\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d9456d5-e757-45b6-8758-de7ff6595915-host-slash\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-dbus\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-registration-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.910791 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysconfig\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-registration-dir\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-sys\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-sysconfig\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-modprobe-d\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-sys\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.910502    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/427113dd-6614-4114-a9fa-040a35bf26fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6efadae3-0831-458f-80c9-474404403c46-etc-modprobe-d\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.910718    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:45:22.410700443 +0000 UTC m=+2.071533581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:21.911326 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.910862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d9456d5-e757-45b6-8758-de7ff6595915-iptables-alerter-script\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.912510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.912484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6efadae3-0831-458f-80c9-474404403c46-etc-tuned\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.912621 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.912511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6efadae3-0831-458f-80c9-474404403c46-tmp\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:21.919021 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.918999    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:21.919021 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.919022    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:21.919158 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.919033    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7xl8h for pod openshift-network-diagnostics/network-check-target-sfz8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:21.919158 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:21.919098    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h podName:454be6de-9835-47c8-b0fb-5355ce1d7d1e nodeName:}" failed. No retries permitted until 2026-07-24 13:45:22.419082322 +0000 UTC m=+2.079915479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7xl8h" (UniqueName: "kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h") pod "network-check-target-sfz8b" (UID: "454be6de-9835-47c8-b0fb-5355ce1d7d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:21.920359 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.920332    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxlv5\" (UniqueName: \"kubernetes.io/projected/8f166484-6e22-42a7-a142-39336af9517a-kube-api-access-mxlv5\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:21.922052 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.922033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trh6s\" (UniqueName: \"kubernetes.io/projected/427113dd-6614-4114-a9fa-040a35bf26fe-kube-api-access-trh6s\") pod \"aws-ebs-csi-driver-node-vzt9x\" (UID: \"427113dd-6614-4114-a9fa-040a35bf26fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:21.922052 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.922045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sffdr\" (UniqueName: \"kubernetes.io/projected/3d9456d5-e757-45b6-8758-de7ff6595915-kube-api-access-sffdr\") pod \"iptables-alerter-h4sdt\" (UID: \"3d9456d5-e757-45b6-8758-de7ff6595915\") " pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:21.922493 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:21.922477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94xx4\" (UniqueName: \"kubernetes.io/projected/6efadae3-0831-458f-80c9-474404403c46-kube-api-access-94xx4\") pod \"tuned-cpjfl\" (UID: \"6efadae3-0831-458f-80c9-474404403c46\") " pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:22.013252 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.013221    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf606796bd1786382e0c767b5c288c1f.slice/crio-f9c22bac3811044094d8f8053e5d3336aa9ebee2a82bd09d7065d79a3af80165 WatchSource:0}: Error finding container f9c22bac3811044094d8f8053e5d3336aa9ebee2a82bd09d7065d79a3af80165: Status 404 returned error can't find the container with id f9c22bac3811044094d8f8053e5d3336aa9ebee2a82bd09d7065d79a3af80165
Jul 24 13:45:22.022729 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.022706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:22.030775 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.030752    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7606e18_0654_40a1_9414_adbc29c32dcd.slice/crio-ef0bff3950fe2646e61bc5fa718d51e52c8c230b0cc0331c9da59c57d18d52d0 WatchSource:0}: Error finding container ef0bff3950fe2646e61bc5fa718d51e52c8c230b0cc0331c9da59c57d18d52d0: Status 404 returned error can't find the container with id ef0bff3950fe2646e61bc5fa718d51e52c8c230b0cc0331c9da59c57d18d52d0
Jul 24 13:45:22.041955 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.041935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kwxst"
Jul 24 13:45:22.050964 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.050934    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba78e9a_afcb_4a83_ba48_0b7cdba7f480.slice/crio-093b5d94c09c9b5ead22209f5de60de2343898190800c5a257829bface512d88 WatchSource:0}: Error finding container 093b5d94c09c9b5ead22209f5de60de2343898190800c5a257829bface512d88: Status 404 returned error can't find the container with id 093b5d94c09c9b5ead22209f5de60de2343898190800c5a257829bface512d88
Jul 24 13:45:22.062413 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.062394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bfcdt"
Jul 24 13:45:22.069689 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.069670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:22.070316 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.070292    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090e2288_7ba1_4606_9f4f_6845109b2f21.slice/crio-103c1da1242c874cfa7db09b51d31e2fc712db4ae3edcec45384aea754e8f669 WatchSource:0}: Error finding container 103c1da1242c874cfa7db09b51d31e2fc712db4ae3edcec45384aea754e8f669: Status 404 returned error can't find the container with id 103c1da1242c874cfa7db09b51d31e2fc712db4ae3edcec45384aea754e8f669
Jul 24 13:45:22.079256 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.079216    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea48d077_a12f_4416_9805_3b69c544b08d.slice/crio-53105eaabf8ab309486f564abf34997c000e970861eb0a0aa754e93d56ee2439 WatchSource:0}: Error finding container 53105eaabf8ab309486f564abf34997c000e970861eb0a0aa754e93d56ee2439: Status 404 returned error can't find the container with id 53105eaabf8ab309486f564abf34997c000e970861eb0a0aa754e93d56ee2439
Jul 24 13:45:22.090230 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.090212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnsdl"
Jul 24 13:45:22.091100 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.091083    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:45:22.097686 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.097659    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9eda48c_dc2e_4ec5_81bd_fb8bb2bbbf66.slice/crio-8a559cce0e640db49e917e2d579e679e7aeb038c0fdf79b2ebcd82a1e63d18ba WatchSource:0}: Error finding container 8a559cce0e640db49e917e2d579e679e7aeb038c0fdf79b2ebcd82a1e63d18ba: Status 404 returned error can't find the container with id 8a559cce0e640db49e917e2d579e679e7aeb038c0fdf79b2ebcd82a1e63d18ba
Jul 24 13:45:22.102026 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.102007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nvr92"
Jul 24 13:45:22.109331 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.109308    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442e6b14_6417_445c_af8d_59a6eca71a57.slice/crio-35290954104faf30fac895f56f5b90a65dd02aed460ad3fa871ebb1fe9c66ca3 WatchSource:0}: Error finding container 35290954104faf30fac895f56f5b90a65dd02aed460ad3fa871ebb1fe9c66ca3: Status 404 returned error can't find the container with id 35290954104faf30fac895f56f5b90a65dd02aed460ad3fa871ebb1fe9c66ca3
Jul 24 13:45:22.118736 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.118714    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h4sdt"
Jul 24 13:45:22.126327 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.126297    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9456d5_e757_45b6_8758_de7ff6595915.slice/crio-b7015cd04b77dee982fd7a2e480a55ceff147272ac8afb83d5cf945c6b0264c5 WatchSource:0}: Error finding container b7015cd04b77dee982fd7a2e480a55ceff147272ac8afb83d5cf945c6b0264c5: Status 404 returned error can't find the container with id b7015cd04b77dee982fd7a2e480a55ceff147272ac8afb83d5cf945c6b0264c5
Jul 24 13:45:22.143815 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.143794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x"
Jul 24 13:45:22.147721 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.147691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpjfl"
Jul 24 13:45:22.151599 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.151578    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427113dd_6614_4114_a9fa_040a35bf26fe.slice/crio-0341bbaab032702ae4592e5c528e4584e91050fd10e1c5bb6ff1784fbd8b63dc WatchSource:0}: Error finding container 0341bbaab032702ae4592e5c528e4584e91050fd10e1c5bb6ff1784fbd8b63dc: Status 404 returned error can't find the container with id 0341bbaab032702ae4592e5c528e4584e91050fd10e1c5bb6ff1784fbd8b63dc
Jul 24 13:45:22.155511 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:22.155492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efadae3_0831_458f_80c9_474404403c46.slice/crio-2fca53c652d7c1a1e0ade2912186fe232192147821da9e323181aee73472b0ee WatchSource:0}: Error finding container 2fca53c652d7c1a1e0ade2912186fe232192147821da9e323181aee73472b0ee: Status 404 returned error can't find the container with id 2fca53c652d7c1a1e0ade2912186fe232192147821da9e323181aee73472b0ee
Jul 24 13:45:22.414926 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.414820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:22.414926 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.414892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:22.415120 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.415059    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:22.415173 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.415122    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret podName:f7eadae5-68df-4f23-b0ee-36f6973a1b9b nodeName:}" failed. No retries permitted until 2026-07-24 13:45:23.415101064 +0000 UTC m=+3.075934209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret") pod "global-pull-secret-syncer-wk5nd" (UID: "f7eadae5-68df-4f23-b0ee-36f6973a1b9b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:22.415541 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.415521    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:22.415671 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.415575    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:45:23.415559167 +0000 UTC m=+3.076392310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:22.515930 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.515894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:22.516134 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.516117    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:22.516222 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.516137    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:22.516222 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.516146    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7xl8h for pod openshift-network-diagnostics/network-check-target-sfz8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:22.516222 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.516211    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h podName:454be6de-9835-47c8-b0fb-5355ce1d7d1e nodeName:}" failed. No retries permitted until 2026-07-24 13:45:23.516181556 +0000 UTC m=+3.177014718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xl8h" (UniqueName: "kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h") pod "network-check-target-sfz8b" (UID: "454be6de-9835-47c8-b0fb-5355ce1d7d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:22.756389 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.756263    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:40:22 +0000 UTC" deadline="2027-12-27 12:16:47.777965414 +0000 UTC"
Jul 24 13:45:22.756389 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.756329    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12502h31m25.021640769s"
Jul 24 13:45:22.861777 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.859996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:22.861777 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:22.860160    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:22.895064 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.894987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpjfl" event={"ID":"6efadae3-0831-458f-80c9-474404403c46","Type":"ContainerStarted","Data":"2fca53c652d7c1a1e0ade2912186fe232192147821da9e323181aee73472b0ee"}
Jul 24 13:45:22.905320 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.905286    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:45:22.926594 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.926553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x" event={"ID":"427113dd-6614-4114-a9fa-040a35bf26fe","Type":"ContainerStarted","Data":"0341bbaab032702ae4592e5c528e4584e91050fd10e1c5bb6ff1784fbd8b63dc"}
Jul 24 13:45:22.953958 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.953921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nvr92" event={"ID":"442e6b14-6417-445c-af8d-59a6eca71a57","Type":"ContainerStarted","Data":"35290954104faf30fac895f56f5b90a65dd02aed460ad3fa871ebb1fe9c66ca3"}
Jul 24 13:45:22.974472 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.974441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerStarted","Data":"8a559cce0e640db49e917e2d579e679e7aeb038c0fdf79b2ebcd82a1e63d18ba"}
Jul 24 13:45:22.978850 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.978822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bfcdt" event={"ID":"090e2288-7ba1-4606-9f4f-6845109b2f21","Type":"ContainerStarted","Data":"103c1da1242c874cfa7db09b51d31e2fc712db4ae3edcec45384aea754e8f669"}
Jul 24 13:45:22.993584 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:22.993541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kwxst" event={"ID":"dba78e9a-afcb-4a83-ba48-0b7cdba7f480","Type":"ContainerStarted","Data":"093b5d94c09c9b5ead22209f5de60de2343898190800c5a257829bface512d88"}
Jul 24 13:45:23.001709 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.001679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal" event={"ID":"bf606796bd1786382e0c767b5c288c1f","Type":"ContainerStarted","Data":"f9c22bac3811044094d8f8053e5d3336aa9ebee2a82bd09d7065d79a3af80165"}
Jul 24 13:45:23.018392 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.018322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h4sdt" event={"ID":"3d9456d5-e757-45b6-8758-de7ff6595915","Type":"ContainerStarted","Data":"b7015cd04b77dee982fd7a2e480a55ceff147272ac8afb83d5cf945c6b0264c5"}
Jul 24 13:45:23.031831 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.031772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"53105eaabf8ab309486f564abf34997c000e970861eb0a0aa754e93d56ee2439"}
Jul 24 13:45:23.050713 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.050654    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9ft7" event={"ID":"a7606e18-0654-40a1-9414-adbc29c32dcd","Type":"ContainerStarted","Data":"ef0bff3950fe2646e61bc5fa718d51e52c8c230b0cc0331c9da59c57d18d52d0"}
Jul 24 13:45:23.070037 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.069919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal" event={"ID":"7345f365a424f5fd3d9488d8c14814f8","Type":"ContainerStarted","Data":"52aab49911aa5a26050f58435fe13f5a72887f2347b22a82e22c3b51de09f28c"}
Jul 24 13:45:23.424284 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.424242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:23.424446 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.424348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:23.424517 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.424478    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:23.424580 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.424550    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:45:25.424526845 +0000 UTC m=+5.085359991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:23.425074 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.425029    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:23.425178 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.425087    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret podName:f7eadae5-68df-4f23-b0ee-36f6973a1b9b nodeName:}" failed. No retries permitted until 2026-07-24 13:45:25.425069649 +0000 UTC m=+5.085902794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret") pod "global-pull-secret-syncer-wk5nd" (UID: "f7eadae5-68df-4f23-b0ee-36f6973a1b9b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:23.525349 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.525116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:23.525546 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.525361    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:23.525546 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.525382    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:23.525546 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.525397    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7xl8h for pod openshift-network-diagnostics/network-check-target-sfz8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:23.525546 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.525461    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h podName:454be6de-9835-47c8-b0fb-5355ce1d7d1e nodeName:}" failed. No retries permitted until 2026-07-24 13:45:25.525440039 +0000 UTC m=+5.186273200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xl8h" (UniqueName: "kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h") pod "network-check-target-sfz8b" (UID: "454be6de-9835-47c8-b0fb-5355ce1d7d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:23.757380 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.757279    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:40:22 +0000 UTC" deadline="2028-02-27 21:05:30.150880628 +0000 UTC"
Jul 24 13:45:23.757847 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.757405    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13999h20m6.393515216s"
Jul 24 13:45:23.858981 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.858943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:23.859175 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.859104    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:23.859558 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:23.859532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:23.859663 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:23.859643    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:24.349869 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:24.349618    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:45:24.858999 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:24.858438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:24.858999 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:24.858589    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:25.443862 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:25.442991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:25.443862 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:25.443092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:25.443862 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.443230    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:25.443862 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.443293    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:45:29.443273856 +0000 UTC m=+9.104107003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:25.443862 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.443705    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:25.443862 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.443762    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret podName:f7eadae5-68df-4f23-b0ee-36f6973a1b9b nodeName:}" failed. No retries permitted until 2026-07-24 13:45:29.443745344 +0000 UTC m=+9.104578485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret") pod "global-pull-secret-syncer-wk5nd" (UID: "f7eadae5-68df-4f23-b0ee-36f6973a1b9b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:25.544506 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:25.543734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:25.544506 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.543994    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:25.544506 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.544020    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:25.544506 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.544033    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7xl8h for pod openshift-network-diagnostics/network-check-target-sfz8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:25.544506 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.544100    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h podName:454be6de-9835-47c8-b0fb-5355ce1d7d1e nodeName:}" failed. No retries permitted until 2026-07-24 13:45:29.544079231 +0000 UTC m=+9.204912374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xl8h" (UniqueName: "kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h") pod "network-check-target-sfz8b" (UID: "454be6de-9835-47c8-b0fb-5355ce1d7d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:25.858665 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:25.858570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:25.858665 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:25.858626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:25.858931 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.858739    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:25.858931 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:25.858851    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:26.859981 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:26.859940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:26.860487 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:26.860102    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:27.858829 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:27.858774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:27.859019 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:27.858938    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:27.862062 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:27.862034    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:27.862450 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:27.862237    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:28.862443 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:28.861854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:28.862443 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:28.862024    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:29.479803 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:29.479760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:29.480008 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:29.479833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:29.480008 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.479956    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:29.480126 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.480014    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret podName:f7eadae5-68df-4f23-b0ee-36f6973a1b9b nodeName:}" failed. No retries permitted until 2026-07-24 13:45:37.479998897 +0000 UTC m=+17.140832035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret") pod "global-pull-secret-syncer-wk5nd" (UID: "f7eadae5-68df-4f23-b0ee-36f6973a1b9b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:29.480330 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.480306    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:29.480451 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.480344    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:45:37.480333793 +0000 UTC m=+17.141166930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:29.580253 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:29.580212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:29.580467 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.580399    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:29.580467 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.580429    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:29.580467 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.580442    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7xl8h for pod openshift-network-diagnostics/network-check-target-sfz8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:29.580630 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.580511    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h podName:454be6de-9835-47c8-b0fb-5355ce1d7d1e nodeName:}" failed. No retries permitted until 2026-07-24 13:45:37.580491639 +0000 UTC m=+17.241324810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xl8h" (UniqueName: "kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h") pod "network-check-target-sfz8b" (UID: "454be6de-9835-47c8-b0fb-5355ce1d7d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:29.859145 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:29.859065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:29.859305 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.859212    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:29.859602 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:29.859586    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:29.859691 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:29.859660    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:30.859478 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:30.859436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:30.859960 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:30.859552    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:31.858708 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:31.858661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:31.859230 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:31.858787    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:31.859230 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:31.858843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:31.859230 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:31.858945    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:32.858764 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:32.858726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:32.859256 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:32.858898    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:33.859052 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:33.859010    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:33.859052 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:33.859044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:33.859576 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:33.859159    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:33.859576 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:33.859299    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:34.859062 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:34.858976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:34.859223 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:34.859120    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:35.858396 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:35.858361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:35.858574 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:35.858483    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:35.858619 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:35.858571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:35.858692 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:35.858664    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:36.858882 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:36.858840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:36.859348 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:36.858977    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:37.545032 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:37.544995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:37.545032 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:37.545045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:37.545304 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.545180    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:37.545304 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.545253    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:45:53.545238147 +0000 UTC m=+33.206071283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:37.545304 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.545183    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:37.545448 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.545343    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret podName:f7eadae5-68df-4f23-b0ee-36f6973a1b9b nodeName:}" failed. No retries permitted until 2026-07-24 13:45:53.545327055 +0000 UTC m=+33.206160210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret") pod "global-pull-secret-syncer-wk5nd" (UID: "f7eadae5-68df-4f23-b0ee-36f6973a1b9b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:37.645586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:37.645538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:37.645766 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.645725    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:37.645766 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.645748    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:37.645766 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.645758    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7xl8h for pod openshift-network-diagnostics/network-check-target-sfz8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:37.645960 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.645810    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h podName:454be6de-9835-47c8-b0fb-5355ce1d7d1e nodeName:}" failed. No retries permitted until 2026-07-24 13:45:53.645796259 +0000 UTC m=+33.306629396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xl8h" (UniqueName: "kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h") pod "network-check-target-sfz8b" (UID: "454be6de-9835-47c8-b0fb-5355ce1d7d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:37.858803 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:37.858717    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:37.858803 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:37.858770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:37.859292 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.858870    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:37.859292 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:37.858998    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:38.858733 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:38.858691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:38.858951 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:38.858859    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:39.858704 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:39.858667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:39.859156 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:39.858715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:39.859156 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:39.858828    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:39.859156 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:39.858932    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:40.859296 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:40.859260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:40.859763 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:40.859371    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:41.859408 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:41.859373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:41.859408 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:41.859405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:41.859960 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:41.859493    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:41.859960 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:41.859635    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:42.863780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:42.863106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:42.863780 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:42.863433    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:43.114079 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.113788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9ft7" event={"ID":"a7606e18-0654-40a1-9414-adbc29c32dcd","Type":"ContainerStarted","Data":"c38458dd824a4cb5f08a44b2d5e0a112b60236604913a66c307e513407a529a5"}
Jul 24 13:45:43.115890 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.115862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal" event={"ID":"7345f365a424f5fd3d9488d8c14814f8","Type":"ContainerStarted","Data":"7e676b57daf8c3da372effd797b66a9433880004555538d2a19201473f398493"}
Jul 24 13:45:43.117832 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.117793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpjfl" event={"ID":"6efadae3-0831-458f-80c9-474404403c46","Type":"ContainerStarted","Data":"cdf02b0420f5ec6c00542eb170e5c8aacdf226a0d759fac3ee2c076cd2f1bde9"}
Jul 24 13:45:43.119425 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.119397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x" event={"ID":"427113dd-6614-4114-a9fa-040a35bf26fe","Type":"ContainerStarted","Data":"4474d53b98ecad4bc0d7e64bf8c6ae74df710ee2b6bfaaea085415d66aa72000"}
Jul 24 13:45:43.121212 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.121186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nvr92" event={"ID":"442e6b14-6417-445c-af8d-59a6eca71a57","Type":"ContainerStarted","Data":"81ecfba6f620ea2b5631992b72a8fa03e3c1e8b91ce5fa03084e3fa307b45408"}
Jul 24 13:45:43.123796 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.123742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerStarted","Data":"04a7ecf7cd4f3930553fed09505cf08b84e84aef07dc651cc6b2c427c5a5a769"}
Jul 24 13:45:43.126739 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.125984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bfcdt" event={"ID":"090e2288-7ba1-4606-9f4f-6845109b2f21","Type":"ContainerStarted","Data":"bd0eece2b2a4768ffddd79c8fa0bfdf1350ea4f590f5488f5ad19e1faf13043c"}
Jul 24 13:45:43.127777 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.127753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kwxst" event={"ID":"dba78e9a-afcb-4a83-ba48-0b7cdba7f480","Type":"ContainerStarted","Data":"8dbf77a615c09a2612ada26deed9aceb02674f4ca92a1422b64ed97097292ddd"}
Jul 24 13:45:43.128042 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.127987    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j9ft7" podStartSLOduration=1.5123094849999998 podStartE2EDuration="22.127973916s" totalImagesPullingTime="20.615664431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:43.127494675 +0000 UTC m=+22.788327815" watchObservedRunningTime="2026-07-24 13:45:43.127973916 +0000 UTC m=+22.788807076"
Jul 24 13:45:43.129479 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.129460    2563 generic.go:356] "Generic (PLEG): container finished" podID="bf606796bd1786382e0c767b5c288c1f" containerID="18058f05e68041445e1cf9fa529f4f621922ba57e2f0c3c61d0af268cd254cae" exitCode=0
Jul 24 13:45:43.129563 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.129531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal" event={"ID":"bf606796bd1786382e0c767b5c288c1f","Type":"ContainerDied","Data":"18058f05e68041445e1cf9fa529f4f621922ba57e2f0c3c61d0af268cd254cae"}
Jul 24 13:45:43.132609 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.131864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"79f4040efacee06d2a8f6969ec8c0adfe116617cf293acab378c221c2e3ab1a3"}
Jul 24 13:45:43.132609 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.131955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"810725a47839bb1ccf82bdbbb8ea8ad96d5d10b833a073aabc8f8ff19a99b599"}
Jul 24 13:45:43.132609 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.131999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"28685fa1991d4fab5ab80039e0f96e67388a69648eb894a1104a5c0801384157"}
Jul 24 13:45:43.141502 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.141464    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bfcdt" podStartSLOduration=1.60961513 podStartE2EDuration="22.14145241s" totalImagesPullingTime="20.53183728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:43.14111049 +0000 UTC m=+22.801943650" watchObservedRunningTime="2026-07-24 13:45:43.14145241 +0000 UTC m=+22.802285593"
Jul 24 13:45:43.171624 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.171583    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cpjfl" podStartSLOduration=1.7581600819999998 podStartE2EDuration="22.17156865s" totalImagesPullingTime="20.413408568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:43.155882083 +0000 UTC m=+22.816715239" watchObservedRunningTime="2026-07-24 13:45:43.17156865 +0000 UTC m=+22.832401859"
Jul 24 13:45:43.191301 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.191266    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-103.ec2.internal" podStartSLOduration=21.191253527 podStartE2EDuration="21.191253527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:43.171214943 +0000 UTC m=+22.832048103" watchObservedRunningTime="2026-07-24 13:45:43.191253527 +0000 UTC m=+22.852086685"
Jul 24 13:45:43.206904 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.206868    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nvr92" podStartSLOduration=1.5152878410000001 podStartE2EDuration="22.206855241s" totalImagesPullingTime="20.6915674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:43.206307248 +0000 UTC m=+22.867140408" watchObservedRunningTime="2026-07-24 13:45:43.206855241 +0000 UTC m=+22.867688400"
Jul 24 13:45:43.859541 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.859339    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:43.859709 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:43.859436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:43.859709 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:43.859642    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:43.859835 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:43.859732    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:44.135376 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.135348    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66" containerID="04a7ecf7cd4f3930553fed09505cf08b84e84aef07dc651cc6b2c427c5a5a769" exitCode=0
Jul 24 13:45:44.136197 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.135429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerDied","Data":"04a7ecf7cd4f3930553fed09505cf08b84e84aef07dc651cc6b2c427c5a5a769"}
Jul 24 13:45:44.136903 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.136876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h4sdt" event={"ID":"3d9456d5-e757-45b6-8758-de7ff6595915","Type":"ContainerStarted","Data":"ee530d6bad0c1c6bf3ad88c4546143cfc2a9256e6be0179659b05f560c90b28c"}
Jul 24 13:45:44.139803 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.139775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"778c28344bfb0e00aebf69f965ae782bd5532f6281c1ff0f76bdf23570beb792"}
Jul 24 13:45:44.139914 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.139867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"a79dde891426a8caaabe7e21cf19393a514a31df425aca886ad4d72f327ec66f"}
Jul 24 13:45:44.139960 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.139920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"538a06a633112c20e5504214f2113539de88be1497eec50f6746ec1b1663bfd0"}
Jul 24 13:45:44.156087 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.156048    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kwxst" podStartSLOduration=2.638226059 podStartE2EDuration="23.156036813s" totalImagesPullingTime="20.517810754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:43.221532595 +0000 UTC m=+22.882365755" watchObservedRunningTime="2026-07-24 13:45:44.156036813 +0000 UTC m=+23.816869971"
Jul 24 13:45:44.169912 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.169874    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h4sdt" podStartSLOduration=2.650053286 podStartE2EDuration="23.1698628s" totalImagesPullingTime="20.519809514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:44.16952415 +0000 UTC m=+23.830357319" watchObservedRunningTime="2026-07-24 13:45:44.1698628 +0000 UTC m=+23.830695958"
Jul 24 13:45:44.351155 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.351083    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 13:45:44.768399 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.768260    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T13:45:44.351099536Z","UUID":"eaf34676-063b-4f4d-95e7-d99f1456d0d0","Handler":null,"Name":"","Endpoint":""}
Jul 24 13:45:44.770737 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.770714    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 13:45:44.770876 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.770752    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 13:45:44.858788 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:44.858752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:44.858976 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:44.858914    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:45.146059 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:45.145336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal" event={"ID":"bf606796bd1786382e0c767b5c288c1f","Type":"ContainerStarted","Data":"c17c11e402f65c26a1bcb7c9d3ed94fe75c62d2f76ca5a0d207e9377b25c609f"}
Jul 24 13:45:45.150074 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:45.150041    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x" event={"ID":"427113dd-6614-4114-a9fa-040a35bf26fe","Type":"ContainerStarted","Data":"b2a3e5412853a0b24eb60b969b49e8101931db18dd31feb16833ebd1ea60b3a9"}
Jul 24 13:45:45.160109 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:45.160045    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-103.ec2.internal" podStartSLOduration=23.160010071 podStartE2EDuration="23.160010071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:45.159157323 +0000 UTC m=+24.819990484" watchObservedRunningTime="2026-07-24 13:45:45.160010071 +0000 UTC m=+24.820843229"
Jul 24 13:45:45.859573 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:45.859503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:45.859725 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:45.859500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:45.859725 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:45.859634    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:45.859843 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:45.859714    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:46.156069 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:46.155983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"2cfa21ffc992952c088ed05dadd2c53e309ca15b71fa87eae5e01df04bf0bee6"}
Jul 24 13:45:46.158311 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:46.158280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x" event={"ID":"427113dd-6614-4114-a9fa-040a35bf26fe","Type":"ContainerStarted","Data":"ae4e928cbaf64f480d6f317af53472b8f59b103ae5b85a668f517c2e588515c8"}
Jul 24 13:45:46.175036 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:46.174985    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vzt9x" podStartSLOduration=2.332304867 podStartE2EDuration="25.174971966s" totalImagesPullingTime="22.842667099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:46.174833752 +0000 UTC m=+25.835666911" watchObservedRunningTime="2026-07-24 13:45:46.174971966 +0000 UTC m=+25.835805125"
Jul 24 13:45:46.858794 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:46.858759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:46.859021 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:46.858921    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:47.568434 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:47.568393    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:47.569261 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:47.569059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:47.859337 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:47.859255    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:47.859510 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:47.859394    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:47.859510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:47.859429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:47.859608 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:47.859519    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:48.162250 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:48.162177    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:48.162883 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:48.162865    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j9ft7"
Jul 24 13:45:48.858681 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:48.858438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:48.859414 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:48.858788    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:49.165898 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.165794    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66" containerID="f322b131f67adfd4ffc87d3d5b21f9a99ca99d3e6363cd27b8aba56ed5a11016" exitCode=0
Jul 24 13:45:49.165898 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.165867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerDied","Data":"f322b131f67adfd4ffc87d3d5b21f9a99ca99d3e6363cd27b8aba56ed5a11016"}
Jul 24 13:45:49.170011 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.169743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" event={"ID":"ea48d077-a12f-4416-9805-3b69c544b08d","Type":"ContainerStarted","Data":"362b4777bce9ec3e0e3464bc52d640dd9e9309d1921bab18196caa94e0375e20"}
Jul 24 13:45:49.170113 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.170094    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:49.170192 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.170178    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:49.185765 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.185745    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:49.210294 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.210255    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt" podStartSLOduration=7.603011739 podStartE2EDuration="28.210242713s" totalImagesPullingTime="20.607230974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:49.209665165 +0000 UTC m=+28.870498347" watchObservedRunningTime="2026-07-24 13:45:49.210242713 +0000 UTC m=+28.871075902"
Jul 24 13:45:49.858685 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.858652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:49.859292 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:49.858666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:49.859292 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:49.858777    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:49.859292 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:49.858881    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:50.172218 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.172140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:50.187799 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.187774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:45:50.678356 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.678137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wk5nd"]
Jul 24 13:45:50.678558 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.678505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:50.678628 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:50.678608    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:50.681631 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.681585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sfz8b"]
Jul 24 13:45:50.681859 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.681726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:50.681999 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:50.681851    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:50.682305 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.682279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-772jm"]
Jul 24 13:45:50.682440 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:50.682387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:50.682507 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:50.682483    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:51.177614 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:51.177532    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66" containerID="172498d41b684e46cc5332f4bb3c17896302e43b03cc0e46293ec22ee8139d9f" exitCode=0
Jul 24 13:45:51.177983 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:51.177649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerDied","Data":"172498d41b684e46cc5332f4bb3c17896302e43b03cc0e46293ec22ee8139d9f"}
Jul 24 13:45:51.859203 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:51.859178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:51.859338 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:51.859181    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:51.859338 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:51.859281    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:51.859426 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:51.859347    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:52.858757 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:52.858729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:52.859134 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:52.858848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:53.184555 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:53.184474    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66" containerID="f8c83e0050a45e8a9e9685471f7f1b19c7b0b871391afc9ba10b49ecc48b128f" exitCode=0
Jul 24 13:45:53.184555 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:53.184518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerDied","Data":"f8c83e0050a45e8a9e9685471f7f1b19c7b0b871391afc9ba10b49ecc48b128f"}
Jul 24 13:45:53.562782 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:53.562696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:53.562782 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:53.562734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:53.562967 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.562849    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:53.562967 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.562849    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:53.562967 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.562902    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret podName:f7eadae5-68df-4f23-b0ee-36f6973a1b9b nodeName:}" failed. No retries permitted until 2026-07-24 13:46:25.562885612 +0000 UTC m=+65.223718765 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret") pod "global-pull-secret-syncer-wk5nd" (UID: "f7eadae5-68df-4f23-b0ee-36f6973a1b9b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:53.562967 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.562917    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:46:25.562910573 +0000 UTC m=+65.223743710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:53.663221 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:53.663185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:53.663465 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.663338    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:53.663555 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.663492    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:53.663555 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.663509    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7xl8h for pod openshift-network-diagnostics/network-check-target-sfz8b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:53.663643 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.663580    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h podName:454be6de-9835-47c8-b0fb-5355ce1d7d1e nodeName:}" failed. No retries permitted until 2026-07-24 13:46:25.663565474 +0000 UTC m=+65.324398630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xl8h" (UniqueName: "kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h") pod "network-check-target-sfz8b" (UID: "454be6de-9835-47c8-b0fb-5355ce1d7d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:53.859131 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:53.859050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:53.859565 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.859178    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sfz8b" podUID="454be6de-9835-47c8-b0fb-5355ce1d7d1e"
Jul 24 13:45:53.859565 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:53.859230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:53.859565 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:53.859331    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk5nd" podUID="f7eadae5-68df-4f23-b0ee-36f6973a1b9b"
Jul 24 13:45:54.859401 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:54.859361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:54.859799 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:54.859508    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:45:55.663532 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.663251    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-103.ec2.internal" event="NodeReady"
Jul 24 13:45:55.663664 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.663635    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 13:45:55.709302 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.709271    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lckcr"]
Jul 24 13:45:55.711759 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.711734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.712290 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.712267    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kgqz2"]
Jul 24 13:45:55.713896 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.713879    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:55.714214 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.714083    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 13:45:55.714572 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.714552    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5lp\""
Jul 24 13:45:55.714658 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.714611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 13:45:55.717024 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.717006    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 13:45:55.717129 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.717024    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 13:45:55.717129 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.717015    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gc8ks\""
Jul 24 13:45:55.717602 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.717579    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 13:45:55.728669 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.728643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lckcr"]
Jul 24 13:45:55.728991 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.728968    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kgqz2"]
Jul 24 13:45:55.858782 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.858751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:45:55.858995 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.858973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:45:55.861705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.861661    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 13:45:55.861705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.861668    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 13:45:55.862110 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.861748    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 13:45:55.862110 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.861926    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h5k24\""
Jul 24 13:45:55.879857 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.879838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b4xl\" (UniqueName: \"kubernetes.io/projected/9b87842e-6bb1-4435-9b5f-efbb63a4ba38-kube-api-access-8b4xl\") pod \"ingress-canary-kgqz2\" (UID: \"9b87842e-6bb1-4435-9b5f-efbb63a4ba38\") " pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:55.879971 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.879863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7484e221-d2ef-49df-9f6d-694edcc4b4bf-config-volume\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.879971 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.879887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7484e221-d2ef-49df-9f6d-694edcc4b4bf-tmp-dir\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.879971 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.879932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.879971 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.879956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b87842e-6bb1-4435-9b5f-efbb63a4ba38-cert\") pod \"ingress-canary-kgqz2\" (UID: \"9b87842e-6bb1-4435-9b5f-efbb63a4ba38\") " pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:55.880149 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.879995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b6f8\" (UniqueName: \"kubernetes.io/projected/7484e221-d2ef-49df-9f6d-694edcc4b4bf-kube-api-access-5b6f8\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.980772 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.980688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b4xl\" (UniqueName: \"kubernetes.io/projected/9b87842e-6bb1-4435-9b5f-efbb63a4ba38-kube-api-access-8b4xl\") pod \"ingress-canary-kgqz2\" (UID: \"9b87842e-6bb1-4435-9b5f-efbb63a4ba38\") " pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:55.980772 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.980731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7484e221-d2ef-49df-9f6d-694edcc4b4bf-config-volume\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.981015 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.980771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7484e221-d2ef-49df-9f6d-694edcc4b4bf-tmp-dir\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.981015 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.980845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.981015 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.980871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b87842e-6bb1-4435-9b5f-efbb63a4ba38-cert\") pod \"ingress-canary-kgqz2\" (UID: \"9b87842e-6bb1-4435-9b5f-efbb63a4ba38\") " pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:55.981015 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.980911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b6f8\" (UniqueName: \"kubernetes.io/projected/7484e221-d2ef-49df-9f6d-694edcc4b4bf-kube-api-access-5b6f8\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.981015 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:55.980990    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:55.981258 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:55.981060    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:56.481044211 +0000 UTC m=+36.141877348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:55.981487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.981465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7484e221-d2ef-49df-9f6d-694edcc4b4bf-config-volume\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.981631 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.981615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7484e221-d2ef-49df-9f6d-694edcc4b4bf-tmp-dir\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:55.986038 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.986016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b87842e-6bb1-4435-9b5f-efbb63a4ba38-cert\") pod \"ingress-canary-kgqz2\" (UID: \"9b87842e-6bb1-4435-9b5f-efbb63a4ba38\") " pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:55.989461 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.989439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b4xl\" (UniqueName: \"kubernetes.io/projected/9b87842e-6bb1-4435-9b5f-efbb63a4ba38-kube-api-access-8b4xl\") pod \"ingress-canary-kgqz2\" (UID: \"9b87842e-6bb1-4435-9b5f-efbb63a4ba38\") " pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:55.992056 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:55.992031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b6f8\" (UniqueName: \"kubernetes.io/projected/7484e221-d2ef-49df-9f6d-694edcc4b4bf-kube-api-access-5b6f8\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:56.032736 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:56.032703    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kgqz2"
Jul 24 13:45:56.485315 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:56.485276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:56.485518 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:56.485456    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:56.485589 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:56.485540    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:57.485518783 +0000 UTC m=+37.146351991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:56.858734 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:56.858644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:45:56.861281 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:56.861260    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 13:45:56.861281 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:56.861280    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbf75\""
Jul 24 13:45:57.285710 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:57.285679    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kgqz2"]
Jul 24 13:45:57.289278 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:45:57.289032    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b87842e_6bb1_4435_9b5f_efbb63a4ba38.slice/crio-1117b535a6d84aaf3748999e00edfcc8abcdb75122e3a1b6aea40ff498257e6e WatchSource:0}: Error finding container 1117b535a6d84aaf3748999e00edfcc8abcdb75122e3a1b6aea40ff498257e6e: Status 404 returned error can't find the container with id 1117b535a6d84aaf3748999e00edfcc8abcdb75122e3a1b6aea40ff498257e6e
Jul 24 13:45:57.494165 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:57.494064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:57.494283 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:57.494189    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:57.494283 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:57.494242    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:59.494228275 +0000 UTC m=+39.155061411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:58.196788 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:58.196751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kgqz2" event={"ID":"9b87842e-6bb1-4435-9b5f-efbb63a4ba38","Type":"ContainerStarted","Data":"1117b535a6d84aaf3748999e00edfcc8abcdb75122e3a1b6aea40ff498257e6e"}
Jul 24 13:45:58.199759 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:58.199724    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66" containerID="4156a62cbac7023a2023c2164d75603c1c2d5ffa6f597fc7cce505cda0aac45f" exitCode=0
Jul 24 13:45:58.199914 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:58.199796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerDied","Data":"4156a62cbac7023a2023c2164d75603c1c2d5ffa6f597fc7cce505cda0aac45f"}
Jul 24 13:45:59.208801 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:59.208767    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66" containerID="8fd7e126f7c1a67ce7d3d7d75e6fbbe5d59da7f86182647452947d1951a483fa" exitCode=0
Jul 24 13:45:59.209259 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:59.208856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerDied","Data":"8fd7e126f7c1a67ce7d3d7d75e6fbbe5d59da7f86182647452947d1951a483fa"}
Jul 24 13:45:59.509343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:45:59.509316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:45:59.509469 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:59.509437    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:59.509519 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:45:59.509491    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:46:03.509476784 +0000 UTC m=+43.170309922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:46:00.214939 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:00.214850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" event={"ID":"b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66","Type":"ContainerStarted","Data":"ae649c376f9922b13209d8f28304dafe09f9435e5d02cd9c1a1ef045bde69fa7"}
Jul 24 13:46:00.216243 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:00.216216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kgqz2" event={"ID":"9b87842e-6bb1-4435-9b5f-efbb63a4ba38","Type":"ContainerStarted","Data":"b3c83e64e72180074762d1d2a4cfc45fdb896c4ae49248a6396b14b38055c44d"}
Jul 24 13:46:00.238307 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:00.238262    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cnsdl" podStartSLOduration=8.028559103 podStartE2EDuration="39.238244489s" totalImagesPullingTime="31.209685386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:46:00.23697877 +0000 UTC m=+39.897811928" watchObservedRunningTime="2026-07-24 13:46:00.238244489 +0000 UTC m=+39.899077651"
Jul 24 13:46:00.252706 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:00.252667    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kgqz2" podStartSLOduration=2.779692181 podStartE2EDuration="5.252654009s" totalImagesPullingTime="2.472961828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:46:00.252206602 +0000 UTC m=+39.913039760" watchObservedRunningTime="2026-07-24 13:46:00.252654009 +0000 UTC m=+39.913487169"
Jul 24 13:46:03.536913 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:03.536879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:46:03.537290 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:03.537041    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:46:03.537290 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:03.537108    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:46:11.537091323 +0000 UTC m=+51.197924464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:46:11.595505 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:11.595461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:46:11.596000 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:11.595579    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:46:11.596000 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:11.595643    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:46:27.595628851 +0000 UTC m=+67.256461988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:46:21.836247 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.836212    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"]
Jul 24 13:46:21.871909 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.871867    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"]
Jul 24 13:46:21.872071 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.871962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:21.874427 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.874403    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 13:46:21.874560 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.874433    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 13:46:21.874560 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.874412    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 13:46:21.874560 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.874421    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 13:46:21.874810 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.874795    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 13:46:21.875398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.875371    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 13:46:21.875494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.875468    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 13:46:21.967929 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.967889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:21.968100 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.967941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:21.968100 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.967977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f89a59-bcde-49c5-a91e-4d888d018ff7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:21.968100 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.967993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx6kt\" (UniqueName: \"kubernetes.io/projected/79f89a59-bcde-49c5-a91e-4d888d018ff7-kube-api-access-mx6kt\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:21.968100 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.968017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-ca\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:21.968233 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:21.968099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-hub\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.068504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.068468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.068649 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.068515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f89a59-bcde-49c5-a91e-4d888d018ff7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.068649 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.068534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx6kt\" (UniqueName: \"kubernetes.io/projected/79f89a59-bcde-49c5-a91e-4d888d018ff7-kube-api-access-mx6kt\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.068753 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.068646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-ca\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.068753 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.068707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-hub\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.068753 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.068737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.070426 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.069593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f89a59-bcde-49c5-a91e-4d888d018ff7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.073633 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.073471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.073633 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.073575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-hub\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.073795 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.073775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-ca\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.075087 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.075061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79f89a59-bcde-49c5-a91e-4d888d018ff7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.076107 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.076089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx6kt\" (UniqueName: \"kubernetes.io/projected/79f89a59-bcde-49c5-a91e-4d888d018ff7-kube-api-access-mx6kt\") pod \"cluster-proxy-proxy-agent-778f4f7df-fz45l\" (UID: \"79f89a59-bcde-49c5-a91e-4d888d018ff7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.194084 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.194003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:46:22.199153 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.199129    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdkxt"
Jul 24 13:46:22.344058 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:22.344028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"]
Jul 24 13:46:22.347312 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:46:22.347283    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79f89a59_bcde_49c5_a91e_4d888d018ff7.slice/crio-fac2f4e4ba2950175bc89083052d1064677a644f530c034a2d8ccda019522f29 WatchSource:0}: Error finding container fac2f4e4ba2950175bc89083052d1064677a644f530c034a2d8ccda019522f29: Status 404 returned error can't find the container with id fac2f4e4ba2950175bc89083052d1064677a644f530c034a2d8ccda019522f29
Jul 24 13:46:23.269588 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:23.269548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" event={"ID":"79f89a59-bcde-49c5-a91e-4d888d018ff7","Type":"ContainerStarted","Data":"fac2f4e4ba2950175bc89083052d1064677a644f530c034a2d8ccda019522f29"}
Jul 24 13:46:25.596643 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.596601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:46:25.597087 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.596665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:46:25.599400 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.599375    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 13:46:25.599569 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.599428    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 13:46:25.607730 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:25.607709    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 13:46:25.607863 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:25.607779    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:47:29.607758197 +0000 UTC m=+129.268591356 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : secret "metrics-daemon-secret" not found
Jul 24 13:46:25.610394 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.610371    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7eadae5-68df-4f23-b0ee-36f6973a1b9b-original-pull-secret\") pod \"global-pull-secret-syncer-wk5nd\" (UID: \"f7eadae5-68df-4f23-b0ee-36f6973a1b9b\") " pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:46:25.697402 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.697360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:46:25.700307 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.700273    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 13:46:25.710369 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.710332    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 13:46:25.721987 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.721962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xl8h\" (UniqueName: \"kubernetes.io/projected/454be6de-9835-47c8-b0fb-5355ce1d7d1e-kube-api-access-7xl8h\") pod \"network-check-target-sfz8b\" (UID: \"454be6de-9835-47c8-b0fb-5355ce1d7d1e\") " pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:46:25.870109 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.870030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk5nd"
Jul 24 13:46:25.877194 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.877172    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h5k24\""
Jul 24 13:46:25.885927 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:25.885897    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:46:26.016572 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.016545    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wk5nd"]
Jul 24 13:46:26.020355 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:46:26.020314    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7eadae5_68df_4f23_b0ee_36f6973a1b9b.slice/crio-94556d5c95e93ad1a17f82d109e4b1d22871cb05cbd99315eadb702920e8cda8 WatchSource:0}: Error finding container 94556d5c95e93ad1a17f82d109e4b1d22871cb05cbd99315eadb702920e8cda8: Status 404 returned error can't find the container with id 94556d5c95e93ad1a17f82d109e4b1d22871cb05cbd99315eadb702920e8cda8
Jul 24 13:46:26.035136 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.035120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sfz8b"]
Jul 24 13:46:26.038665 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:46:26.038641    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454be6de_9835_47c8_b0fb_5355ce1d7d1e.slice/crio-9fdb0be2282efd5b61529144789ac30ce4165cdbe2320bfad52c6e1c8ed3fed5 WatchSource:0}: Error finding container 9fdb0be2282efd5b61529144789ac30ce4165cdbe2320bfad52c6e1c8ed3fed5: Status 404 returned error can't find the container with id 9fdb0be2282efd5b61529144789ac30ce4165cdbe2320bfad52c6e1c8ed3fed5
Jul 24 13:46:26.279982 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.279942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" event={"ID":"79f89a59-bcde-49c5-a91e-4d888d018ff7","Type":"ContainerStarted","Data":"7c98109327ebd8a2296310ce4a46885724854977bbf811bd54182cdd58eda23e"}
Jul 24 13:46:26.280160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.279992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" event={"ID":"79f89a59-bcde-49c5-a91e-4d888d018ff7","Type":"ContainerStarted","Data":"736499709a06598c20bc653a37e48fc89217f7d16e51e4a4ff84892c8982e7ce"}
Jul 24 13:46:26.280160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.280007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" event={"ID":"79f89a59-bcde-49c5-a91e-4d888d018ff7","Type":"ContainerStarted","Data":"510817782c42adda9f6f80d37216e4bf9f33160a4b03271cf7bd35ff4efaf014"}
Jul 24 13:46:26.281103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.281080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wk5nd" event={"ID":"f7eadae5-68df-4f23-b0ee-36f6973a1b9b","Type":"ContainerStarted","Data":"94556d5c95e93ad1a17f82d109e4b1d22871cb05cbd99315eadb702920e8cda8"}
Jul 24 13:46:26.282110 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.282091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sfz8b" event={"ID":"454be6de-9835-47c8-b0fb-5355ce1d7d1e","Type":"ContainerStarted","Data":"9fdb0be2282efd5b61529144789ac30ce4165cdbe2320bfad52c6e1c8ed3fed5"}
Jul 24 13:46:26.297700 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:26.297653    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" podStartSLOduration=1.752406081 podStartE2EDuration="5.297641479s" totalImagesPullingTime="3.545235398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:46:26.2973366 +0000 UTC m=+65.958169758" watchObservedRunningTime="2026-07-24 13:46:26.297641479 +0000 UTC m=+65.958474635"
Jul 24 13:46:27.611712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:27.611056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:46:27.611712 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:27.611228    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:46:27.611712 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:27.611319    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:46:59.611298769 +0000 UTC m=+99.272131910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:46:31.299279 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:31.299242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sfz8b" event={"ID":"454be6de-9835-47c8-b0fb-5355ce1d7d1e","Type":"ContainerStarted","Data":"b80b8cfc58dfb7f643b550fd5e420b515377bb2a256323fddeceaa1b8911114f"}
Jul 24 13:46:31.299729 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:31.299341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:46:31.300657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:31.300635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wk5nd" event={"ID":"f7eadae5-68df-4f23-b0ee-36f6973a1b9b","Type":"ContainerStarted","Data":"dabd38fd7bcf3b0186bf8923650d3ba297a0eb969d5bc2637a605844115178af"}
Jul 24 13:46:31.315048 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:31.315003    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sfz8b" podStartSLOduration=65.529642858 podStartE2EDuration="1m10.314990711s" totalImagesPullingTime="4.785347853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:46:31.314801247 +0000 UTC m=+70.975634405" watchObservedRunningTime="2026-07-24 13:46:31.314990711 +0000 UTC m=+70.975823870"
Jul 24 13:46:31.332435 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:31.332393    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wk5nd" podStartSLOduration=65.51860908 podStartE2EDuration="1m10.33238165s" totalImagesPullingTime="4.81377257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:46:31.331881758 +0000 UTC m=+70.992714918" watchObservedRunningTime="2026-07-24 13:46:31.33238165 +0000 UTC m=+70.993214809"
Jul 24 13:46:59.627835 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:46:59.627688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:46:59.628325 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:59.627874    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:46:59.628325 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:46:59.627951    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:48:03.627935439 +0000 UTC m=+163.288768576 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:47:02.305353 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:47:02.305323    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sfz8b"
Jul 24 13:47:29.643784 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:47:29.643728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:47:29.644255 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:47:29.643903    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 13:47:29.644255 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:47:29.643975    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:31.643957026 +0000 UTC m=+251.304790163 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : secret "metrics-daemon-secret" not found
Jul 24 13:47:58.726017 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:47:58.725964    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lckcr" podUID="7484e221-d2ef-49df-9f6d-694edcc4b4bf"
Jul 24 13:47:59.547916 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:47:59.547883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lckcr"
Jul 24 13:47:59.869055 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:47:59.868953    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:48:03.671427 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:48:03.671381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:48:03.671869 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:48:03.671556    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:48:03.671869 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:48:03.671627    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls podName:7484e221-d2ef-49df-9f6d-694edcc4b4bf nodeName:}" failed. No retries permitted until 2026-07-24 13:50:05.671609932 +0000 UTC m=+285.332443069 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls") pod "dns-default-lckcr" (UID: "7484e221-d2ef-49df-9f6d-694edcc4b4bf") : secret "dns-default-metrics-tls" not found
Jul 24 13:48:13.858694 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:48:13.858591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:49:19.281397 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.281364    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"]
Jul 24 13:49:19.283447 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.283431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.301956 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.301934    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 13:49:19.302194 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.302180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 13:49:19.302569 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.302553    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xcrgk\""
Jul 24 13:49:19.312690 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.312669    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 13:49:19.313294 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.313274    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"]
Jul 24 13:49:19.314643 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.314623    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 13:49:19.315086 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.315071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.320200 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.320181    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 13:49:19.321493 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.321476    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 13:49:19.323046 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.323029    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bz29t\""
Jul 24 13:49:19.323852 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.323836    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 13:49:19.329122 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.329101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"]
Jul 24 13:49:19.362924 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.362896    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 13:49:19.369760 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.369735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"]
Jul 24 13:49:19.378874 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.378842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.378994 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.378881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgfhk\" (UniqueName: \"kubernetes.io/projected/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-kube-api-access-bgfhk\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.378994 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.378934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.479267 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.479267 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgfhk\" (UniqueName: \"kubernetes.io/projected/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-kube-api-access-bgfhk\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.479544 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-installation-pull-secrets\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.479544 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.479544 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-certificates\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.479544 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznpx\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-kube-api-access-fznpx\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.479544 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-bound-sa-token\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.479544 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:19.479490    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:19.479774 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-image-registry-private-configuration\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.479774 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:19.479587    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls podName:dfcd24cc-942f-4735-8cbb-8e3f14f38b63 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:19.979572416 +0000 UTC m=+239.640405554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ql9hc" (UID: "dfcd24cc-942f-4735-8cbb-8e3f14f38b63") : secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:19.479774 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94ddc4b-d933-43f1-90c8-4a58ea177db1-ca-trust-extracted\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.479774 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-trusted-ca\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.479774 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.479657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.480074 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.480058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.488173 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.488151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgfhk\" (UniqueName: \"kubernetes.io/projected/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-kube-api-access-bgfhk\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.580418 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-installation-pull-secrets\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580418 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-certificates\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580418 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznpx\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-kube-api-access-fznpx\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580418 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-bound-sa-token\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580731 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-image-registry-private-configuration\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580731 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94ddc4b-d933-43f1-90c8-4a58ea177db1-ca-trust-extracted\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580731 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-trusted-ca\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580731 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.580509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.580731 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:19.580609    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:49:19.580731 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:19.580629    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4dbcbfbc-2pxsg: secret "image-registry-tls" not found
Jul 24 13:49:19.580731 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:19.580703    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls podName:f94ddc4b-d933-43f1-90c8-4a58ea177db1 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:20.080683326 +0000 UTC m=+239.741516484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls") pod "image-registry-b4dbcbfbc-2pxsg" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1") : secret "image-registry-tls" not found
Jul 24 13:49:19.581089 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.581034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-certificates\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.581089 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.581034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94ddc4b-d933-43f1-90c8-4a58ea177db1-ca-trust-extracted\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.581549 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.581526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-trusted-ca\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.582982 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.582959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-installation-pull-secrets\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.583072 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.582992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-image-registry-private-configuration\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.592377 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.592350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznpx\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-kube-api-access-fznpx\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.592470 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.592365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-bound-sa-token\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:19.983084 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:19.983049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:19.983294 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:19.983192    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:19.983294 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:19.983261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls podName:dfcd24cc-942f-4735-8cbb-8e3f14f38b63 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:20.983247219 +0000 UTC m=+240.644080360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ql9hc" (UID: "dfcd24cc-942f-4735-8cbb-8e3f14f38b63") : secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:20.083514 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:20.083481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:20.083664 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:20.083630    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:49:20.083664 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:20.083651    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4dbcbfbc-2pxsg: secret "image-registry-tls" not found
Jul 24 13:49:20.083734 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:20.083715    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls podName:f94ddc4b-d933-43f1-90c8-4a58ea177db1 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:21.083699443 +0000 UTC m=+240.744532579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls") pod "image-registry-b4dbcbfbc-2pxsg" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1") : secret "image-registry-tls" not found
Jul 24 13:49:20.989611 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:20.989554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:20.990037 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:20.989712    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:20.990037 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:20.989787    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls podName:dfcd24cc-942f-4735-8cbb-8e3f14f38b63 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:22.989767669 +0000 UTC m=+242.650600816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ql9hc" (UID: "dfcd24cc-942f-4735-8cbb-8e3f14f38b63") : secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:21.090422 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:21.090390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:21.090532 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:21.090513    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:49:21.090532 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:21.090525    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4dbcbfbc-2pxsg: secret "image-registry-tls" not found
Jul 24 13:49:21.090608 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:21.090574    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls podName:f94ddc4b-d933-43f1-90c8-4a58ea177db1 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:23.090559873 +0000 UTC m=+242.751393010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls") pod "image-registry-b4dbcbfbc-2pxsg" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1") : secret "image-registry-tls" not found
Jul 24 13:49:23.004742 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:23.004691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:23.005186 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:23.004850    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:23.005186 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:23.004912    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls podName:dfcd24cc-942f-4735-8cbb-8e3f14f38b63 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:27.004896784 +0000 UTC m=+246.665729920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ql9hc" (UID: "dfcd24cc-942f-4735-8cbb-8e3f14f38b63") : secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:23.105692 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:23.105662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:23.105779 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:23.105766    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:49:23.105779 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:23.105777    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4dbcbfbc-2pxsg: secret "image-registry-tls" not found
Jul 24 13:49:23.105870 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:23.105853    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls podName:f94ddc4b-d933-43f1-90c8-4a58ea177db1 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:27.105838405 +0000 UTC m=+246.766671541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls") pod "image-registry-b4dbcbfbc-2pxsg" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1") : secret "image-registry-tls" not found
Jul 24 13:49:25.346441 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.346407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m64p8"]
Jul 24 13:49:25.349075 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.349054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.351557 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.351534    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 13:49:25.351714 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.351649    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 13:49:25.352221 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.352206    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 13:49:25.352841 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.352811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dqt9s\""
Jul 24 13:49:25.354771 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.354752    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 13:49:25.361040 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.361016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m64p8"]
Jul 24 13:49:25.423972 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.423939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-data-volume\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.424157 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.423980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghm9r\" (UniqueName: \"kubernetes.io/projected/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-api-access-ghm9r\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.424157 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.424005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-crio-socket\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.424281 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.424180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.424281 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.424220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.525514 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.525476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghm9r\" (UniqueName: \"kubernetes.io/projected/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-api-access-ghm9r\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.525654 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.525522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-crio-socket\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.525654 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.525607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-crio-socket\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.525763 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.525727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.525842 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.525766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.525842 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.525805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-data-volume\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.525942 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:25.525873    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:25.525942 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:25.525893    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:25.525942 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:25.525932    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:26.025914409 +0000 UTC m=+245.686747549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:25.526094 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:25.525947    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:26.025940339 +0000 UTC m=+245.686773476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:25.526215 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.526195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-data-volume\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:25.535570 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:25.535547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghm9r\" (UniqueName: \"kubernetes.io/projected/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-api-access-ghm9r\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:26.028710 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:26.028675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:26.028710 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:26.028713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:26.028948 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:26.028802    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:26.028948 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:26.028852    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:26.028948 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:26.028906    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:27.02888529 +0000 UTC m=+246.689718450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:26.028948 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:26.028921    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:27.028914983 +0000 UTC m=+246.689748119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:27.036672 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:27.036639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:27.036672 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:27.036674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:27.037124 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.036761    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:27.037124 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.036788    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:27.037124 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.036854    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:29.036836429 +0000 UTC m=+248.697669566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:27.037124 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:27.036870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:27.037124 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.036920    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:29.036910512 +0000 UTC m=+248.697743649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:27.037124 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.036974    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:27.037124 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.037029    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls podName:dfcd24cc-942f-4735-8cbb-8e3f14f38b63 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:35.037015587 +0000 UTC m=+254.697848725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ql9hc" (UID: "dfcd24cc-942f-4735-8cbb-8e3f14f38b63") : secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:27.138170 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:27.138142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:27.138294 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.138277    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:49:27.138331 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.138295    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4dbcbfbc-2pxsg: secret "image-registry-tls" not found
Jul 24 13:49:27.138363 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:27.138339    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls podName:f94ddc4b-d933-43f1-90c8-4a58ea177db1 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:35.138325474 +0000 UTC m=+254.799158611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls") pod "image-registry-b4dbcbfbc-2pxsg" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1") : secret "image-registry-tls" not found
Jul 24 13:49:27.529256 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:27.529232    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kwxst_dba78e9a-afcb-4a83-ba48-0b7cdba7f480/dns-node-resolver/0.log"
Jul 24 13:49:28.330623 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:28.330594    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bfcdt_090e2288-7ba1-4606-9f4f-6845109b2f21/node-ca/0.log"
Jul 24 13:49:28.929338 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:28.929305    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kgqz2_9b87842e-6bb1-4435-9b5f-efbb63a4ba38/serve-healthcheck-canary/0.log"
Jul 24 13:49:29.052593 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:29.052560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:29.052593 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:29.052593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:29.052865 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:29.052675    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:29.052865 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:29.052729    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:33.052715453 +0000 UTC m=+252.713548590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:29.052865 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:29.052741    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:29.052865 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:29.052800    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:33.052783395 +0000 UTC m=+252.713616536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:31.674038 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:31.674001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:49:31.674452 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:31.674153    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 13:49:31.674452 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:31.674216    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs podName:8f166484-6e22-42a7-a142-39336af9517a nodeName:}" failed. No retries permitted until 2026-07-24 13:51:33.674200911 +0000 UTC m=+373.335034048 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs") pod "network-metrics-daemon-772jm" (UID: "8f166484-6e22-42a7-a142-39336af9517a") : secret "metrics-daemon-secret" not found
Jul 24 13:49:33.088763 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:33.088720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:33.088763 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:33.088766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:33.089234 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:33.088879    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:33.089234 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:33.088925    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:33.089234 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:33.088944    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:41.088927879 +0000 UTC m=+260.749761015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:33.089234 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:33.088976    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:41.088963226 +0000 UTC m=+260.749796401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:35.105088 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.105050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:35.105511 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:35.105201    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:35.105511 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:35.105266    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls podName:dfcd24cc-942f-4735-8cbb-8e3f14f38b63 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:51.105251128 +0000 UTC m=+270.766084265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ql9hc" (UID: "dfcd24cc-942f-4735-8cbb-8e3f14f38b63") : secret "cluster-monitoring-operator-tls" not found
Jul 24 13:49:35.206277 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.206238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:35.208867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.208843    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"image-registry-b4dbcbfbc-2pxsg\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") " pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:35.226102 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.226069    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bz29t\""
Jul 24 13:49:35.234807 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.234785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:35.359743 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.359659    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"]
Jul 24 13:49:35.363405 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:49:35.363378    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94ddc4b_d933_43f1_90c8_4a58ea177db1.slice/crio-73370680e38a4f7081a26fb62d45a7a73cf36758d08a032a963dd48b30b9e7ef WatchSource:0}: Error finding container 73370680e38a4f7081a26fb62d45a7a73cf36758d08a032a963dd48b30b9e7ef: Status 404 returned error can't find the container with id 73370680e38a4f7081a26fb62d45a7a73cf36758d08a032a963dd48b30b9e7ef
Jul 24 13:49:35.816884 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.816848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" event={"ID":"f94ddc4b-d933-43f1-90c8-4a58ea177db1","Type":"ContainerStarted","Data":"ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66"}
Jul 24 13:49:35.817072 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.816899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" event={"ID":"f94ddc4b-d933-43f1-90c8-4a58ea177db1","Type":"ContainerStarted","Data":"73370680e38a4f7081a26fb62d45a7a73cf36758d08a032a963dd48b30b9e7ef"}
Jul 24 13:49:35.817072 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.816930    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:49:35.836365 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:35.836321    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" podStartSLOduration=16.836305103 podStartE2EDuration="16.836305103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:35.835581662 +0000 UTC m=+255.496414822" watchObservedRunningTime="2026-07-24 13:49:35.836305103 +0000 UTC m=+255.497138261"
Jul 24 13:49:41.152459 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:41.152360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:41.152459 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:41.152421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:41.152904 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:41.152511    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:41.152904 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:49:41.152578    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls podName:5fd02cc8-40df-471d-94c5-e0386f9c6ed2 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:57.152559857 +0000 UTC m=+276.813392995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m64p8" (UID: "5fd02cc8-40df-471d-94c5-e0386f9c6ed2") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:41.152983 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:41.152949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:47.187614 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:47.187577    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"]
Jul 24 13:49:51.122251 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:51.122206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:51.124855 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:51.124806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfcd24cc-942f-4735-8cbb-8e3f14f38b63-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ql9hc\" (UID: \"dfcd24cc-942f-4735-8cbb-8e3f14f38b63\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:51.395389 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:51.395290    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xcrgk\""
Jul 24 13:49:51.403292 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:51.403270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"
Jul 24 13:49:51.524759 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:51.524730    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc"]
Jul 24 13:49:51.528006 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:49:51.527981    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcd24cc_942f_4735_8cbb_8e3f14f38b63.slice/crio-4176a342989c10b54edad63bee7eb5476a74ac8b0fb6c14d2ae4575efa80d975 WatchSource:0}: Error finding container 4176a342989c10b54edad63bee7eb5476a74ac8b0fb6c14d2ae4575efa80d975: Status 404 returned error can't find the container with id 4176a342989c10b54edad63bee7eb5476a74ac8b0fb6c14d2ae4575efa80d975
Jul 24 13:49:51.862547 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:51.862507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc" event={"ID":"dfcd24cc-942f-4735-8cbb-8e3f14f38b63","Type":"ContainerStarted","Data":"4176a342989c10b54edad63bee7eb5476a74ac8b0fb6c14d2ae4575efa80d975"}
Jul 24 13:49:53.869295 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:53.869262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc" event={"ID":"dfcd24cc-942f-4735-8cbb-8e3f14f38b63","Type":"ContainerStarted","Data":"e4c303423bc12e63aa8173b0d09e80c8163eedfd9d39d948248a7e309a8d8b85"}
Jul 24 13:49:53.884317 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:53.884252    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ql9hc" podStartSLOduration=33.181843362 podStartE2EDuration="34.884239012s" totalImagesPullingTime="1.70239565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:53.882873812 +0000 UTC m=+273.543706968" watchObservedRunningTime="2026-07-24 13:49:53.884239012 +0000 UTC m=+273.545072207"
Jul 24 13:49:57.167716 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:57.167662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:57.170141 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:57.170119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5fd02cc8-40df-471d-94c5-e0386f9c6ed2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m64p8\" (UID: \"5fd02cc8-40df-471d-94c5-e0386f9c6ed2\") " pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:57.192764 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:57.192731    2563 patch_prober.go:28] interesting pod/image-registry-b4dbcbfbc-2pxsg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 13:49:57.192893 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:57.192784    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" podUID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 13:49:57.457811 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:57.457730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m64p8"
Jul 24 13:49:57.578319 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:57.578289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m64p8"]
Jul 24 13:49:57.581131 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:49:57.581106    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd02cc8_40df_471d_94c5_e0386f9c6ed2.slice/crio-822b46df1a27b0b81ffdc90140dd5e74ef4e30451c298cbff80f49c8e7aa6354 WatchSource:0}: Error finding container 822b46df1a27b0b81ffdc90140dd5e74ef4e30451c298cbff80f49c8e7aa6354: Status 404 returned error can't find the container with id 822b46df1a27b0b81ffdc90140dd5e74ef4e30451c298cbff80f49c8e7aa6354
Jul 24 13:49:57.881181 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:49:57.881147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m64p8" event={"ID":"5fd02cc8-40df-471d-94c5-e0386f9c6ed2","Type":"ContainerStarted","Data":"822b46df1a27b0b81ffdc90140dd5e74ef4e30451c298cbff80f49c8e7aa6354"}
Jul 24 13:50:01.185141 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.185102    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5xt5v"]
Jul 24 13:50:01.204366 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.204338    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.206953 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.206929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 13:50:01.207125 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.207100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 13:50:01.207600 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.207579    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dgt7z\""
Jul 24 13:50:01.207705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.207676    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 13:50:01.207705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.207691    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 13:50:01.304101 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304312 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-tls\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304312 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304312 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-wtmp\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304312 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-textfile\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304312 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a68b7195-58a9-4495-a22c-f04b9a8446d8-metrics-client-ca\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304583 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-root\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304583 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-sys\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.304583 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.304553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwfcl\" (UniqueName: \"kubernetes.io/projected/a68b7195-58a9-4495-a22c-f04b9a8446d8-kube-api-access-zwfcl\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405075 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwfcl\" (UniqueName: \"kubernetes.io/projected/a68b7195-58a9-4495-a22c-f04b9a8446d8-kube-api-access-zwfcl\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-tls\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-wtmp\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-textfile\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405517 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a68b7195-58a9-4495-a22c-f04b9a8446d8-metrics-client-ca\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405517 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-root\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405517 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-sys\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405634 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-wtmp\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.405886 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-textfile\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.406017 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.405997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a68b7195-58a9-4495-a22c-f04b9a8446d8-metrics-client-ca\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.406091 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.406076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-root\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.406257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.406223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a68b7195-58a9-4495-a22c-f04b9a8446d8-sys\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.406356 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:50:01.406326    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 13:50:01.406411 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:50:01.406385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-tls podName:a68b7195-58a9-4495-a22c-f04b9a8446d8 nodeName:}" failed. No retries permitted until 2026-07-24 13:50:01.906366109 +0000 UTC m=+281.567199253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-tls") pod "node-exporter-5xt5v" (UID: "a68b7195-58a9-4495-a22c-f04b9a8446d8") : secret "node-exporter-tls" not found
Jul 24 13:50:01.406512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.406490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.408782 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.408760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.414358 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.414315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwfcl\" (UniqueName: \"kubernetes.io/projected/a68b7195-58a9-4495-a22c-f04b9a8446d8-kube-api-access-zwfcl\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.909355 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.909309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-tls\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:01.912114 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:01.912067    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a68b7195-58a9-4495-a22c-f04b9a8446d8-node-exporter-tls\") pod \"node-exporter-5xt5v\" (UID: \"a68b7195-58a9-4495-a22c-f04b9a8446d8\") " pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:02.115619 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.115586    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xt5v"
Jul 24 13:50:02.224080 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.224044    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:50:02.227071 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.227042    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.229564 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.229532    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 13:50:02.229705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.229582    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fvbwd\""
Jul 24 13:50:02.229705 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.229653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 13:50:02.229857 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.229841    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 13:50:02.229922 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.229887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 13:50:02.229922 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.229899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 13:50:02.230025 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.229999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 13:50:02.230103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.230079    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 13:50:02.230150 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.230108    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 13:50:02.230412 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.230394    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 13:50:02.250426 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.250390    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:50:02.313154 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhdvw\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-kube-api-access-dhdvw\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313339 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313193    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313339 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313339 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313492 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-volume\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313492 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313492 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-out\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313627 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313627 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313627 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313758 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-web-config\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313758 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.313758 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.313729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414362 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-web-config\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414494 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:50:02.414372    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68b7195_58a9_4495_a22c_f04b9a8446d8.slice/crio-3787732be1d7c98472d4b25b42b11cc5618361a594c9b949bb5503e11e1f1214 WatchSource:0}: Error finding container 3787732be1d7c98472d4b25b42b11cc5618361a594c9b949bb5503e11e1f1214: Status 404 returned error can't find the container with id 3787732be1d7c98472d4b25b42b11cc5618361a594c9b949bb5503e11e1f1214
Jul 24 13:50:02.414494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhdvw\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-kube-api-access-dhdvw\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-volume\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.414712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.415083 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-out\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.415083 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.415083 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.414868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.415231 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.415097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.415441 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.415418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.417524 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.417498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.417672 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.417649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-web-config\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.417672 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.417666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.418172 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:50:02.418069    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle podName:74439dc1-8d7e-444f-9e56-6cdeca3077be nodeName:}" failed. No retries permitted until 2026-07-24 13:50:02.918043781 +0000 UTC m=+282.578876932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be") : configmap references non-existent config key: ca-bundle.crt
Jul 24 13:50:02.418172 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.418129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.418899 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.418856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.419240 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.419181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.420834 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.420793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-volume\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.420935 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.420913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.421048 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.421027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-out\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.426923 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.426901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhdvw\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-kube-api-access-dhdvw\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.548486 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:50:02.548439    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lckcr" podUID="7484e221-d2ef-49df-9f6d-694edcc4b4bf"
Jul 24 13:50:02.898395 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.898297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m64p8" event={"ID":"5fd02cc8-40df-471d-94c5-e0386f9c6ed2","Type":"ContainerStarted","Data":"91ebd7997bb5da26ec557cbad99a074315eb0af89ec3dd7182f89c7f92e6ed74"}
Jul 24 13:50:02.899440 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.899420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lckcr"
Jul 24 13:50:02.899536 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.899434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xt5v" event={"ID":"a68b7195-58a9-4495-a22c-f04b9a8446d8","Type":"ContainerStarted","Data":"3787732be1d7c98472d4b25b42b11cc5618361a594c9b949bb5503e11e1f1214"}
Jul 24 13:50:02.919285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.919237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:02.920028 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:02.920005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:03.138545 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:03.138504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:50:03.332400 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:03.332319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:50:03.335603 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:50:03.335572    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74439dc1_8d7e_444f_9e56_6cdeca3077be.slice/crio-fba68305230c1a4d61b1bf10aea10c00793aa3a23b770682249da5c613b5897a WatchSource:0}: Error finding container fba68305230c1a4d61b1bf10aea10c00793aa3a23b770682249da5c613b5897a: Status 404 returned error can't find the container with id fba68305230c1a4d61b1bf10aea10c00793aa3a23b770682249da5c613b5897a
Jul 24 13:50:03.905895 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:03.905852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerStarted","Data":"fba68305230c1a4d61b1bf10aea10c00793aa3a23b770682249da5c613b5897a"}
Jul 24 13:50:03.908949 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:03.908916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xt5v" event={"ID":"a68b7195-58a9-4495-a22c-f04b9a8446d8","Type":"ContainerStarted","Data":"0e2aa5fef2d1ba4ff3ed059580ea9b6ea988755911fbc912ab990229f78fcbc2"}
Jul 24 13:50:04.223722 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.223684    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-545b948ffd-w9xcr"]
Jul 24 13:50:04.228249 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.228066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.230866 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.230835    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 13:50:04.230866 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.230861    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 13:50:04.231070 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.230872    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 13:50:04.231070 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.230906    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 13:50:04.231070 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.230907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 13:50:04.231398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.231376    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9o0tk2vkh8o9a\""
Jul 24 13:50:04.231780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.231760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pjq9q\""
Jul 24 13:50:04.240380 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.240362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-545b948ffd-w9xcr"]
Jul 24 13:50:04.333011 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.332954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.333011 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.333003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllbg\" (UniqueName: \"kubernetes.io/projected/88b111c8-31fc-4fc2-8522-44973e5ba769-kube-api-access-bllbg\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.333487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.333048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.333487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.333077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.333487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.333153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-tls\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.333487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.333208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-grpc-tls\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.333487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.333277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.333487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.333316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88b111c8-31fc-4fc2-8522-44973e5ba769-metrics-client-ca\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434398 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-tls\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434580 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-grpc-tls\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434580 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434580 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88b111c8-31fc-4fc2-8522-44973e5ba769-metrics-client-ca\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bllbg\" (UniqueName: \"kubernetes.io/projected/88b111c8-31fc-4fc2-8522-44973e5ba769-kube-api-access-bllbg\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.434867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.434845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.435376 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.435330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88b111c8-31fc-4fc2-8522-44973e5ba769-metrics-client-ca\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.438001 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.437957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.438112 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.438068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.438175 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.438107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.438247 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.438227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-grpc-tls\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.438342 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.438260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-tls\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.438972 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.438952    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88b111c8-31fc-4fc2-8522-44973e5ba769-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.443223 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.443194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllbg\" (UniqueName: \"kubernetes.io/projected/88b111c8-31fc-4fc2-8522-44973e5ba769-kube-api-access-bllbg\") pod \"thanos-querier-545b948ffd-w9xcr\" (UID: \"88b111c8-31fc-4fc2-8522-44973e5ba769\") " pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.538250 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.538168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:04.918951 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.916141    2563 generic.go:356] "Generic (PLEG): container finished" podID="a68b7195-58a9-4495-a22c-f04b9a8446d8" containerID="0e2aa5fef2d1ba4ff3ed059580ea9b6ea988755911fbc912ab990229f78fcbc2" exitCode=0
Jul 24 13:50:04.918951 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:04.916249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xt5v" event={"ID":"a68b7195-58a9-4495-a22c-f04b9a8446d8","Type":"ContainerDied","Data":"0e2aa5fef2d1ba4ff3ed059580ea9b6ea988755911fbc912ab990229f78fcbc2"}
Jul 24 13:50:05.745316 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:05.745282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:50:05.748056 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:05.748031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7484e221-d2ef-49df-9f6d-694edcc4b4bf-metrics-tls\") pod \"dns-default-lckcr\" (UID: \"7484e221-d2ef-49df-9f6d-694edcc4b4bf\") " pod="openshift-dns/dns-default-lckcr"
Jul 24 13:50:05.902603 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:05.902575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5lp\""
Jul 24 13:50:05.911479 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:05.911444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lckcr"
Jul 24 13:50:06.481855 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.481806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-545b948ffd-w9xcr"]
Jul 24 13:50:06.485752 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.485732    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lckcr"]
Jul 24 13:50:06.510846 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:50:06.510793    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b111c8_31fc_4fc2_8522_44973e5ba769.slice/crio-1921b7ef95e4d39e40744c97a4e68e80212aad24ce22613d89ecbdd8c6d92984 WatchSource:0}: Error finding container 1921b7ef95e4d39e40744c97a4e68e80212aad24ce22613d89ecbdd8c6d92984: Status 404 returned error can't find the container with id 1921b7ef95e4d39e40744c97a4e68e80212aad24ce22613d89ecbdd8c6d92984
Jul 24 13:50:06.529724 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:50:06.529701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7484e221_d2ef_49df_9f6d_694edcc4b4bf.slice/crio-4144b2e2814168d5c324db26c8c7c7e5a18a88e4c03c0140db2be2a2ee76a1c5 WatchSource:0}: Error finding container 4144b2e2814168d5c324db26c8c7c7e5a18a88e4c03c0140db2be2a2ee76a1c5: Status 404 returned error can't find the container with id 4144b2e2814168d5c324db26c8c7c7e5a18a88e4c03c0140db2be2a2ee76a1c5
Jul 24 13:50:06.925751 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.925710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m64p8" event={"ID":"5fd02cc8-40df-471d-94c5-e0386f9c6ed2","Type":"ContainerStarted","Data":"7704baed612abfaefdc6ecd446eab452decdf682fd18b112ed74abab9e9ee522"}
Jul 24 13:50:06.927351 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.927312    2563 generic.go:356] "Generic (PLEG): container finished" podID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerID="b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988" exitCode=0
Jul 24 13:50:06.927503 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.927403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988"}
Jul 24 13:50:06.928760 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.928738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lckcr" event={"ID":"7484e221-d2ef-49df-9f6d-694edcc4b4bf","Type":"ContainerStarted","Data":"4144b2e2814168d5c324db26c8c7c7e5a18a88e4c03c0140db2be2a2ee76a1c5"}
Jul 24 13:50:06.931421 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.931400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xt5v" event={"ID":"a68b7195-58a9-4495-a22c-f04b9a8446d8","Type":"ContainerStarted","Data":"e6585f6a1ed6b453678403c07794aec33f62f5ab8a894305789f8a934829e76e"}
Jul 24 13:50:06.931531 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.931441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xt5v" event={"ID":"a68b7195-58a9-4495-a22c-f04b9a8446d8","Type":"ContainerStarted","Data":"0c177130538b097b4ca7d764a7935adb3e9faaa5489cd27b0fbdf863eaee4d09"}
Jul 24 13:50:06.932792 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.932766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" event={"ID":"88b111c8-31fc-4fc2-8522-44973e5ba769","Type":"ContainerStarted","Data":"1921b7ef95e4d39e40744c97a4e68e80212aad24ce22613d89ecbdd8c6d92984"}
Jul 24 13:50:06.979437 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:06.978986    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5xt5v" podStartSLOduration=4.549868029 podStartE2EDuration="5.978968769s" totalImagesPullingTime="1.33785693s" totalInitContainerRuntime="91.24381ms" isStatefulPod=true podCreationTimestamp="2026-07-24 13:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:06.978908477 +0000 UTC m=+286.639741637" watchObservedRunningTime="2026-07-24 13:50:06.978968769 +0000 UTC m=+286.639801929"
Jul 24 13:50:07.193204 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:07.193098    2563 patch_prober.go:28] interesting pod/image-registry-b4dbcbfbc-2pxsg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 13:50:07.193204 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:07.193171    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" podUID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 13:50:11.953356 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.953310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lckcr" event={"ID":"7484e221-d2ef-49df-9f6d-694edcc4b4bf","Type":"ContainerStarted","Data":"a97bf74d32217f34591beab58f7aad58ce116aef536f57829008f3a838afa9fa"}
Jul 24 13:50:11.953780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.953380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lckcr" event={"ID":"7484e221-d2ef-49df-9f6d-694edcc4b4bf","Type":"ContainerStarted","Data":"66a86b04d32076243a4b2a8f0cb8dad5c8de92a4e46fe3a824c58028fa0252fb"}
Jul 24 13:50:11.953780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.953407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lckcr"
Jul 24 13:50:11.955374 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.955349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" event={"ID":"88b111c8-31fc-4fc2-8522-44973e5ba769","Type":"ContainerStarted","Data":"a7f41e08e27140e06bdc8f55856d55b2f5b0227a8e8e4a432a4f35eb9964f697"}
Jul 24 13:50:11.955476 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.955416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" event={"ID":"88b111c8-31fc-4fc2-8522-44973e5ba769","Type":"ContainerStarted","Data":"05dd483c0098fc785cd528b2fe8696242bb70ffedbd6015b3399cf7db2df8156"}
Jul 24 13:50:11.955476 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.955457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" event={"ID":"88b111c8-31fc-4fc2-8522-44973e5ba769","Type":"ContainerStarted","Data":"2412621dba890577bafcf61e65c62241641d685c0a0d48732bdae2bacfcc60a0"}
Jul 24 13:50:11.957243 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.957212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m64p8" event={"ID":"5fd02cc8-40df-471d-94c5-e0386f9c6ed2","Type":"ContainerStarted","Data":"e50a013dd0f71a485a26cb5d08ac39a41429ebf2538ff9b3c76ed8429de82790"}
Jul 24 13:50:11.960172 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.960152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerStarted","Data":"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"}
Jul 24 13:50:11.960275 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.960214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerStarted","Data":"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"}
Jul 24 13:50:11.960275 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.960257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerStarted","Data":"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"}
Jul 24 13:50:11.960383 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.960296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerStarted","Data":"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"}
Jul 24 13:50:11.960383 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.960336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerStarted","Data":"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"}
Jul 24 13:50:11.971298 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.971259    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lckcr" podStartSLOduration=252.334205341 podStartE2EDuration="4m16.97124373s" totalImagesPullingTime="4.637038389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:11.97044512 +0000 UTC m=+291.631278279" watchObservedRunningTime="2026-07-24 13:50:11.97124373 +0000 UTC m=+291.632077050"
Jul 24 13:50:11.987009 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:11.986964    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m64p8" podStartSLOduration=33.546293282 podStartE2EDuration="46.986954182s" totalImagesPullingTime="13.4406609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:49:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:11.986954232 +0000 UTC m=+291.647787404" watchObservedRunningTime="2026-07-24 13:50:11.986954182 +0000 UTC m=+291.647787335"
Jul 24 13:50:12.196132 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.196088    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" podUID="79f89a59-bcde-49c5-a91e-4d888d018ff7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 13:50:12.206629 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.206554    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" podUID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" containerName="registry" containerID="cri-o://ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66" gracePeriod=30
Jul 24 13:50:12.460967 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.460945    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:50:12.614649 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.614620    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-trusted-ca\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.614802 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.614671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-installation-pull-secrets\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.614802 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.614711    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-certificates\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.614960 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.614836    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-image-registry-private-configuration\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.614960 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.614912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fznpx\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-kube-api-access-fznpx\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.615063 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.614963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.615063 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.615006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-bound-sa-token\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.615063 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.615031    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94ddc4b-d933-43f1-90c8-4a58ea177db1-ca-trust-extracted\") pod \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\" (UID: \"f94ddc4b-d933-43f1-90c8-4a58ea177db1\") "
Jul 24 13:50:12.615198 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.615095    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:50:12.615198 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.615107    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:50:12.615368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.615295    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-trusted-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.615368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.615313    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-certificates\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.617315 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.617279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:50:12.617315 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.617303    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:50:12.617519 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.617494    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-kube-api-access-fznpx" (OuterVolumeSpecName: "kube-api-access-fznpx") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "kube-api-access-fznpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:50:12.617598 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.617552    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:50:12.617637 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.617589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:50:12.623517 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.623498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94ddc4b-d933-43f1-90c8-4a58ea177db1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f94ddc4b-d933-43f1-90c8-4a58ea177db1" (UID: "f94ddc4b-d933-43f1-90c8-4a58ea177db1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:50:12.716596 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.716513    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fznpx\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-kube-api-access-fznpx\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.716596 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.716544    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-registry-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.716596 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.716555    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f94ddc4b-d933-43f1-90c8-4a58ea177db1-bound-sa-token\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.716596 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.716563    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f94ddc4b-d933-43f1-90c8-4a58ea177db1-ca-trust-extracted\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.716596 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.716572    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-installation-pull-secrets\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.716596 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.716583    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f94ddc4b-d933-43f1-90c8-4a58ea177db1-image-registry-private-configuration\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:50:12.966839 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.966704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" event={"ID":"88b111c8-31fc-4fc2-8522-44973e5ba769","Type":"ContainerStarted","Data":"8e6b883025c7b31b74fcd189c9df4728c323eb139ce51c5964046f8d3bb9cfa1"}
Jul 24 13:50:12.966839 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.966791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" event={"ID":"88b111c8-31fc-4fc2-8522-44973e5ba769","Type":"ContainerStarted","Data":"9da9bf65268c665ddd95bd2e0a0b02f27f38f34fc615deda3527792dfe75d0e8"}
Jul 24 13:50:12.967289 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.966848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" event={"ID":"88b111c8-31fc-4fc2-8522-44973e5ba769","Type":"ContainerStarted","Data":"4e13d3eb28993ce3f0c2676cb227d6be9e2858544dc783b24f71ade297215e5f"}
Jul 24 13:50:12.967289 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.966894    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:12.967940 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.967919    2563 generic.go:356] "Generic (PLEG): container finished" podID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" containerID="ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66" exitCode=0
Jul 24 13:50:12.968010 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.967958    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"
Jul 24 13:50:12.968063 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.968007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" event={"ID":"f94ddc4b-d933-43f1-90c8-4a58ea177db1","Type":"ContainerDied","Data":"ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66"}
Jul 24 13:50:12.968111 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.968067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4dbcbfbc-2pxsg" event={"ID":"f94ddc4b-d933-43f1-90c8-4a58ea177db1","Type":"ContainerDied","Data":"73370680e38a4f7081a26fb62d45a7a73cf36758d08a032a963dd48b30b9e7ef"}
Jul 24 13:50:12.968111 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.968098    2563 scope.go:117] "RemoveContainer" containerID="ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66"
Jul 24 13:50:12.971885 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.971856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerStarted","Data":"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"}
Jul 24 13:50:12.976697 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.976680    2563 scope.go:117] "RemoveContainer" containerID="ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66"
Jul 24 13:50:12.976972 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:50:12.976952    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66\": container with ID starting with ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66 not found: ID does not exist" containerID="ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66"
Jul 24 13:50:12.977052 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.976985    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66"} err="failed to get container status \"ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66\": rpc error: code = NotFound desc = could not find container \"ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66\": container with ID starting with ef45e8ff21b37c75947769877e3183dc396cd277a8da10d44bf7963aeabe4f66 not found: ID does not exist"
Jul 24 13:50:12.992438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:12.992396    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr" podStartSLOduration=3.445628531 podStartE2EDuration="8.992381064s" totalImagesPullingTime="5.546752533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:12.990359747 +0000 UTC m=+292.651192906" watchObservedRunningTime="2026-07-24 13:50:12.992381064 +0000 UTC m=+292.653214222"
Jul 24 13:50:13.015510 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:13.015463    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.990050246 podStartE2EDuration="11.015447625s" totalImagesPullingTime="8.001986674s" totalInitContainerRuntime="23.410705ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:13.014042703 +0000 UTC m=+292.674876160" watchObservedRunningTime="2026-07-24 13:50:13.015447625 +0000 UTC m=+292.676280784"
Jul 24 13:50:13.028310 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:13.028283    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"]
Jul 24 13:50:13.031070 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:13.031047    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b4dbcbfbc-2pxsg"]
Jul 24 13:50:14.863571 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:14.863540    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" path="/var/lib/kubelet/pods/f94ddc4b-d933-43f1-90c8-4a58ea177db1/volumes"
Jul 24 13:50:16.860129 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:50:16.860082    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-772jm" podUID="8f166484-6e22-42a7-a142-39336af9517a"
Jul 24 13:50:17.158941 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.158852    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-m5j4c"]
Jul 24 13:50:17.159204 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.159186    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" containerName="registry"
Jul 24 13:50:17.159279 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.159207    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" containerName="registry"
Jul 24 13:50:17.159279 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.159276    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f94ddc4b-d933-43f1-90c8-4a58ea177db1" containerName="registry"
Jul 24 13:50:17.164117 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.164096    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-m5j4c"
Jul 24 13:50:17.166532 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.166513    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 13:50:17.166747 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.166730    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hgkjj\""
Jul 24 13:50:17.166799 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.166777    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 13:50:17.172018 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.172001    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-m5j4c"]
Jul 24 13:50:17.257005 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.256975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hv7s\" (UniqueName: \"kubernetes.io/projected/49450a75-baf1-4f50-b5f0-8c82e4aee3a5-kube-api-access-5hv7s\") pod \"downloads-7c97dc4555-m5j4c\" (UID: \"49450a75-baf1-4f50-b5f0-8c82e4aee3a5\") " pod="openshift-console/downloads-7c97dc4555-m5j4c"
Jul 24 13:50:17.357865 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.357832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hv7s\" (UniqueName: \"kubernetes.io/projected/49450a75-baf1-4f50-b5f0-8c82e4aee3a5-kube-api-access-5hv7s\") pod \"downloads-7c97dc4555-m5j4c\" (UID: \"49450a75-baf1-4f50-b5f0-8c82e4aee3a5\") " pod="openshift-console/downloads-7c97dc4555-m5j4c"
Jul 24 13:50:17.366530 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.366502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hv7s\" (UniqueName: \"kubernetes.io/projected/49450a75-baf1-4f50-b5f0-8c82e4aee3a5-kube-api-access-5hv7s\") pod \"downloads-7c97dc4555-m5j4c\" (UID: \"49450a75-baf1-4f50-b5f0-8c82e4aee3a5\") " pod="openshift-console/downloads-7c97dc4555-m5j4c"
Jul 24 13:50:17.474009 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.473973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-m5j4c"
Jul 24 13:50:17.600065 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.600034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-m5j4c"]
Jul 24 13:50:17.603761 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:50:17.603727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49450a75_baf1_4f50_b5f0_8c82e4aee3a5.slice/crio-c2be1289994f96e596461e66ac7e4bc6e6519b75a90fd789be1132b5ad04170a WatchSource:0}: Error finding container c2be1289994f96e596461e66ac7e4bc6e6519b75a90fd789be1132b5ad04170a: Status 404 returned error can't find the container with id c2be1289994f96e596461e66ac7e4bc6e6519b75a90fd789be1132b5ad04170a
Jul 24 13:50:17.994093 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:17.994061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-m5j4c" event={"ID":"49450a75-baf1-4f50-b5f0-8c82e4aee3a5","Type":"ContainerStarted","Data":"c2be1289994f96e596461e66ac7e4bc6e6519b75a90fd789be1132b5ad04170a"}
Jul 24 13:50:18.985096 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:18.985063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-545b948ffd-w9xcr"
Jul 24 13:50:20.736712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:20.736689    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 13:50:21.973963 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:21.973903    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lckcr"
Jul 24 13:50:22.195890 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:22.195843    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" podUID="79f89a59-bcde-49c5-a91e-4d888d018ff7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 13:50:29.859113 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:29.859078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:50:32.195522 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:32.195478    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" podUID="79f89a59-bcde-49c5-a91e-4d888d018ff7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 13:50:32.196002 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:32.195567    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l"
Jul 24 13:50:32.196150 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:32.196129    2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7c98109327ebd8a2296310ce4a46885724854977bbf811bd54182cdd58eda23e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 24 13:50:32.196209 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:32.196173    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" podUID="79f89a59-bcde-49c5-a91e-4d888d018ff7" containerName="service-proxy" containerID="cri-o://7c98109327ebd8a2296310ce4a46885724854977bbf811bd54182cdd58eda23e" gracePeriod=30
Jul 24 13:50:35.458924 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:35.458848    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kgqz2_9b87842e-6bb1-4435-9b5f-efbb63a4ba38/serve-healthcheck-canary/0.log"
Jul 24 13:50:36.068266 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:36.068219    2563 generic.go:356] "Generic (PLEG): container finished" podID="79f89a59-bcde-49c5-a91e-4d888d018ff7" containerID="7c98109327ebd8a2296310ce4a46885724854977bbf811bd54182cdd58eda23e" exitCode=2
Jul 24 13:50:36.068463 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:36.068293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" event={"ID":"79f89a59-bcde-49c5-a91e-4d888d018ff7","Type":"ContainerDied","Data":"7c98109327ebd8a2296310ce4a46885724854977bbf811bd54182cdd58eda23e"}
Jul 24 13:50:36.068463 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:36.068368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-778f4f7df-fz45l" event={"ID":"79f89a59-bcde-49c5-a91e-4d888d018ff7","Type":"ContainerStarted","Data":"919f8d56b5eb6c5d959aed0fc3f83e58a7a7733920702ad4af906229358a2b5b"}
Jul 24 13:50:36.070160 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:36.070126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-m5j4c" event={"ID":"49450a75-baf1-4f50-b5f0-8c82e4aee3a5","Type":"ContainerStarted","Data":"568b5410123a6d8e2b6476b1a5eaf4d898fc9a02073ec52be53a9361e7712c68"}
Jul 24 13:50:36.070516 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:36.070492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-m5j4c"
Jul 24 13:50:36.085255 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:36.085225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-m5j4c"
Jul 24 13:50:36.118075 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:50:36.118019    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-m5j4c" podStartSLOduration=1.172679734 podStartE2EDuration="19.117996228s" totalImagesPullingTime="17.945316494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:36.115988101 +0000 UTC m=+315.776821271" watchObservedRunningTime="2026-07-24 13:50:36.117996228 +0000 UTC m=+315.778829388"
Jul 24 13:51:21.497543 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:21.497462    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:51:21.498103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:21.497769    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="alertmanager" containerID="cri-o://f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc" gracePeriod=120
Jul 24 13:51:21.498103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:21.497831    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-metric" containerID="cri-o://cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2" gracePeriod=120
Jul 24 13:51:21.498103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:21.497867    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-web" containerID="cri-o://bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78" gracePeriod=120
Jul 24 13:51:21.498103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:21.497894    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="config-reloader" containerID="cri-o://01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9" gracePeriod=120
Jul 24 13:51:21.498103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:21.497939    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="prom-label-proxy" containerID="cri-o://0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831" gracePeriod=120
Jul 24 13:51:21.498103 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:21.497871    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy" containerID="cri-o://427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c" gracePeriod=120
Jul 24 13:51:21.540437 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:21.540406    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74439dc1_8d7e_444f_9e56_6cdeca3077be.slice/crio-conmon-427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74439dc1_8d7e_444f_9e56_6cdeca3077be.slice/crio-conmon-f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74439dc1_8d7e_444f_9e56_6cdeca3077be.slice/crio-f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc.scope\": RecentStats: unable to find data in memory cache]"
Jul 24 13:51:22.242877 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.242840    2563 generic.go:356] "Generic (PLEG): container finished" podID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerID="0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831" exitCode=0
Jul 24 13:51:22.242877 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.242866    2563 generic.go:356] "Generic (PLEG): container finished" podID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerID="427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c" exitCode=0
Jul 24 13:51:22.242877 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.242872    2563 generic.go:356] "Generic (PLEG): container finished" podID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerID="01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9" exitCode=0
Jul 24 13:51:22.242877 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.242877    2563 generic.go:356] "Generic (PLEG): container finished" podID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerID="f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc" exitCode=0
Jul 24 13:51:22.243148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.242912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"}
Jul 24 13:51:22.243148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.242974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"}
Jul 24 13:51:22.243148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.243001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"}
Jul 24 13:51:22.243148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.243049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"}
Jul 24 13:51:22.738892 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.738871    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:22.815238 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815163    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815238 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815206    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815238 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815232    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-out\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815248    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-web\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815270    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-metrics-client-ca\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815285    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-main-tls\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-main-db\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhdvw\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-kube-api-access-dhdvw\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815346    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-tls-assets\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815367    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-cluster-tls-config\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-web-config\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815442    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-metric\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.815494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815474    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-volume\") pod \"74439dc1-8d7e-444f-9e56-6cdeca3077be\" (UID: \"74439dc1-8d7e-444f-9e56-6cdeca3077be\") "
Jul 24 13:51:22.816285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:22.816285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:51:22.816285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815736    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.816285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815754    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-alertmanager-main-db\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.816285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.815754    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:22.818008 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.817874    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-out" (OuterVolumeSpecName: "config-out") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:51:22.818120 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.818079    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:22.818571 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.818540    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:22.818932 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.818910    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-volume" (OuterVolumeSpecName: "config-volume") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:22.819988 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.819960    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:22.820259 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.820233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:22.820397 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.820379    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-kube-api-access-dhdvw" (OuterVolumeSpecName: "kube-api-access-dhdvw") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "kube-api-access-dhdvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:51:22.820487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.820465    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:51:22.822974 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.822902    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:22.829118 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.829098    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-web-config" (OuterVolumeSpecName: "web-config") pod "74439dc1-8d7e-444f-9e56-6cdeca3077be" (UID: "74439dc1-8d7e-444f-9e56-6cdeca3077be"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:22.916156 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916123    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-web-config\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916156 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916155    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916169    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916183    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916194    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74439dc1-8d7e-444f-9e56-6cdeca3077be-config-out\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916205    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916217    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74439dc1-8d7e-444f-9e56-6cdeca3077be-metrics-client-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916230    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-secret-alertmanager-main-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916242    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhdvw\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-kube-api-access-dhdvw\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916253    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74439dc1-8d7e-444f-9e56-6cdeca3077be-tls-assets\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:22.916343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:22.916265    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74439dc1-8d7e-444f-9e56-6cdeca3077be-cluster-tls-config\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:51:23.249265 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.249233    2563 generic.go:356] "Generic (PLEG): container finished" podID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerID="cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2" exitCode=0
Jul 24 13:51:23.249265 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.249260    2563 generic.go:356] "Generic (PLEG): container finished" podID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerID="bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78" exitCode=0
Jul 24 13:51:23.249512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.249309    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.249512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.249321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"}
Jul 24 13:51:23.249512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.249408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"}
Jul 24 13:51:23.249512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.249451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74439dc1-8d7e-444f-9e56-6cdeca3077be","Type":"ContainerDied","Data":"fba68305230c1a4d61b1bf10aea10c00793aa3a23b770682249da5c613b5897a"}
Jul 24 13:51:23.249512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.249472    2563 scope.go:117] "RemoveContainer" containerID="0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"
Jul 24 13:51:23.257802 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.257773    2563 scope.go:117] "RemoveContainer" containerID="cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"
Jul 24 13:51:23.264525 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.264504    2563 scope.go:117] "RemoveContainer" containerID="427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"
Jul 24 13:51:23.269530 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.269507    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:51:23.271476 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.271460    2563 scope.go:117] "RemoveContainer" containerID="bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"
Jul 24 13:51:23.273847 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.273808    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:51:23.278014 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.277999    2563 scope.go:117] "RemoveContainer" containerID="01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"
Jul 24 13:51:23.284424 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.284411    2563 scope.go:117] "RemoveContainer" containerID="f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"
Jul 24 13:51:23.290963 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.290947    2563 scope.go:117] "RemoveContainer" containerID="b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988"
Jul 24 13:51:23.297514 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.297499    2563 scope.go:117] "RemoveContainer" containerID="0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"
Jul 24 13:51:23.297738 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:23.297721    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831\": container with ID starting with 0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831 not found: ID does not exist" containerID="0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"
Jul 24 13:51:23.297785 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.297746    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"} err="failed to get container status \"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831\": rpc error: code = NotFound desc = could not find container \"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831\": container with ID starting with 0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831 not found: ID does not exist"
Jul 24 13:51:23.297785 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.297763    2563 scope.go:117] "RemoveContainer" containerID="cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"
Jul 24 13:51:23.297995 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:23.297977    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2\": container with ID starting with cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2 not found: ID does not exist" containerID="cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"
Jul 24 13:51:23.298034 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298002    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"} err="failed to get container status \"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2\": rpc error: code = NotFound desc = could not find container \"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2\": container with ID starting with cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2 not found: ID does not exist"
Jul 24 13:51:23.298034 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298019    2563 scope.go:117] "RemoveContainer" containerID="427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"
Jul 24 13:51:23.298200 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:23.298186    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c\": container with ID starting with 427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c not found: ID does not exist" containerID="427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"
Jul 24 13:51:23.298239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298202    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"} err="failed to get container status \"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c\": rpc error: code = NotFound desc = could not find container \"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c\": container with ID starting with 427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c not found: ID does not exist"
Jul 24 13:51:23.298239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298213    2563 scope.go:117] "RemoveContainer" containerID="bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"
Jul 24 13:51:23.298442 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:23.298426    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78\": container with ID starting with bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78 not found: ID does not exist" containerID="bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"
Jul 24 13:51:23.298494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298447    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"} err="failed to get container status \"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78\": rpc error: code = NotFound desc = could not find container \"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78\": container with ID starting with bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78 not found: ID does not exist"
Jul 24 13:51:23.298494 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298462    2563 scope.go:117] "RemoveContainer" containerID="01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"
Jul 24 13:51:23.298677 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:23.298661    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9\": container with ID starting with 01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9 not found: ID does not exist" containerID="01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"
Jul 24 13:51:23.298723 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298679    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"} err="failed to get container status \"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9\": rpc error: code = NotFound desc = could not find container \"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9\": container with ID starting with 01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9 not found: ID does not exist"
Jul 24 13:51:23.298723 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298691    2563 scope.go:117] "RemoveContainer" containerID="f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"
Jul 24 13:51:23.298938 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:23.298924    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc\": container with ID starting with f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc not found: ID does not exist" containerID="f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"
Jul 24 13:51:23.298991 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298940    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"} err="failed to get container status \"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc\": rpc error: code = NotFound desc = could not find container \"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc\": container with ID starting with f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc not found: ID does not exist"
Jul 24 13:51:23.298991 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.298954    2563 scope.go:117] "RemoveContainer" containerID="b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988"
Jul 24 13:51:23.299153 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:51:23.299138    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988\": container with ID starting with b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988 not found: ID does not exist" containerID="b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988"
Jul 24 13:51:23.299188 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299157    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988"} err="failed to get container status \"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988\": rpc error: code = NotFound desc = could not find container \"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988\": container with ID starting with b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988 not found: ID does not exist"
Jul 24 13:51:23.299188 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299170    2563 scope.go:117] "RemoveContainer" containerID="0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"
Jul 24 13:51:23.299382 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299366    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831"} err="failed to get container status \"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831\": rpc error: code = NotFound desc = could not find container \"0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831\": container with ID starting with 0eefec57243017e028605477cdf07abfdf46e1c562b1c83a33a70484ef607831 not found: ID does not exist"
Jul 24 13:51:23.299382 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299381    2563 scope.go:117] "RemoveContainer" containerID="cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"
Jul 24 13:51:23.299560 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299543    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2"} err="failed to get container status \"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2\": rpc error: code = NotFound desc = could not find container \"cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2\": container with ID starting with cccece7de02c75182ddd893fe2bddce3697d982bc50fd7110fc850030ac211e2 not found: ID does not exist"
Jul 24 13:51:23.299598 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299560    2563 scope.go:117] "RemoveContainer" containerID="427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"
Jul 24 13:51:23.299721 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299705    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c"} err="failed to get container status \"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c\": rpc error: code = NotFound desc = could not find container \"427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c\": container with ID starting with 427de20d04796fb8f7017d3bfcacc1d4d7a2a59033fd6213f48f4d5acbbfad5c not found: ID does not exist"
Jul 24 13:51:23.299761 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299720    2563 scope.go:117] "RemoveContainer" containerID="bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"
Jul 24 13:51:23.299923 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299908    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78"} err="failed to get container status \"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78\": rpc error: code = NotFound desc = could not find container \"bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78\": container with ID starting with bd83c0d7da4ea4d900810c2a1d8d009f7583cc13bd19517624ab2e73bedfad78 not found: ID does not exist"
Jul 24 13:51:23.299976 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.299923    2563 scope.go:117] "RemoveContainer" containerID="01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"
Jul 24 13:51:23.300148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.300130    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9"} err="failed to get container status \"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9\": rpc error: code = NotFound desc = could not find container \"01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9\": container with ID starting with 01ed7aeab34b5d36f233e2586e978fd67a8051fa595355ae4ebbb07374f215a9 not found: ID does not exist"
Jul 24 13:51:23.300197 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.300148    2563 scope.go:117] "RemoveContainer" containerID="f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"
Jul 24 13:51:23.300358 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.300340    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc"} err="failed to get container status \"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc\": rpc error: code = NotFound desc = could not find container \"f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc\": container with ID starting with f84af588b427d7ef462547b2599bcbb2e8e215282c2f5809c7a551eec91f94dc not found: ID does not exist"
Jul 24 13:51:23.300399 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.300359    2563 scope.go:117] "RemoveContainer" containerID="b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988"
Jul 24 13:51:23.300536 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.300519    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988"} err="failed to get container status \"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988\": rpc error: code = NotFound desc = could not find container \"b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988\": container with ID starting with b9a474b5160270cecebf43cb010975e6768422893a4508fffd35995883921988 not found: ID does not exist"
Jul 24 13:51:23.303190 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303172    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:51:23.303426 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303413    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="init-config-reloader"
Jul 24 13:51:23.303464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303428    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="init-config-reloader"
Jul 24 13:51:23.303464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303442    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="prom-label-proxy"
Jul 24 13:51:23.303464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303452    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="prom-label-proxy"
Jul 24 13:51:23.303464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303462    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-metric"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303467    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-metric"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303474    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="alertmanager"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303480    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="alertmanager"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303485    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="config-reloader"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303491    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="config-reloader"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303499    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303504    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303510    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-web"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303515    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-web"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303569    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303577    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="config-reloader"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303583    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="alertmanager"
Jul 24 13:51:23.303586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303590    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-metric"
Jul 24 13:51:23.303955 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303598    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="kube-rbac-proxy-web"
Jul 24 13:51:23.303955 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.303606    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" containerName="prom-label-proxy"
Jul 24 13:51:23.307007 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.306992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.309177 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309155    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 13:51:23.309278 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 13:51:23.309278 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 13:51:23.309507 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309488    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 13:51:23.309580 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fvbwd\""
Jul 24 13:51:23.309580 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309563    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 13:51:23.309699 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 13:51:23.309699 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 13:51:23.309850 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.309800    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 13:51:23.314986 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.314962    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 13:51:23.320335 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.320316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:51:23.419228 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f097df21-193b-4017-a46f-c27df2835884-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419228 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-web-config\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-config-volume\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f097df21-193b-4017-a46f-c27df2835884-config-out\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96bf9\" (UniqueName: \"kubernetes.io/projected/f097df21-193b-4017-a46f-c27df2835884-kube-api-access-96bf9\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f097df21-193b-4017-a46f-c27df2835884-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f097df21-193b-4017-a46f-c27df2835884-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.419657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.419599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f097df21-193b-4017-a46f-c27df2835884-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520489 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f097df21-193b-4017-a46f-c27df2835884-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520489 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f097df21-193b-4017-a46f-c27df2835884-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520489 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f097df21-193b-4017-a46f-c27df2835884-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520731 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f097df21-193b-4017-a46f-c27df2835884-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520731 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520731 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-web-config\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520896 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-config-volume\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520944 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.520944 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f097df21-193b-4017-a46f-c27df2835884-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.521325 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.521296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f097df21-193b-4017-a46f-c27df2835884-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.521437 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.520931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.521437 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.521394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f097df21-193b-4017-a46f-c27df2835884-config-out\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.521437 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.521429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.521772 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.521455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.521772 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.521477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96bf9\" (UniqueName: \"kubernetes.io/projected/f097df21-193b-4017-a46f-c27df2835884-kube-api-access-96bf9\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.521909 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.521895    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f097df21-193b-4017-a46f-c27df2835884-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.523691 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.523658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f097df21-193b-4017-a46f-c27df2835884-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.523858 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.523836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-config-volume\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.524036 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.524003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-web-config\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.524143 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.524075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.524470 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.524453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.524517 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.524461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.524517 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.524437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.524748 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.524733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f097df21-193b-4017-a46f-c27df2835884-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.525561 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.525542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f097df21-193b-4017-a46f-c27df2835884-config-out\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.530925 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.530906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96bf9\" (UniqueName: \"kubernetes.io/projected/f097df21-193b-4017-a46f-c27df2835884-kube-api-access-96bf9\") pod \"alertmanager-main-0\" (UID: \"f097df21-193b-4017-a46f-c27df2835884\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.616627 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.616603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 13:51:23.751096 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:23.751067    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 13:51:23.754280 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:51:23.754255    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf097df21_193b_4017_a46f_c27df2835884.slice/crio-16e8c301827817ee2c4869156bdb369632e825ab1b46206eb05b1570e46fdff2 WatchSource:0}: Error finding container 16e8c301827817ee2c4869156bdb369632e825ab1b46206eb05b1570e46fdff2: Status 404 returned error can't find the container with id 16e8c301827817ee2c4869156bdb369632e825ab1b46206eb05b1570e46fdff2
Jul 24 13:51:24.254495 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:24.254461    2563 generic.go:356] "Generic (PLEG): container finished" podID="f097df21-193b-4017-a46f-c27df2835884" containerID="f427fad2a44dc683687e2b0c5ddf9f550901ceb3209346b196f455c9d388b883" exitCode=0
Jul 24 13:51:24.254678 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:24.254502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerDied","Data":"f427fad2a44dc683687e2b0c5ddf9f550901ceb3209346b196f455c9d388b883"}
Jul 24 13:51:24.254678 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:24.254551    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerStarted","Data":"16e8c301827817ee2c4869156bdb369632e825ab1b46206eb05b1570e46fdff2"}
Jul 24 13:51:24.863802 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:24.863720    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74439dc1-8d7e-444f-9e56-6cdeca3077be" path="/var/lib/kubelet/pods/74439dc1-8d7e-444f-9e56-6cdeca3077be/volumes"
Jul 24 13:51:25.261137 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.261099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerStarted","Data":"7b5b71e41b276ffb6138f2c53fa358c396c776f6729f9205c208eb6f4d41f093"}
Jul 24 13:51:25.261328 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.261178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerStarted","Data":"c9308cc9c5a764e5479561a1a70f0692ac7ac47fe26452256df9621b0907259b"}
Jul 24 13:51:25.261328 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.261216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerStarted","Data":"73fde1c1707c6d3f19bc02b154d164b3a88026df0576281c2d2b4410deb01d63"}
Jul 24 13:51:25.261328 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.261251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerStarted","Data":"c1da05ff8563fa6111b5ce9f2c1b1431756fe1af318725794c6e298ea3d48e76"}
Jul 24 13:51:25.261328 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.261298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerStarted","Data":"5cb60f7d9aee9f880916177b6b6a29d8f55cb7ed69b767e67df8e6986b0d34cf"}
Jul 24 13:51:25.261538 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.261342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f097df21-193b-4017-a46f-c27df2835884","Type":"ContainerStarted","Data":"876a5a8b3c1cc679f338829a693dfbf80c7cd26aead2ee0b2eae90bea094eae2"}
Jul 24 13:51:25.285938 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.285893    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.268263394 podStartE2EDuration="2.285876905s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.613511ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:25.285375626 +0000 UTC m=+364.946208784" watchObservedRunningTime="2026-07-24 13:51:25.285876905 +0000 UTC m=+364.946710056"
Jul 24 13:51:25.481276 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.481244    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-db9dd69f6-959xq"]
Jul 24 13:51:25.484082 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.484062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.486443 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.486424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 13:51:25.486657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.486641    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 13:51:25.486784 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.486766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 13:51:25.486863 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.486775    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 13:51:25.486863 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.486775    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 13:51:25.486863 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.486837    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-57p4m\""
Jul 24 13:51:25.492003 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.491985    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 13:51:25.497711 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.497692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-db9dd69f6-959xq"]
Jul 24 13:51:25.535998 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.535908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zqs\" (UniqueName: \"kubernetes.io/projected/821f17d4-dc63-41dc-a5d6-20561832f119-kube-api-access-c8zqs\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.535998 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.535966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.536189 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.536032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-secret-telemeter-client\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.536189 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.536069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.536189 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.536114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-telemeter-client-tls\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.536189 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.536157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-metrics-client-ca\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.536189 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.536184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-serving-certs-ca-bundle\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.536332 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.536209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-federate-client-tls\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637002 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.636966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-serving-certs-ca-bundle\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637002 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.637002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-federate-client-tls\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637226 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.637021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zqs\" (UniqueName: \"kubernetes.io/projected/821f17d4-dc63-41dc-a5d6-20561832f119-kube-api-access-c8zqs\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637226 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.637073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637226 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.637095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-secret-telemeter-client\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637226 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.637113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637226 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.637148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-telemeter-client-tls\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.637565 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.637536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-metrics-client-ca\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.638960 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.638401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-serving-certs-ca-bundle\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.638960 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.638885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.639109 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.639041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/821f17d4-dc63-41dc-a5d6-20561832f119-metrics-client-ca\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.640257 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.640228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-federate-client-tls\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.640396 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.640363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-secret-telemeter-client\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.644057 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.640933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-telemeter-client-tls\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.644057 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.643251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/821f17d4-dc63-41dc-a5d6-20561832f119-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.646115 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.646095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zqs\" (UniqueName: \"kubernetes.io/projected/821f17d4-dc63-41dc-a5d6-20561832f119-kube-api-access-c8zqs\") pod \"telemeter-client-db9dd69f6-959xq\" (UID: \"821f17d4-dc63-41dc-a5d6-20561832f119\") " pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.794282 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.794197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq"
Jul 24 13:51:25.924179 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.924154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-db9dd69f6-959xq"]
Jul 24 13:51:25.926665 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:51:25.926638    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821f17d4_dc63_41dc_a5d6_20561832f119.slice/crio-068e6ba25f7fe3d342c220e8f29539523694935f429f106ad81c42081125cbc7 WatchSource:0}: Error finding container 068e6ba25f7fe3d342c220e8f29539523694935f429f106ad81c42081125cbc7: Status 404 returned error can't find the container with id 068e6ba25f7fe3d342c220e8f29539523694935f429f106ad81c42081125cbc7
Jul 24 13:51:25.929232 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:25.929218    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:51:26.265954 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:26.265916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq" event={"ID":"821f17d4-dc63-41dc-a5d6-20561832f119","Type":"ContainerStarted","Data":"068e6ba25f7fe3d342c220e8f29539523694935f429f106ad81c42081125cbc7"}
Jul 24 13:51:28.275152 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:28.275117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq" event={"ID":"821f17d4-dc63-41dc-a5d6-20561832f119","Type":"ContainerStarted","Data":"457dfd7c51d41e3959d9ddef846352bfffc1d70fa5301167e8d1dc62a3bd756f"}
Jul 24 13:51:28.275571 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:28.275173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq" event={"ID":"821f17d4-dc63-41dc-a5d6-20561832f119","Type":"ContainerStarted","Data":"28eee8f08749ca215f220849f5ae998414392d0de0c85dcaf467af4c1b683135"}
Jul 24 13:51:28.275571 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:28.275196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq" event={"ID":"821f17d4-dc63-41dc-a5d6-20561832f119","Type":"ContainerStarted","Data":"2de5ad8d36a716ff199f1ecc6001e21dfab12f97a315bf44e1ac6ac28322e650"}
Jul 24 13:51:28.302291 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:28.302240    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-db9dd69f6-959xq" podStartSLOduration=1.390678725 podStartE2EDuration="3.302224275s" totalImagesPullingTime="1.91154555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:28.301075895 +0000 UTC m=+367.961909067" watchObservedRunningTime="2026-07-24 13:51:28.302224275 +0000 UTC m=+367.963057435"
Jul 24 13:51:33.698027 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:33.697988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:51:33.700413 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:33.700388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f166484-6e22-42a7-a142-39336af9517a-metrics-certs\") pod \"network-metrics-daemon-772jm\" (UID: \"8f166484-6e22-42a7-a142-39336af9517a\") " pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:51:33.762869 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:33.762843    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbf75\""
Jul 24 13:51:33.770614 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:33.770598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772jm"
Jul 24 13:51:33.901308 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:33.901275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-772jm"]
Jul 24 13:51:33.904141 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:51:33.904112    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f166484_6e22_42a7_a142_39336af9517a.slice/crio-176190bc3442399d411d1b1152e2d97a6ec7e17e2c006bd757f520696d692eb8 WatchSource:0}: Error finding container 176190bc3442399d411d1b1152e2d97a6ec7e17e2c006bd757f520696d692eb8: Status 404 returned error can't find the container with id 176190bc3442399d411d1b1152e2d97a6ec7e17e2c006bd757f520696d692eb8
Jul 24 13:51:34.297937 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:34.297897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-772jm" event={"ID":"8f166484-6e22-42a7-a142-39336af9517a","Type":"ContainerStarted","Data":"176190bc3442399d411d1b1152e2d97a6ec7e17e2c006bd757f520696d692eb8"}
Jul 24 13:51:35.303497 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:35.303456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-772jm" event={"ID":"8f166484-6e22-42a7-a142-39336af9517a","Type":"ContainerStarted","Data":"de569d5a36dc516d728c33e75e4e7629965f124bda19bcd542657b0c6b750fc6"}
Jul 24 13:51:35.303924 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:35.303511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-772jm" event={"ID":"8f166484-6e22-42a7-a142-39336af9517a","Type":"ContainerStarted","Data":"a3145666fc72d6d3584ebcbf9c9678a8853acdd1fb30189bfa61e43eaa1f7ac4"}
Jul 24 13:51:35.320270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:51:35.320224    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-772jm" podStartSLOduration=373.32148093 podStartE2EDuration="6m14.320208575s" totalImagesPullingTime="998.727645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:35.319033198 +0000 UTC m=+374.979866382" watchObservedRunningTime="2026-07-24 13:51:35.320208575 +0000 UTC m=+374.981041734"
Jul 24 13:53:24.315573 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.315536    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"]
Jul 24 13:53:24.318770 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.318754    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.321285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.321256    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9mkkl\""
Jul 24 13:53:24.321285 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.321269    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 13:53:24.321945 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.321929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 13:53:24.326614 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.326594    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"]
Jul 24 13:53:24.458912 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.458876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2dq\" (UniqueName: \"kubernetes.io/projected/b3ccbcc8-9718-4ba6-b418-108d17500d7a-kube-api-access-rz2dq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.459069 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.458920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.459069 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.458945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.559306 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.559272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.559306 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.559309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.559548 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.559356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2dq\" (UniqueName: \"kubernetes.io/projected/b3ccbcc8-9718-4ba6-b418-108d17500d7a-kube-api-access-rz2dq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.559647 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.559625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.559767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.559748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.567926 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.567870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2dq\" (UniqueName: \"kubernetes.io/projected/b3ccbcc8-9718-4ba6-b418-108d17500d7a-kube-api-access-rz2dq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.628712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.628676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:24.753463 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:24.753440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"]
Jul 24 13:53:24.755911 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:53:24.755881    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ccbcc8_9718_4ba6_b418_108d17500d7a.slice/crio-5adac9929c85652fa6333b7f9aa589d9b34049a32789013afa8a8de53f0c5398 WatchSource:0}: Error finding container 5adac9929c85652fa6333b7f9aa589d9b34049a32789013afa8a8de53f0c5398: Status 404 returned error can't find the container with id 5adac9929c85652fa6333b7f9aa589d9b34049a32789013afa8a8de53f0c5398
Jul 24 13:53:25.701460 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:25.701413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td" event={"ID":"b3ccbcc8-9718-4ba6-b418-108d17500d7a","Type":"ContainerStarted","Data":"5adac9929c85652fa6333b7f9aa589d9b34049a32789013afa8a8de53f0c5398"}
Jul 24 13:53:31.725867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:31.725805    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerID="b44c49c0c9e22dd52a3e758b32aa448ef8bd83ee3b88e492617f115fe8ad3b52" exitCode=0
Jul 24 13:53:31.725867 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:31.725848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td" event={"ID":"b3ccbcc8-9718-4ba6-b418-108d17500d7a","Type":"ContainerDied","Data":"b44c49c0c9e22dd52a3e758b32aa448ef8bd83ee3b88e492617f115fe8ad3b52"}
Jul 24 13:53:34.739985 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:34.739944    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerID="98eb1a3abfbfa0201c1f6f2ddf1d05af12ff810d4994d5457b5958e66d97af03" exitCode=0
Jul 24 13:53:34.740388 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:34.740028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td" event={"ID":"b3ccbcc8-9718-4ba6-b418-108d17500d7a","Type":"ContainerDied","Data":"98eb1a3abfbfa0201c1f6f2ddf1d05af12ff810d4994d5457b5958e66d97af03"}
Jul 24 13:53:41.771549 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:41.771512    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerID="c32dfcf716d2b634f34a9da3574da413081f49f8b62f8ed1759657faa44a852a" exitCode=0
Jul 24 13:53:41.771996 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:41.771585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td" event={"ID":"b3ccbcc8-9718-4ba6-b418-108d17500d7a","Type":"ContainerDied","Data":"c32dfcf716d2b634f34a9da3574da413081f49f8b62f8ed1759657faa44a852a"}
Jul 24 13:53:42.897488 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:42.897465    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:42.999321 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:42.999294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz2dq\" (UniqueName: \"kubernetes.io/projected/b3ccbcc8-9718-4ba6-b418-108d17500d7a-kube-api-access-rz2dq\") pod \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") "
Jul 24 13:53:42.999464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:42.999345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-util\") pod \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") "
Jul 24 13:53:42.999464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:42.999385    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-bundle\") pod \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\" (UID: \"b3ccbcc8-9718-4ba6-b418-108d17500d7a\") "
Jul 24 13:53:43.000013 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:42.999988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-bundle" (OuterVolumeSpecName: "bundle") pod "b3ccbcc8-9718-4ba6-b418-108d17500d7a" (UID: "b3ccbcc8-9718-4ba6-b418-108d17500d7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:53:43.001563 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.001542    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ccbcc8-9718-4ba6-b418-108d17500d7a-kube-api-access-rz2dq" (OuterVolumeSpecName: "kube-api-access-rz2dq") pod "b3ccbcc8-9718-4ba6-b418-108d17500d7a" (UID: "b3ccbcc8-9718-4ba6-b418-108d17500d7a"). InnerVolumeSpecName "kube-api-access-rz2dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:53:43.004588 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.004562    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-util" (OuterVolumeSpecName: "util") pod "b3ccbcc8-9718-4ba6-b418-108d17500d7a" (UID: "b3ccbcc8-9718-4ba6-b418-108d17500d7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:53:43.100646 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.100570    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-util\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:53:43.100646 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.100596    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3ccbcc8-9718-4ba6-b418-108d17500d7a-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:53:43.100646 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.100604    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz2dq\" (UniqueName: \"kubernetes.io/projected/b3ccbcc8-9718-4ba6-b418-108d17500d7a-kube-api-access-rz2dq\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:53:43.781209 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.781173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td" event={"ID":"b3ccbcc8-9718-4ba6-b418-108d17500d7a","Type":"ContainerDied","Data":"5adac9929c85652fa6333b7f9aa589d9b34049a32789013afa8a8de53f0c5398"}
Jul 24 13:53:43.781209 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.781203    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n7td"
Jul 24 13:53:43.781409 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:43.781221    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5adac9929c85652fa6333b7f9aa589d9b34049a32789013afa8a8de53f0c5398"
Jul 24 13:53:51.115713 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.115678    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"]
Jul 24 13:53:51.116166 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.115992    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerName="extract"
Jul 24 13:53:51.116166 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.116008    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerName="extract"
Jul 24 13:53:51.116166 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.116024    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerName="pull"
Jul 24 13:53:51.116166 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.116030    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerName="pull"
Jul 24 13:53:51.116166 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.116042    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerName="util"
Jul 24 13:53:51.116166 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.116047    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerName="util"
Jul 24 13:53:51.116166 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.116097    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3ccbcc8-9718-4ba6-b418-108d17500d7a" containerName="extract"
Jul 24 13:53:51.152906 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.152868    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"]
Jul 24 13:53:51.153075 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.153008    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.155914 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.155891    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 13:53:51.156025 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.155891    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 13:53:51.156225 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.156211    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9mkkl\""
Jul 24 13:53:51.260244 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.260207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.260418 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.260264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.260418 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.260344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k2jl\" (UniqueName: \"kubernetes.io/projected/40b7a59b-8011-463b-97b3-f2480af58131-kube-api-access-5k2jl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.361554 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.361521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k2jl\" (UniqueName: \"kubernetes.io/projected/40b7a59b-8011-463b-97b3-f2480af58131-kube-api-access-5k2jl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.361554 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.361561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.361754 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.361603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.361967 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.361951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.362003 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.361984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.373696 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.373631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k2jl\" (UniqueName: \"kubernetes.io/projected/40b7a59b-8011-463b-97b3-f2480af58131-kube-api-access-5k2jl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.451589 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.451556    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-568h9"]
Jul 24 13:53:51.453635 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.453621    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.457471 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.457446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tqmmg\""
Jul 24 13:53:51.457597 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.457484    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 13:53:51.457597 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.457507    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 13:53:51.462132 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.462111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:51.465868 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.465844    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-568h9"]
Jul 24 13:53:51.563252 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.563216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbffa02f-6a3c-4539-ae6d-da1eac8bf670-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-568h9\" (UID: \"fbffa02f-6a3c-4539-ae6d-da1eac8bf670\") " pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.563392 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.563278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hh9v\" (UniqueName: \"kubernetes.io/projected/fbffa02f-6a3c-4539-ae6d-da1eac8bf670-kube-api-access-7hh9v\") pod \"cert-manager-webhook-6486ffd997-568h9\" (UID: \"fbffa02f-6a3c-4539-ae6d-da1eac8bf670\") " pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.598047 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.597876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"]
Jul 24 13:53:51.600753 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:53:51.600728    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b7a59b_8011_463b_97b3_f2480af58131.slice/crio-f44e7139f55bfd4f13d841b5cc6bb5278738cdfa1770f04838eb7b26cb0e8c9d WatchSource:0}: Error finding container f44e7139f55bfd4f13d841b5cc6bb5278738cdfa1770f04838eb7b26cb0e8c9d: Status 404 returned error can't find the container with id f44e7139f55bfd4f13d841b5cc6bb5278738cdfa1770f04838eb7b26cb0e8c9d
Jul 24 13:53:51.663994 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.663964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbffa02f-6a3c-4539-ae6d-da1eac8bf670-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-568h9\" (UID: \"fbffa02f-6a3c-4539-ae6d-da1eac8bf670\") " pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.664106 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.664008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hh9v\" (UniqueName: \"kubernetes.io/projected/fbffa02f-6a3c-4539-ae6d-da1eac8bf670-kube-api-access-7hh9v\") pod \"cert-manager-webhook-6486ffd997-568h9\" (UID: \"fbffa02f-6a3c-4539-ae6d-da1eac8bf670\") " pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.671685 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.671660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hh9v\" (UniqueName: \"kubernetes.io/projected/fbffa02f-6a3c-4539-ae6d-da1eac8bf670-kube-api-access-7hh9v\") pod \"cert-manager-webhook-6486ffd997-568h9\" (UID: \"fbffa02f-6a3c-4539-ae6d-da1eac8bf670\") " pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.671769 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.671687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbffa02f-6a3c-4539-ae6d-da1eac8bf670-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-568h9\" (UID: \"fbffa02f-6a3c-4539-ae6d-da1eac8bf670\") " pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.762833 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.762789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:51.815249 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.815217    2563 generic.go:356] "Generic (PLEG): container finished" podID="40b7a59b-8011-463b-97b3-f2480af58131" containerID="9f8d98c37f8fd29af9a53c6e552bd4e1ede339248d2fb2b23975e3ec6a0ddc22" exitCode=0
Jul 24 13:53:51.815393 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.815305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs" event={"ID":"40b7a59b-8011-463b-97b3-f2480af58131","Type":"ContainerDied","Data":"9f8d98c37f8fd29af9a53c6e552bd4e1ede339248d2fb2b23975e3ec6a0ddc22"}
Jul 24 13:53:51.815393 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.815365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs" event={"ID":"40b7a59b-8011-463b-97b3-f2480af58131","Type":"ContainerStarted","Data":"f44e7139f55bfd4f13d841b5cc6bb5278738cdfa1770f04838eb7b26cb0e8c9d"}
Jul 24 13:53:51.889351 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:51.889282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-568h9"]
Jul 24 13:53:51.891874 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:53:51.891844    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbffa02f_6a3c_4539_ae6d_da1eac8bf670.slice/crio-c7604b42c5914ad20a985d9538ae2175569e2e19856b5018433813c8ea3862d2 WatchSource:0}: Error finding container c7604b42c5914ad20a985d9538ae2175569e2e19856b5018433813c8ea3862d2: Status 404 returned error can't find the container with id c7604b42c5914ad20a985d9538ae2175569e2e19856b5018433813c8ea3862d2
Jul 24 13:53:52.821127 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:52.821083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-568h9" event={"ID":"fbffa02f-6a3c-4539-ae6d-da1eac8bf670","Type":"ContainerStarted","Data":"c7604b42c5914ad20a985d9538ae2175569e2e19856b5018433813c8ea3862d2"}
Jul 24 13:53:54.832358 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:54.832316    2563 generic.go:356] "Generic (PLEG): container finished" podID="40b7a59b-8011-463b-97b3-f2480af58131" containerID="823c3e96304f23e2659fb036bf1b9bfb4ad97356bc64db4cafd05ca7611338f0" exitCode=0
Jul 24 13:53:54.832865 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:54.832364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs" event={"ID":"40b7a59b-8011-463b-97b3-f2480af58131","Type":"ContainerDied","Data":"823c3e96304f23e2659fb036bf1b9bfb4ad97356bc64db4cafd05ca7611338f0"}
Jul 24 13:53:55.837971 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:55.837937    2563 generic.go:356] "Generic (PLEG): container finished" podID="40b7a59b-8011-463b-97b3-f2480af58131" containerID="951093d2a045a04821b5965da6869c52960de56981276dfd0b17fcb4880f2f52" exitCode=0
Jul 24 13:53:55.838419 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:55.838028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs" event={"ID":"40b7a59b-8011-463b-97b3-f2480af58131","Type":"ContainerDied","Data":"951093d2a045a04821b5965da6869c52960de56981276dfd0b17fcb4880f2f52"}
Jul 24 13:53:55.839391 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:55.839368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-568h9" event={"ID":"fbffa02f-6a3c-4539-ae6d-da1eac8bf670","Type":"ContainerStarted","Data":"a208bea25b8dca0fed3176ffbf67538d2e8a609cca777c6e7db8e1859d7f9305"}
Jul 24 13:53:55.839501 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:55.839487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:53:55.871855 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:55.871795    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-568h9" podStartSLOduration=1.458648178 podStartE2EDuration="4.871780912s" totalImagesPullingTime="3.413132734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:53:55.870609246 +0000 UTC m=+515.531442406" watchObservedRunningTime="2026-07-24 13:53:55.871780912 +0000 UTC m=+515.532614071"
Jul 24 13:53:56.968009 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:56.967983    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:57.011536 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.011503    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-bundle\") pod \"40b7a59b-8011-463b-97b3-f2480af58131\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") "
Jul 24 13:53:57.011675 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.011576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-util\") pod \"40b7a59b-8011-463b-97b3-f2480af58131\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") "
Jul 24 13:53:57.011675 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.011626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k2jl\" (UniqueName: \"kubernetes.io/projected/40b7a59b-8011-463b-97b3-f2480af58131-kube-api-access-5k2jl\") pod \"40b7a59b-8011-463b-97b3-f2480af58131\" (UID: \"40b7a59b-8011-463b-97b3-f2480af58131\") "
Jul 24 13:53:57.011909 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.011884    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-bundle" (OuterVolumeSpecName: "bundle") pod "40b7a59b-8011-463b-97b3-f2480af58131" (UID: "40b7a59b-8011-463b-97b3-f2480af58131"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:53:57.013864 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.013808    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b7a59b-8011-463b-97b3-f2480af58131-kube-api-access-5k2jl" (OuterVolumeSpecName: "kube-api-access-5k2jl") pod "40b7a59b-8011-463b-97b3-f2480af58131" (UID: "40b7a59b-8011-463b-97b3-f2480af58131"). InnerVolumeSpecName "kube-api-access-5k2jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:53:57.015685 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.015662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-util" (OuterVolumeSpecName: "util") pod "40b7a59b-8011-463b-97b3-f2480af58131" (UID: "40b7a59b-8011-463b-97b3-f2480af58131"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:53:57.113148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.113050    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:53:57.113148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.113093    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40b7a59b-8011-463b-97b3-f2480af58131-util\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:53:57.113148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.113103    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k2jl\" (UniqueName: \"kubernetes.io/projected/40b7a59b-8011-463b-97b3-f2480af58131-kube-api-access-5k2jl\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:53:57.848771 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.848737    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs"
Jul 24 13:53:57.848771 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.848746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjwgcs" event={"ID":"40b7a59b-8011-463b-97b3-f2480af58131","Type":"ContainerDied","Data":"f44e7139f55bfd4f13d841b5cc6bb5278738cdfa1770f04838eb7b26cb0e8c9d"}
Jul 24 13:53:57.849003 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:53:57.848795    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f44e7139f55bfd4f13d841b5cc6bb5278738cdfa1770f04838eb7b26cb0e8c9d"
Jul 24 13:54:00.574751 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.574716    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"]
Jul 24 13:54:00.575122 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.575051    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b7a59b-8011-463b-97b3-f2480af58131" containerName="util"
Jul 24 13:54:00.575122 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.575062    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b7a59b-8011-463b-97b3-f2480af58131" containerName="util"
Jul 24 13:54:00.575122 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.575070    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b7a59b-8011-463b-97b3-f2480af58131" containerName="extract"
Jul 24 13:54:00.575122 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.575084    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b7a59b-8011-463b-97b3-f2480af58131" containerName="extract"
Jul 24 13:54:00.575122 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.575094    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b7a59b-8011-463b-97b3-f2480af58131" containerName="pull"
Jul 24 13:54:00.575122 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.575099    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b7a59b-8011-463b-97b3-f2480af58131" containerName="pull"
Jul 24 13:54:00.575320 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.575141    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b7a59b-8011-463b-97b3-f2480af58131" containerName="extract"
Jul 24 13:54:00.577169 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.577150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:00.579567 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.579540    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:54:00.580328 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.580311    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 13:54:00.580394 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.580311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qtmvz\""
Jul 24 13:54:00.588366 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.588345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"]
Jul 24 13:54:00.641328 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.641292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ef26a27-65b7-46b2-9018-94c61dee1309-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z8gqs\" (UID: \"2ef26a27-65b7-46b2-9018-94c61dee1309\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:00.641493 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.641339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grr2w\" (UniqueName: \"kubernetes.io/projected/2ef26a27-65b7-46b2-9018-94c61dee1309-kube-api-access-grr2w\") pod \"openshift-lws-operator-fd8ccff4c-z8gqs\" (UID: \"2ef26a27-65b7-46b2-9018-94c61dee1309\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:00.742687 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.742641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ef26a27-65b7-46b2-9018-94c61dee1309-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z8gqs\" (UID: \"2ef26a27-65b7-46b2-9018-94c61dee1309\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:00.742856 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.742707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grr2w\" (UniqueName: \"kubernetes.io/projected/2ef26a27-65b7-46b2-9018-94c61dee1309-kube-api-access-grr2w\") pod \"openshift-lws-operator-fd8ccff4c-z8gqs\" (UID: \"2ef26a27-65b7-46b2-9018-94c61dee1309\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:00.743048 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.743030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ef26a27-65b7-46b2-9018-94c61dee1309-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z8gqs\" (UID: \"2ef26a27-65b7-46b2-9018-94c61dee1309\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:00.751924 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.751894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grr2w\" (UniqueName: \"kubernetes.io/projected/2ef26a27-65b7-46b2-9018-94c61dee1309-kube-api-access-grr2w\") pod \"openshift-lws-operator-fd8ccff4c-z8gqs\" (UID: \"2ef26a27-65b7-46b2-9018-94c61dee1309\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:00.886765 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:00.886686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"
Jul 24 13:54:01.017109 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:01.017082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs"]
Jul 24 13:54:01.018906 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:01.018876    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ef26a27_65b7_46b2_9018_94c61dee1309.slice/crio-8fa13ab128823293c55397328b7e3b9531dc7fab1494bf00b75514c683a91534 WatchSource:0}: Error finding container 8fa13ab128823293c55397328b7e3b9531dc7fab1494bf00b75514c683a91534: Status 404 returned error can't find the container with id 8fa13ab128823293c55397328b7e3b9531dc7fab1494bf00b75514c683a91534
Jul 24 13:54:01.845621 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:01.845590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-568h9"
Jul 24 13:54:01.867624 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:01.867539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs" event={"ID":"2ef26a27-65b7-46b2-9018-94c61dee1309","Type":"ContainerStarted","Data":"8fa13ab128823293c55397328b7e3b9531dc7fab1494bf00b75514c683a91534"}
Jul 24 13:54:02.447693 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.447657    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gsqqf"]
Jul 24 13:54:02.449885 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.449865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:02.452102 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.452084    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qwk85\""
Jul 24 13:54:02.459996 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.459972    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gsqqf"]
Jul 24 13:54:02.556991 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.556955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrdxn\" (UniqueName: \"kubernetes.io/projected/6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9-kube-api-access-xrdxn\") pod \"cert-manager-55b4d954d5-gsqqf\" (UID: \"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9\") " pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:02.556991 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.557004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-gsqqf\" (UID: \"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9\") " pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:02.657958 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.657920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrdxn\" (UniqueName: \"kubernetes.io/projected/6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9-kube-api-access-xrdxn\") pod \"cert-manager-55b4d954d5-gsqqf\" (UID: \"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9\") " pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:02.658142 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.657972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-gsqqf\" (UID: \"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9\") " pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:02.666215 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.666184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-gsqqf\" (UID: \"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9\") " pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:02.666418 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.666393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrdxn\" (UniqueName: \"kubernetes.io/projected/6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9-kube-api-access-xrdxn\") pod \"cert-manager-55b4d954d5-gsqqf\" (UID: \"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9\") " pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:02.760673 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:02.760633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gsqqf"
Jul 24 13:54:03.009976 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:03.009949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gsqqf"]
Jul 24 13:54:03.012062 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:03.011992    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a52a7f0_5177_4dd7_9c7b_24e6b08e19a9.slice/crio-ba32b369e1ff0d730fdab0f12d6dfdbc085b7e6231fb11052ba0121794757c8e WatchSource:0}: Error finding container ba32b369e1ff0d730fdab0f12d6dfdbc085b7e6231fb11052ba0121794757c8e: Status 404 returned error can't find the container with id ba32b369e1ff0d730fdab0f12d6dfdbc085b7e6231fb11052ba0121794757c8e
Jul 24 13:54:03.879550 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:03.879512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gsqqf" event={"ID":"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9","Type":"ContainerStarted","Data":"08a930a4015a538427e0cb53da0b7cb5aa60ac2505010d31bb816c702c2ea7d3"}
Jul 24 13:54:03.879550 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:03.879562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gsqqf" event={"ID":"6a52a7f0-5177-4dd7-9c7b-24e6b08e19a9","Type":"ContainerStarted","Data":"ba32b369e1ff0d730fdab0f12d6dfdbc085b7e6231fb11052ba0121794757c8e"}
Jul 24 13:54:03.881200 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:03.881176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs" event={"ID":"2ef26a27-65b7-46b2-9018-94c61dee1309","Type":"ContainerStarted","Data":"838849e86625ccaf6cbd1c58560940a0ce39248a7170179a493de48b8b2a52e5"}
Jul 24 13:54:03.895411 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:03.895370    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gsqqf" podStartSLOduration=1.895356753 podStartE2EDuration="1.895356753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:03.894607643 +0000 UTC m=+523.555440803" watchObservedRunningTime="2026-07-24 13:54:03.895356753 +0000 UTC m=+523.556189911"
Jul 24 13:54:03.909527 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:03.909479    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z8gqs" podStartSLOduration=2.016576895 podStartE2EDuration="3.909462016s" totalImagesPullingTime="1.892885121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:03.909028933 +0000 UTC m=+523.569862096" watchObservedRunningTime="2026-07-24 13:54:03.909462016 +0000 UTC m=+523.570295175"
Jul 24 13:54:06.375262 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.375224    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"]
Jul 24 13:54:06.377568 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.377550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.379750 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.379727    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 13:54:06.380533 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.380506    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 13:54:06.380672 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.380506    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9mkkl\""
Jul 24 13:54:06.386196 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.386171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"]
Jul 24 13:54:06.484591 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.484554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.484591 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.484589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wx4p\" (UniqueName: \"kubernetes.io/projected/3a3c1529-817a-4db3-8a5b-379cf4218cb8-kube-api-access-9wx4p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.484801 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.484655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.586062 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.586031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.586062 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.586067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wx4p\" (UniqueName: \"kubernetes.io/projected/3a3c1529-817a-4db3-8a5b-379cf4218cb8-kube-api-access-9wx4p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.586267 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.586102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.586501 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.586481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.586545 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.586500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.594024 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.593998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wx4p\" (UniqueName: \"kubernetes.io/projected/3a3c1529-817a-4db3-8a5b-379cf4218cb8-kube-api-access-9wx4p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.688442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.688353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:06.819364 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.819338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"]
Jul 24 13:54:06.822129 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:06.822099    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3c1529_817a_4db3_8a5b_379cf4218cb8.slice/crio-f3d1e2572facae5dce71b723e7b569de814be89896a2f1af0da0b758483b785a WatchSource:0}: Error finding container f3d1e2572facae5dce71b723e7b569de814be89896a2f1af0da0b758483b785a: Status 404 returned error can't find the container with id f3d1e2572facae5dce71b723e7b569de814be89896a2f1af0da0b758483b785a
Jul 24 13:54:06.899359 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.899330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4" event={"ID":"3a3c1529-817a-4db3-8a5b-379cf4218cb8","Type":"ContainerStarted","Data":"d034439d347487774af690942112fef77e520088dc3b110a9232a9daddfc4cc1"}
Jul 24 13:54:06.899465 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:06.899382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4" event={"ID":"3a3c1529-817a-4db3-8a5b-379cf4218cb8","Type":"ContainerStarted","Data":"f3d1e2572facae5dce71b723e7b569de814be89896a2f1af0da0b758483b785a"}
Jul 24 13:54:07.904301 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:07.904210    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerID="d034439d347487774af690942112fef77e520088dc3b110a9232a9daddfc4cc1" exitCode=0
Jul 24 13:54:07.904301 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:07.904287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4" event={"ID":"3a3c1529-817a-4db3-8a5b-379cf4218cb8","Type":"ContainerDied","Data":"d034439d347487774af690942112fef77e520088dc3b110a9232a9daddfc4cc1"}
Jul 24 13:54:08.910750 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:08.910661    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerID="d8c01046f9dd156ac9b9ba84fc9b4fa07aab54359e9d9e84cdf5596fef848847" exitCode=0
Jul 24 13:54:08.910750 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:08.910736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4" event={"ID":"3a3c1529-817a-4db3-8a5b-379cf4218cb8","Type":"ContainerDied","Data":"d8c01046f9dd156ac9b9ba84fc9b4fa07aab54359e9d9e84cdf5596fef848847"}
Jul 24 13:54:09.916978 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:09.916936    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerID="ffc8208be53174307c0d90e8fbf2879d776cf67ca438383dccc633c946e9aab4" exitCode=0
Jul 24 13:54:09.917366 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:09.916986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4" event={"ID":"3a3c1529-817a-4db3-8a5b-379cf4218cb8","Type":"ContainerDied","Data":"ffc8208be53174307c0d90e8fbf2879d776cf67ca438383dccc633c946e9aab4"}
Jul 24 13:54:11.043720 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.043695    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:11.124538 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.124504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wx4p\" (UniqueName: \"kubernetes.io/projected/3a3c1529-817a-4db3-8a5b-379cf4218cb8-kube-api-access-9wx4p\") pod \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") "
Jul 24 13:54:11.124538 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.124541    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-util\") pod \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") "
Jul 24 13:54:11.124780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.124563    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-bundle\") pod \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\" (UID: \"3a3c1529-817a-4db3-8a5b-379cf4218cb8\") "
Jul 24 13:54:11.125329 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.125304    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-bundle" (OuterVolumeSpecName: "bundle") pod "3a3c1529-817a-4db3-8a5b-379cf4218cb8" (UID: "3a3c1529-817a-4db3-8a5b-379cf4218cb8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:54:11.126782 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.126761    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3c1529-817a-4db3-8a5b-379cf4218cb8-kube-api-access-9wx4p" (OuterVolumeSpecName: "kube-api-access-9wx4p") pod "3a3c1529-817a-4db3-8a5b-379cf4218cb8" (UID: "3a3c1529-817a-4db3-8a5b-379cf4218cb8"). InnerVolumeSpecName "kube-api-access-9wx4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:54:11.130255 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.130232    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-util" (OuterVolumeSpecName: "util") pod "3a3c1529-817a-4db3-8a5b-379cf4218cb8" (UID: "3a3c1529-817a-4db3-8a5b-379cf4218cb8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:54:11.226034 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.226007    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wx4p\" (UniqueName: \"kubernetes.io/projected/3a3c1529-817a-4db3-8a5b-379cf4218cb8-kube-api-access-9wx4p\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:54:11.226034 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.226032    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-util\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:54:11.226192 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.226062    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c1529-817a-4db3-8a5b-379cf4218cb8-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:54:11.926786 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.926749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4" event={"ID":"3a3c1529-817a-4db3-8a5b-379cf4218cb8","Type":"ContainerDied","Data":"f3d1e2572facae5dce71b723e7b569de814be89896a2f1af0da0b758483b785a"}
Jul 24 13:54:11.926786 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.926770    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgxbr4"
Jul 24 13:54:11.927048 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:11.926801    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3d1e2572facae5dce71b723e7b569de814be89896a2f1af0da0b758483b785a"
Jul 24 13:54:23.561877 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.561832    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"]
Jul 24 13:54:23.562445 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.562161    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerName="util"
Jul 24 13:54:23.562445 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.562176    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerName="util"
Jul 24 13:54:23.562445 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.562190    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerName="pull"
Jul 24 13:54:23.562445 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.562195    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerName="pull"
Jul 24 13:54:23.562445 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.562200    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerName="extract"
Jul 24 13:54:23.562445 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.562205    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerName="extract"
Jul 24 13:54:23.562445 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.562258    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3c1529-817a-4db3-8a5b-379cf4218cb8" containerName="extract"
Jul 24 13:54:23.565543 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.565523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.568043 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.568022    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 13:54:23.568170 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.568154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ft8zn\""
Jul 24 13:54:23.568238 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.568213    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 13:54:23.568238 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.568156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 13:54:23.568343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.568300    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 13:54:23.579504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.579471    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"]
Jul 24 13:54:23.731574 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.731532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x85nw\" (UniqueName: \"kubernetes.io/projected/fe69d097-1d0e-429e-8f07-5b154a5920a6-kube-api-access-x85nw\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.731768 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.731586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe69d097-1d0e-429e-8f07-5b154a5920a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.731768 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.731657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe69d097-1d0e-429e-8f07-5b154a5920a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.731768 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.731729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe69d097-1d0e-429e-8f07-5b154a5920a6-manifests\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.731768 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.731759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe69d097-1d0e-429e-8f07-5b154a5920a6-tmp\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.832208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.832118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe69d097-1d0e-429e-8f07-5b154a5920a6-manifests\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.832208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.832164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe69d097-1d0e-429e-8f07-5b154a5920a6-tmp\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.832208 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.832190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x85nw\" (UniqueName: \"kubernetes.io/projected/fe69d097-1d0e-429e-8f07-5b154a5920a6-kube-api-access-x85nw\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.832464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.832229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe69d097-1d0e-429e-8f07-5b154a5920a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.832464 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.832268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe69d097-1d0e-429e-8f07-5b154a5920a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.832571 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.832507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe69d097-1d0e-429e-8f07-5b154a5920a6-manifests\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.834600 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.834574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe69d097-1d0e-429e-8f07-5b154a5920a6-tmp\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.834848 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.834829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe69d097-1d0e-429e-8f07-5b154a5920a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.834976 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.834956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe69d097-1d0e-429e-8f07-5b154a5920a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.840476 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.840456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x85nw\" (UniqueName: \"kubernetes.io/projected/fe69d097-1d0e-429e-8f07-5b154a5920a6-kube-api-access-x85nw\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw\" (UID: \"fe69d097-1d0e-429e-8f07-5b154a5920a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:23.875648 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:23.875618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:24.014277 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:24.014252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"]
Jul 24 13:54:24.016925 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:24.016892    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe69d097_1d0e_429e_8f07_5b154a5920a6.slice/crio-3dd237b2790a589b6351ab526e0601ecb9ea3f68fbb2135b893666d94b2b9709 WatchSource:0}: Error finding container 3dd237b2790a589b6351ab526e0601ecb9ea3f68fbb2135b893666d94b2b9709: Status 404 returned error can't find the container with id 3dd237b2790a589b6351ab526e0601ecb9ea3f68fbb2135b893666d94b2b9709
Jul 24 13:54:24.981039 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:24.981000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw" event={"ID":"fe69d097-1d0e-429e-8f07-5b154a5920a6","Type":"ContainerStarted","Data":"3dd237b2790a589b6351ab526e0601ecb9ea3f68fbb2135b893666d94b2b9709"}
Jul 24 13:54:27.999725 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:27.999689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw" event={"ID":"fe69d097-1d0e-429e-8f07-5b154a5920a6","Type":"ContainerStarted","Data":"73271a20adf152760d8ac140ee89cb755ddb7a82b8b39d815d003e5c6848f03a"}
Jul 24 13:54:29.010534 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:29.010493    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe69d097-1d0e-429e-8f07-5b154a5920a6" containerID="73271a20adf152760d8ac140ee89cb755ddb7a82b8b39d815d003e5c6848f03a" exitCode=0
Jul 24 13:54:29.010918 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:29.010541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw" event={"ID":"fe69d097-1d0e-429e-8f07-5b154a5920a6","Type":"ContainerDied","Data":"73271a20adf152760d8ac140ee89cb755ddb7a82b8b39d815d003e5c6848f03a"}
Jul 24 13:54:30.016755 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:30.016716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw" event={"ID":"fe69d097-1d0e-429e-8f07-5b154a5920a6","Type":"ContainerStarted","Data":"bfabaf79b5de2e80850f134e49ade52e1da54d473bed580d4168a439e58d92e5"}
Jul 24 13:54:30.017157 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:30.016792    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:30.037433 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:30.037385    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw" podStartSLOduration=2.5307098420000003 podStartE2EDuration="7.037370695s" totalImagesPullingTime="3.457522458s" totalInitContainerRuntime="1.049138395s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:30.035404912 +0000 UTC m=+549.696238072" watchObservedRunningTime="2026-07-24 13:54:30.037370695 +0000 UTC m=+549.698203894"
Jul 24 13:54:41.024270 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:41.024239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw"
Jul 24 13:54:52.811776 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.811744    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"]
Jul 24 13:54:52.814884 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.814868    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:52.817428 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.817401    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 13:54:52.817428 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.817411    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vm9jr\""
Jul 24 13:54:52.824586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.824566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"]
Jul 24 13:54:52.827448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.827422    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"]
Jul 24 13:54:52.831092 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.831074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:52.833598 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.833580    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-h7n55\""
Jul 24 13:54:52.833758 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.833739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 13:54:52.847923 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.847897    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"]
Jul 24 13:54:52.863073 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.863049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gvhn\" (UniqueName: \"kubernetes.io/projected/3bfe74c5-a810-4e6e-87c8-1f3fe754db47-kube-api-access-9gvhn\") pod \"kserve-controller-manager-d6f4b65b8-zdd87\" (UID: \"3bfe74c5-a810-4e6e-87c8-1f3fe754db47\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:52.863179 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.863091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5482c673-181d-4be0-b2af-39783491a149-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dwdlh\" (UID: \"5482c673-181d-4be0-b2af-39783491a149\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:52.863179 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.863139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmmz\" (UniqueName: \"kubernetes.io/projected/5482c673-181d-4be0-b2af-39783491a149-kube-api-access-drmmz\") pod \"llmisvc-controller-manager-777c6bd7d5-dwdlh\" (UID: \"5482c673-181d-4be0-b2af-39783491a149\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:52.863179 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.863172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bfe74c5-a810-4e6e-87c8-1f3fe754db47-cert\") pod \"kserve-controller-manager-d6f4b65b8-zdd87\" (UID: \"3bfe74c5-a810-4e6e-87c8-1f3fe754db47\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:52.963662 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.963626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmmz\" (UniqueName: \"kubernetes.io/projected/5482c673-181d-4be0-b2af-39783491a149-kube-api-access-drmmz\") pod \"llmisvc-controller-manager-777c6bd7d5-dwdlh\" (UID: \"5482c673-181d-4be0-b2af-39783491a149\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:52.963893 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.963677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bfe74c5-a810-4e6e-87c8-1f3fe754db47-cert\") pod \"kserve-controller-manager-d6f4b65b8-zdd87\" (UID: \"3bfe74c5-a810-4e6e-87c8-1f3fe754db47\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:52.963893 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.963704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gvhn\" (UniqueName: \"kubernetes.io/projected/3bfe74c5-a810-4e6e-87c8-1f3fe754db47-kube-api-access-9gvhn\") pod \"kserve-controller-manager-d6f4b65b8-zdd87\" (UID: \"3bfe74c5-a810-4e6e-87c8-1f3fe754db47\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:52.963893 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.963733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5482c673-181d-4be0-b2af-39783491a149-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dwdlh\" (UID: \"5482c673-181d-4be0-b2af-39783491a149\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:52.966368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.966341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bfe74c5-a810-4e6e-87c8-1f3fe754db47-cert\") pod \"kserve-controller-manager-d6f4b65b8-zdd87\" (UID: \"3bfe74c5-a810-4e6e-87c8-1f3fe754db47\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:52.966466 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.966409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5482c673-181d-4be0-b2af-39783491a149-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dwdlh\" (UID: \"5482c673-181d-4be0-b2af-39783491a149\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:52.977420 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.977394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmmz\" (UniqueName: \"kubernetes.io/projected/5482c673-181d-4be0-b2af-39783491a149-kube-api-access-drmmz\") pod \"llmisvc-controller-manager-777c6bd7d5-dwdlh\" (UID: \"5482c673-181d-4be0-b2af-39783491a149\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:52.978274 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:52.978252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gvhn\" (UniqueName: \"kubernetes.io/projected/3bfe74c5-a810-4e6e-87c8-1f3fe754db47-kube-api-access-9gvhn\") pod \"kserve-controller-manager-d6f4b65b8-zdd87\" (UID: \"3bfe74c5-a810-4e6e-87c8-1f3fe754db47\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:53.126368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.126283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:53.142282 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.142260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:53.268657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.268544    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"]
Jul 24 13:54:53.271045 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:53.271018    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfe74c5_a810_4e6e_87c8_1f3fe754db47.slice/crio-897cc6b6347810a8d099dd6415c82a4d09118602fee6c560867e2b6ff60d6862 WatchSource:0}: Error finding container 897cc6b6347810a8d099dd6415c82a4d09118602fee6c560867e2b6ff60d6862: Status 404 returned error can't find the container with id 897cc6b6347810a8d099dd6415c82a4d09118602fee6c560867e2b6ff60d6862
Jul 24 13:54:53.291442 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.291423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"]
Jul 24 13:54:53.293809 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:53.293787    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5482c673_181d_4be0_b2af_39783491a149.slice/crio-960bb0f7c94c3eaadd11ceae66c98b5341f2a2bb6f949612b1efa12e15f6b0c2 WatchSource:0}: Error finding container 960bb0f7c94c3eaadd11ceae66c98b5341f2a2bb6f949612b1efa12e15f6b0c2: Status 404 returned error can't find the container with id 960bb0f7c94c3eaadd11ceae66c98b5341f2a2bb6f949612b1efa12e15f6b0c2
Jul 24 13:54:53.750359 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.750323    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"]
Jul 24 13:54:53.755050 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.755031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.757657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.757635    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 13:54:53.757763 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.757639    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 13:54:53.757969 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.757942    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 13:54:53.758085 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.758026    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 13:54:53.758655 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.758642    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s924h\""
Jul 24 13:54:53.769020 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.768986    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"]
Jul 24 13:54:53.872546 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.872512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rscl5\" (UniqueName: \"kubernetes.io/projected/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-kube-api-access-rscl5\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.872546 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.872551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-tmp\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.873009 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.872577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-tls-certs\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.973855 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.973802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rscl5\" (UniqueName: \"kubernetes.io/projected/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-kube-api-access-rscl5\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.974042 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.973861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-tmp\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.974042 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.973898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-tls-certs\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.977298 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.977267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-tls-certs\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.977479 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.977380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-tmp\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:53.991768 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:53.991742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rscl5\" (UniqueName: \"kubernetes.io/projected/ecaf1bf7-15eb-443d-8357-5a8d95f51f46-kube-api-access-rscl5\") pod \"kube-auth-proxy-7dc46bdfb5-c5vvx\" (UID: \"ecaf1bf7-15eb-443d-8357-5a8d95f51f46\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:54.064631 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:54.064563    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"
Jul 24 13:54:54.129869 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:54.129761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh" event={"ID":"5482c673-181d-4be0-b2af-39783491a149","Type":"ContainerStarted","Data":"960bb0f7c94c3eaadd11ceae66c98b5341f2a2bb6f949612b1efa12e15f6b0c2"}
Jul 24 13:54:54.132106 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:54.132023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87" event={"ID":"3bfe74c5-a810-4e6e-87c8-1f3fe754db47","Type":"ContainerStarted","Data":"897cc6b6347810a8d099dd6415c82a4d09118602fee6c560867e2b6ff60d6862"}
Jul 24 13:54:54.218084 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:54.218046    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx"]
Jul 24 13:54:54.251534 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:54.251496    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecaf1bf7_15eb_443d_8357_5a8d95f51f46.slice/crio-1dfb2bb9fd24d4721a22cbdc320454e57072c43429008c7b7b9c6e0c30950d1a WatchSource:0}: Error finding container 1dfb2bb9fd24d4721a22cbdc320454e57072c43429008c7b7b9c6e0c30950d1a: Status 404 returned error can't find the container with id 1dfb2bb9fd24d4721a22cbdc320454e57072c43429008c7b7b9c6e0c30950d1a
Jul 24 13:54:55.139919 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.139857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx" event={"ID":"ecaf1bf7-15eb-443d-8357-5a8d95f51f46","Type":"ContainerStarted","Data":"1dfb2bb9fd24d4721a22cbdc320454e57072c43429008c7b7b9c6e0c30950d1a"}
Jul 24 13:54:55.487573 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.487536    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"]
Jul 24 13:54:55.492413 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.492382    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.494760 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.494731    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 13:54:55.494760 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.494752    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 13:54:55.494988 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.494801    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 13:54:55.494988 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.494847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xwzhw\""
Jul 24 13:54:55.494988 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.494752    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 13:54:55.504998 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.504929    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"]
Jul 24 13:54:55.590013 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.589973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.590218 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.590094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a10396-e3ca-4706-9bea-80e313874fde-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.590218 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.590132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8a10396-e3ca-4706-9bea-80e313874fde-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.590218 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.590175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r96rd\" (UniqueName: \"kubernetes.io/projected/d8a10396-e3ca-4706-9bea-80e313874fde-kube-api-access-r96rd\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.590357 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.590225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a10396-e3ca-4706-9bea-80e313874fde-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.590357 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.590250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.590357 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.590273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.690744 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.690701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.691318 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.690806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a10396-e3ca-4706-9bea-80e313874fde-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.691405 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.691366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8a10396-e3ca-4706-9bea-80e313874fde-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.691458 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.691411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96rd\" (UniqueName: \"kubernetes.io/projected/d8a10396-e3ca-4706-9bea-80e313874fde-kube-api-access-r96rd\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.691458 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.691446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a10396-e3ca-4706-9bea-80e313874fde-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.691568 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.691473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.691568 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.691495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.693476 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.693398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8a10396-e3ca-4706-9bea-80e313874fde-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.696251 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.696227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.696632 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.696588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8a10396-e3ca-4706-9bea-80e313874fde-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.697537 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.697503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.697752 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.697735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8a10396-e3ca-4706-9bea-80e313874fde-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.701556 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.701507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r96rd\" (UniqueName: \"kubernetes.io/projected/d8a10396-e3ca-4706-9bea-80e313874fde-kube-api-access-r96rd\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.701556 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.701510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8a10396-e3ca-4706-9bea-80e313874fde-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-25j98\" (UID: \"d8a10396-e3ca-4706-9bea-80e313874fde\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:55.806959 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:55.806875    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:54:57.142713 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.142676    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"]
Jul 24 13:54:57.145714 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:54:57.145683    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a10396_e3ca_4706_9bea_80e313874fde.slice/crio-52654a2cf0d0c99b1a8e62f1bc13a8980008b436400d73122b055db335fd606a WatchSource:0}: Error finding container 52654a2cf0d0c99b1a8e62f1bc13a8980008b436400d73122b055db335fd606a: Status 404 returned error can't find the container with id 52654a2cf0d0c99b1a8e62f1bc13a8980008b436400d73122b055db335fd606a
Jul 24 13:54:57.151092 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.151063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87" event={"ID":"3bfe74c5-a810-4e6e-87c8-1f3fe754db47","Type":"ContainerStarted","Data":"bccfdbac78f0cb2c24f6b6156187054a492f7cd7e66712bc480797901e8e1438"}
Jul 24 13:54:57.151198 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.151129    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:54:57.152453 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.152425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx" event={"ID":"ecaf1bf7-15eb-443d-8357-5a8d95f51f46","Type":"ContainerStarted","Data":"92de3d93c9438d95c67ae7b7f18d4969fc3a09c3da81b1a63fa22d7f2ffffcdf"}
Jul 24 13:54:57.153789 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.153769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh" event={"ID":"5482c673-181d-4be0-b2af-39783491a149","Type":"ContainerStarted","Data":"d708b8c8b7dfde2db71e9c9ce971ae9cd610203d000fda465257fd6e8b2ed244"}
Jul 24 13:54:57.153917 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.153857    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:54:57.166718 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.166574    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87" podStartSLOduration=1.436085517 podStartE2EDuration="5.16656096s" totalImagesPullingTime="3.730475443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:57.165929354 +0000 UTC m=+576.826762524" watchObservedRunningTime="2026-07-24 13:54:57.16656096 +0000 UTC m=+576.827394119"
Jul 24 13:54:57.182422 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.182385    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh" podStartSLOduration=1.473769691 podStartE2EDuration="5.182372483s" totalImagesPullingTime="3.708602792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:57.180949451 +0000 UTC m=+576.841782610" watchObservedRunningTime="2026-07-24 13:54:57.182372483 +0000 UTC m=+576.843205641"
Jul 24 13:54:57.195803 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:57.195758    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-c5vvx" podStartSLOduration=1.439104817 podStartE2EDuration="4.195739955s" totalImagesPullingTime="2.756635138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:57.195057236 +0000 UTC m=+576.855890397" watchObservedRunningTime="2026-07-24 13:54:57.195739955 +0000 UTC m=+576.856573117"
Jul 24 13:54:58.161671 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:58.161625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98" event={"ID":"d8a10396-e3ca-4706-9bea-80e313874fde","Type":"ContainerStarted","Data":"52654a2cf0d0c99b1a8e62f1bc13a8980008b436400d73122b055db335fd606a"}
Jul 24 13:54:59.679148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:59.679111    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:54:59.679530 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:54:59.679192    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 13:55:00.174845 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:00.174791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98" event={"ID":"d8a10396-e3ca-4706-9bea-80e313874fde","Type":"ContainerStarted","Data":"d9e222cc3a3a668503a4c3860f942bcc6dec4928a10996bb447caac2561a6ab1"}
Jul 24 13:55:00.175045 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:00.174999    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:55:00.176611 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:00.176580    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-25j98 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 13:55:00.176733 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:00.176635    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98" podUID="d8a10396-e3ca-4706-9bea-80e313874fde" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 13:55:00.195891 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:00.195833    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98" podStartSLOduration=2.664815306 podStartE2EDuration="5.195794607s" totalImagesPullingTime="2.530979301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:55:00.193201722 +0000 UTC m=+579.854034883" watchObservedRunningTime="2026-07-24 13:55:00.195794607 +0000 UTC m=+579.856627768"
Jul 24 13:55:01.180079 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:01.180047    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-25j98"
Jul 24 13:55:28.164493 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:28.164463    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dwdlh"
Jul 24 13:55:28.207215 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:28.167493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdd87"
Jul 24 13:55:59.570586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.570501    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"]
Jul 24 13:55:59.573057 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.573036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.575239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.575219    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 13:55:59.575363 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.575219    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 13:55:59.576080 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.576059    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x5xxb\""
Jul 24 13:55:59.582432 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.582406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"]
Jul 24 13:55:59.639069 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.639028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.639251 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.639152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.639251 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.639200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzwrf\" (UniqueName: \"kubernetes.io/projected/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-kube-api-access-tzwrf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.739627 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.739596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.739794 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.739643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzwrf\" (UniqueName: \"kubernetes.io/projected/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-kube-api-access-tzwrf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.739794 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.739672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.740004 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.739987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.740043 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.740018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.747538 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.747513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzwrf\" (UniqueName: \"kubernetes.io/projected/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-kube-api-access-tzwrf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:55:59.884764 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:55:59.884672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:56:00.016501 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.016464    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"]
Jul 24 13:56:00.019326 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:56:00.019299    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e8fcf9_f7cb_4e6c_8d6a_a6cc895efca4.slice/crio-05e1bd4bbd93b9ea7636e245de95b4c726bbd994e037eb08177d7871db06ac7a WatchSource:0}: Error finding container 05e1bd4bbd93b9ea7636e245de95b4c726bbd994e037eb08177d7871db06ac7a: Status 404 returned error can't find the container with id 05e1bd4bbd93b9ea7636e245de95b4c726bbd994e037eb08177d7871db06ac7a
Jul 24 13:56:00.367839 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.367783    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"]
Jul 24 13:56:00.370235 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.370218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.379462 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.379425    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"]
Jul 24 13:56:00.445786 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.445756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.445967 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.445807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6hfm\" (UniqueName: \"kubernetes.io/projected/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-kube-api-access-g6hfm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.445967 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.445883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.449317 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.449289    2563 generic.go:356] "Generic (PLEG): container finished" podID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerID="78be5458e586f22274a9936635284a1677db22a997a498dd1746b7931f6dd3e4" exitCode=0
Jul 24 13:56:00.449431 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.449379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs" event={"ID":"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4","Type":"ContainerDied","Data":"78be5458e586f22274a9936635284a1677db22a997a498dd1746b7931f6dd3e4"}
Jul 24 13:56:00.449431 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.449424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs" event={"ID":"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4","Type":"ContainerStarted","Data":"05e1bd4bbd93b9ea7636e245de95b4c726bbd994e037eb08177d7871db06ac7a"}
Jul 24 13:56:00.546629 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.546598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.546781 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.546654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6hfm\" (UniqueName: \"kubernetes.io/projected/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-kube-api-access-g6hfm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.546781 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.546683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.547092 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.547073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.547130 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.547078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.554405 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.554386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6hfm\" (UniqueName: \"kubernetes.io/projected/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-kube-api-access-g6hfm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.680317 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.680243    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:00.770506 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.770474    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"]
Jul 24 13:56:00.773659 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.773637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.781921 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.781860    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"]
Jul 24 13:56:00.832720 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.831295    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"]
Jul 24 13:56:00.836373 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:56:00.836348    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fecc45f_d8bb_4207_9ac7_8c080ac34df7.slice/crio-0568cdba04242c43b80bdc10a661e59d0d88d2f95335fe48307bd9c9f13ebd23 WatchSource:0}: Error finding container 0568cdba04242c43b80bdc10a661e59d0d88d2f95335fe48307bd9c9f13ebd23: Status 404 returned error can't find the container with id 0568cdba04242c43b80bdc10a661e59d0d88d2f95335fe48307bd9c9f13ebd23
Jul 24 13:56:00.859754 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.859727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ph6\" (UniqueName: \"kubernetes.io/projected/bdcbfc9d-2439-43ec-a348-d466728e1344-kube-api-access-p7ph6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.859889 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.859779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.859889 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.859844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.961058 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.961030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ph6\" (UniqueName: \"kubernetes.io/projected/bdcbfc9d-2439-43ec-a348-d466728e1344-kube-api-access-p7ph6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.961164 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.961079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.961164 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.961105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.961438 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.961422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.961492 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.961448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:00.969221 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:00.969195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ph6\" (UniqueName: \"kubernetes.io/projected/bdcbfc9d-2439-43ec-a348-d466728e1344-kube-api-access-p7ph6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:01.087876 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.087842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:01.170721 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.170690    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"]
Jul 24 13:56:01.174196 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.173911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.184586 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.184511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"]
Jul 24 13:56:01.230603 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.230574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"]
Jul 24 13:56:01.243275 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:56:01.243234    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdcbfc9d_2439_43ec_a348_d466728e1344.slice/crio-36fccbad7e1bea2a96957628ccfed443084edf57294a3281abad9c64ec0e88b9 WatchSource:0}: Error finding container 36fccbad7e1bea2a96957628ccfed443084edf57294a3281abad9c64ec0e88b9: Status 404 returned error can't find the container with id 36fccbad7e1bea2a96957628ccfed443084edf57294a3281abad9c64ec0e88b9
Jul 24 13:56:01.263590 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.263563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5fdc\" (UniqueName: \"kubernetes.io/projected/6c96cf45-aaa6-46fa-98b3-4bc21da31898-kube-api-access-f5fdc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.263687 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.263627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.263687 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.263656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.364702 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.364665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.364876 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.364721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.364876 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.364799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5fdc\" (UniqueName: \"kubernetes.io/projected/6c96cf45-aaa6-46fa-98b3-4bc21da31898-kube-api-access-f5fdc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.365067 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.365049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.365157 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.365064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.373452 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.373423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5fdc\" (UniqueName: \"kubernetes.io/projected/6c96cf45-aaa6-46fa-98b3-4bc21da31898-kube-api-access-f5fdc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.456179 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.456106    2563 generic.go:356] "Generic (PLEG): container finished" podID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerID="a6ac29d3a6e785175bb4814b4fe19fda59c84ac3b0181d0e5a6207a194d39935" exitCode=0
Jul 24 13:56:01.456321 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.456187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z" event={"ID":"2fecc45f-d8bb-4207-9ac7-8c080ac34df7","Type":"ContainerDied","Data":"a6ac29d3a6e785175bb4814b4fe19fda59c84ac3b0181d0e5a6207a194d39935"}
Jul 24 13:56:01.456321 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.456243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z" event={"ID":"2fecc45f-d8bb-4207-9ac7-8c080ac34df7","Type":"ContainerStarted","Data":"0568cdba04242c43b80bdc10a661e59d0d88d2f95335fe48307bd9c9f13ebd23"}
Jul 24 13:56:01.457741 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.457717    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerID="bcb070becaca6121acfb3235d8a9dd2c3bbacdd0e58d2181c34d46d68b67dba4" exitCode=0
Jul 24 13:56:01.457854 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.457803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9" event={"ID":"bdcbfc9d-2439-43ec-a348-d466728e1344","Type":"ContainerDied","Data":"bcb070becaca6121acfb3235d8a9dd2c3bbacdd0e58d2181c34d46d68b67dba4"}
Jul 24 13:56:01.457927 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.457872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9" event={"ID":"bdcbfc9d-2439-43ec-a348-d466728e1344","Type":"ContainerStarted","Data":"36fccbad7e1bea2a96957628ccfed443084edf57294a3281abad9c64ec0e88b9"}
Jul 24 13:56:01.459664 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.459644    2563 generic.go:356] "Generic (PLEG): container finished" podID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerID="bb025d5fd9d97f417939461094c8efc70683999c7ed7f7dbfa23880169974e02" exitCode=0
Jul 24 13:56:01.459780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.459700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs" event={"ID":"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4","Type":"ContainerDied","Data":"bb025d5fd9d97f417939461094c8efc70683999c7ed7f7dbfa23880169974e02"}
Jul 24 13:56:01.488713 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.488687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:01.627617 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:01.627592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"]
Jul 24 13:56:01.633797 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:56:01.633768    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c96cf45_aaa6_46fa_98b3_4bc21da31898.slice/crio-ee2876c3f3e624fcd2c3fbe3fa81645f0728e92e1517b76ec9fef93ddbe3c727 WatchSource:0}: Error finding container ee2876c3f3e624fcd2c3fbe3fa81645f0728e92e1517b76ec9fef93ddbe3c727: Status 404 returned error can't find the container with id ee2876c3f3e624fcd2c3fbe3fa81645f0728e92e1517b76ec9fef93ddbe3c727
Jul 24 13:56:02.466462 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.466422    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerID="1faa43b7570efb164b3b12896c1433f71706a165eb5d83b400898572428941a0" exitCode=0
Jul 24 13:56:02.466958 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.466507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9" event={"ID":"bdcbfc9d-2439-43ec-a348-d466728e1344","Type":"ContainerDied","Data":"1faa43b7570efb164b3b12896c1433f71706a165eb5d83b400898572428941a0"}
Jul 24 13:56:02.468118 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.468052    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerID="dd2c00c5bd34f43a8fce2aade6515f8cc5832e2eb7c688860edc13397ac09c3e" exitCode=0
Jul 24 13:56:02.468192 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.468108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6" event={"ID":"6c96cf45-aaa6-46fa-98b3-4bc21da31898","Type":"ContainerDied","Data":"dd2c00c5bd34f43a8fce2aade6515f8cc5832e2eb7c688860edc13397ac09c3e"}
Jul 24 13:56:02.468192 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.468155    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6" event={"ID":"6c96cf45-aaa6-46fa-98b3-4bc21da31898","Type":"ContainerStarted","Data":"ee2876c3f3e624fcd2c3fbe3fa81645f0728e92e1517b76ec9fef93ddbe3c727"}
Jul 24 13:56:02.470367 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.470343    2563 generic.go:356] "Generic (PLEG): container finished" podID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerID="eb407c4b39f30c7fd88f274eb76f37c0ba53a33813dbf4b937989c817ead66d8" exitCode=0
Jul 24 13:56:02.470487 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.470437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs" event={"ID":"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4","Type":"ContainerDied","Data":"eb407c4b39f30c7fd88f274eb76f37c0ba53a33813dbf4b937989c817ead66d8"}
Jul 24 13:56:02.472480 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.472457    2563 generic.go:356] "Generic (PLEG): container finished" podID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerID="f7071272ecf4a50de3c9b67d07c12dc28f67f8c0d606d7559314a1e9a83aa1a7" exitCode=0
Jul 24 13:56:02.472558 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:02.472498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z" event={"ID":"2fecc45f-d8bb-4207-9ac7-8c080ac34df7","Type":"ContainerDied","Data":"f7071272ecf4a50de3c9b67d07c12dc28f67f8c0d606d7559314a1e9a83aa1a7"}
Jul 24 13:56:03.479469 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.479427    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerID="a7b9a7d729f9f989e0a82fe571a4f15390c274b655f343937523a42167ef39fe" exitCode=0
Jul 24 13:56:03.479875 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.479522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9" event={"ID":"bdcbfc9d-2439-43ec-a348-d466728e1344","Type":"ContainerDied","Data":"a7b9a7d729f9f989e0a82fe571a4f15390c274b655f343937523a42167ef39fe"}
Jul 24 13:56:03.481231 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.481206    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerID="adb501fefe7dbab4ddc83ae22d6fe620bd2089601a419076d9deb0dc080b3575" exitCode=0
Jul 24 13:56:03.481340 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.481279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6" event={"ID":"6c96cf45-aaa6-46fa-98b3-4bc21da31898","Type":"ContainerDied","Data":"adb501fefe7dbab4ddc83ae22d6fe620bd2089601a419076d9deb0dc080b3575"}
Jul 24 13:56:03.483644 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.483621    2563 generic.go:356] "Generic (PLEG): container finished" podID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerID="c0900ff9b79c9be082b31353c7e6125a839af48f2d8e372183d93427085a396b" exitCode=0
Jul 24 13:56:03.483755 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.483702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z" event={"ID":"2fecc45f-d8bb-4207-9ac7-8c080ac34df7","Type":"ContainerDied","Data":"c0900ff9b79c9be082b31353c7e6125a839af48f2d8e372183d93427085a396b"}
Jul 24 13:56:03.676871 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.676843    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:56:03.786635 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.786543    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-util\") pod \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") "
Jul 24 13:56:03.786635 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.786583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-bundle\") pod \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") "
Jul 24 13:56:03.786635 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.786603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzwrf\" (UniqueName: \"kubernetes.io/projected/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-kube-api-access-tzwrf\") pod \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\" (UID: \"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4\") "
Jul 24 13:56:03.787061 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.787031    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-bundle" (OuterVolumeSpecName: "bundle") pod "75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" (UID: "75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:03.789052 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.789027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-kube-api-access-tzwrf" (OuterVolumeSpecName: "kube-api-access-tzwrf") pod "75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" (UID: "75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4"). InnerVolumeSpecName "kube-api-access-tzwrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:56:03.792416 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.792389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-util" (OuterVolumeSpecName: "util") pod "75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" (UID: "75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:03.887788 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.887757    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-util\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:03.887788 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.887785    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:03.887788 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:03.887793    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzwrf\" (UniqueName: \"kubernetes.io/projected/75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4-kube-api-access-tzwrf\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:04.490588 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.490550    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerID="c6530a2164c39ef69b2e7839142c2fc22c48f17042b0701f3a586a7eac5cf14c" exitCode=0
Jul 24 13:56:04.491011 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.490633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6" event={"ID":"6c96cf45-aaa6-46fa-98b3-4bc21da31898","Type":"ContainerDied","Data":"c6530a2164c39ef69b2e7839142c2fc22c48f17042b0701f3a586a7eac5cf14c"}
Jul 24 13:56:04.492524 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.492507    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs"
Jul 24 13:56:04.492568 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.492527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs" event={"ID":"75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4","Type":"ContainerDied","Data":"05e1bd4bbd93b9ea7636e245de95b4c726bbd994e037eb08177d7871db06ac7a"}
Jul 24 13:56:04.492568 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.492565    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05e1bd4bbd93b9ea7636e245de95b4c726bbd994e037eb08177d7871db06ac7a"
Jul 24 13:56:04.624388 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.624361    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:04.654022 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.653995    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:04.693995 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.693969    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7ph6\" (UniqueName: \"kubernetes.io/projected/bdcbfc9d-2439-43ec-a348-d466728e1344-kube-api-access-p7ph6\") pod \"bdcbfc9d-2439-43ec-a348-d466728e1344\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") "
Jul 24 13:56:04.694151 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.694035    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-bundle\") pod \"bdcbfc9d-2439-43ec-a348-d466728e1344\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") "
Jul 24 13:56:04.694151 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.694093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-util\") pod \"bdcbfc9d-2439-43ec-a348-d466728e1344\" (UID: \"bdcbfc9d-2439-43ec-a348-d466728e1344\") "
Jul 24 13:56:04.694587 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.694563    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-bundle" (OuterVolumeSpecName: "bundle") pod "bdcbfc9d-2439-43ec-a348-d466728e1344" (UID: "bdcbfc9d-2439-43ec-a348-d466728e1344"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:04.696069 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.696046    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdcbfc9d-2439-43ec-a348-d466728e1344-kube-api-access-p7ph6" (OuterVolumeSpecName: "kube-api-access-p7ph6") pod "bdcbfc9d-2439-43ec-a348-d466728e1344" (UID: "bdcbfc9d-2439-43ec-a348-d466728e1344"). InnerVolumeSpecName "kube-api-access-p7ph6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:56:04.699837 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.699803    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-util" (OuterVolumeSpecName: "util") pod "bdcbfc9d-2439-43ec-a348-d466728e1344" (UID: "bdcbfc9d-2439-43ec-a348-d466728e1344"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:04.795498 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.795465    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6hfm\" (UniqueName: \"kubernetes.io/projected/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-kube-api-access-g6hfm\") pod \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") "
Jul 24 13:56:04.795617 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.795546    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-bundle\") pod \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") "
Jul 24 13:56:04.795617 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.795588    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-util\") pod \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\" (UID: \"2fecc45f-d8bb-4207-9ac7-8c080ac34df7\") "
Jul 24 13:56:04.795728 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.795715    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:04.795776 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.795728    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdcbfc9d-2439-43ec-a348-d466728e1344-util\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:04.795776 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.795736    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7ph6\" (UniqueName: \"kubernetes.io/projected/bdcbfc9d-2439-43ec-a348-d466728e1344-kube-api-access-p7ph6\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:04.796337 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.796310    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-bundle" (OuterVolumeSpecName: "bundle") pod "2fecc45f-d8bb-4207-9ac7-8c080ac34df7" (UID: "2fecc45f-d8bb-4207-9ac7-8c080ac34df7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:04.797780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.797760    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-kube-api-access-g6hfm" (OuterVolumeSpecName: "kube-api-access-g6hfm") pod "2fecc45f-d8bb-4207-9ac7-8c080ac34df7" (UID: "2fecc45f-d8bb-4207-9ac7-8c080ac34df7"). InnerVolumeSpecName "kube-api-access-g6hfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:56:04.801063 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.801044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-util" (OuterVolumeSpecName: "util") pod "2fecc45f-d8bb-4207-9ac7-8c080ac34df7" (UID: "2fecc45f-d8bb-4207-9ac7-8c080ac34df7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:04.896151 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.896126    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:04.896151 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.896151    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-util\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:04.896296 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:04.896160    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6hfm\" (UniqueName: \"kubernetes.io/projected/2fecc45f-d8bb-4207-9ac7-8c080ac34df7-kube-api-access-g6hfm\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:05.500218 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.500187    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9"
Jul 24 13:56:05.500218 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.500207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9" event={"ID":"bdcbfc9d-2439-43ec-a348-d466728e1344","Type":"ContainerDied","Data":"36fccbad7e1bea2a96957628ccfed443084edf57294a3281abad9c64ec0e88b9"}
Jul 24 13:56:05.500686 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.500250    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36fccbad7e1bea2a96957628ccfed443084edf57294a3281abad9c64ec0e88b9"
Jul 24 13:56:05.502333 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.502264    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z" event={"ID":"2fecc45f-d8bb-4207-9ac7-8c080ac34df7","Type":"ContainerDied","Data":"0568cdba04242c43b80bdc10a661e59d0d88d2f95335fe48307bd9c9f13ebd23"}
Jul 24 13:56:05.502333 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.502306    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0568cdba04242c43b80bdc10a661e59d0d88d2f95335fe48307bd9c9f13ebd23"
Jul 24 13:56:05.502512 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.502454    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z"
Jul 24 13:56:05.632335 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.632310    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:05.703282 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.703247    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-util\") pod \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") "
Jul 24 13:56:05.703463 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.703315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5fdc\" (UniqueName: \"kubernetes.io/projected/6c96cf45-aaa6-46fa-98b3-4bc21da31898-kube-api-access-f5fdc\") pod \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") "
Jul 24 13:56:05.703463 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.703331    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-bundle\") pod \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\" (UID: \"6c96cf45-aaa6-46fa-98b3-4bc21da31898\") "
Jul 24 13:56:05.704058 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.703940    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-bundle" (OuterVolumeSpecName: "bundle") pod "6c96cf45-aaa6-46fa-98b3-4bc21da31898" (UID: "6c96cf45-aaa6-46fa-98b3-4bc21da31898"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:05.705555 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.705522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c96cf45-aaa6-46fa-98b3-4bc21da31898-kube-api-access-f5fdc" (OuterVolumeSpecName: "kube-api-access-f5fdc") pod "6c96cf45-aaa6-46fa-98b3-4bc21da31898" (UID: "6c96cf45-aaa6-46fa-98b3-4bc21da31898"). InnerVolumeSpecName "kube-api-access-f5fdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:56:05.708447 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.708416    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-util" (OuterVolumeSpecName: "util") pod "6c96cf45-aaa6-46fa-98b3-4bc21da31898" (UID: "6c96cf45-aaa6-46fa-98b3-4bc21da31898"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:56:05.804325 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.804235    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-util\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:05.804325 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.804268    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5fdc\" (UniqueName: \"kubernetes.io/projected/6c96cf45-aaa6-46fa-98b3-4bc21da31898-kube-api-access-f5fdc\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:05.804325 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:05.804278    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c96cf45-aaa6-46fa-98b3-4bc21da31898-bundle\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:56:06.508657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:06.508623    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6" event={"ID":"6c96cf45-aaa6-46fa-98b3-4bc21da31898","Type":"ContainerDied","Data":"ee2876c3f3e624fcd2c3fbe3fa81645f0728e92e1517b76ec9fef93ddbe3c727"}
Jul 24 13:56:06.508657 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:06.508646    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6"
Jul 24 13:56:06.509201 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:06.508674    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee2876c3f3e624fcd2c3fbe3fa81645f0728e92e1517b76ec9fef93ddbe3c727"
Jul 24 13:56:20.309694 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.309658    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"]
Jul 24 13:56:20.310244 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310225    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerName="util"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310247    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerName="util"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310284    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerName="util"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310292    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerName="util"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310304    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerName="extract"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310313    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerName="extract"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310332    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerName="util"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310340    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerName="util"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310349    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerName="extract"
Jul 24 13:56:20.310368 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310357    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310373    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310381    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310389    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310397    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310416    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310424    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310436    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310444    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310453    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310463    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310475    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerName="util"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310483    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerName="util"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310493    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310501    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerName="pull"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310581    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fecc45f-d8bb-4207-9ac7-8c080ac34df7" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310595    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdcbfc9d-2439-43ec-a348-d466728e1344" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310603    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c96cf45-aaa6-46fa-98b3-4bc21da31898" containerName="extract"
Jul 24 13:56:20.310767 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.310611    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4" containerName="extract"
Jul 24 13:56:20.313723 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.313701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"
Jul 24 13:56:20.317768 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.317747    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 13:56:20.317893 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.317772    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jlzxw\""
Jul 24 13:56:20.318338 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.318324    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 13:56:20.325453 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.325429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"]
Jul 24 13:56:20.336223 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.336191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p7fz\" (UniqueName: \"kubernetes.io/projected/58d88bd2-d583-4839-9566-bf4c8d9599a6-kube-api-access-5p7fz\") pod \"authorino-operator-75cc8d5cb7-mfzk7\" (UID: \"58d88bd2-d583-4839-9566-bf4c8d9599a6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"
Jul 24 13:56:20.436758 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.436724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p7fz\" (UniqueName: \"kubernetes.io/projected/58d88bd2-d583-4839-9566-bf4c8d9599a6-kube-api-access-5p7fz\") pod \"authorino-operator-75cc8d5cb7-mfzk7\" (UID: \"58d88bd2-d583-4839-9566-bf4c8d9599a6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"
Jul 24 13:56:20.447239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.447207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p7fz\" (UniqueName: \"kubernetes.io/projected/58d88bd2-d583-4839-9566-bf4c8d9599a6-kube-api-access-5p7fz\") pod \"authorino-operator-75cc8d5cb7-mfzk7\" (UID: \"58d88bd2-d583-4839-9566-bf4c8d9599a6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"
Jul 24 13:56:20.623860 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.623744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"
Jul 24 13:56:20.773136 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:20.773109    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"]
Jul 24 13:56:20.774542 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:56:20.774520    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d88bd2_d583_4839_9566_bf4c8d9599a6.slice/crio-af2253727de8486e261f41cf8163bc5effdf79bd25a43c0eb086526977ae1728 WatchSource:0}: Error finding container af2253727de8486e261f41cf8163bc5effdf79bd25a43c0eb086526977ae1728: Status 404 returned error can't find the container with id af2253727de8486e261f41cf8163bc5effdf79bd25a43c0eb086526977ae1728
Jul 24 13:56:21.584702 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:21.584650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7" event={"ID":"58d88bd2-d583-4839-9566-bf4c8d9599a6","Type":"ContainerStarted","Data":"af2253727de8486e261f41cf8163bc5effdf79bd25a43c0eb086526977ae1728"}
Jul 24 13:56:23.597271 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:23.597234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7" event={"ID":"58d88bd2-d583-4839-9566-bf4c8d9599a6","Type":"ContainerStarted","Data":"45bced037de95dbd1d5f78a8d2c825aa254bcafc60bca75c3915fdb3a45b4a6c"}
Jul 24 13:56:23.597712 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:23.597336    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"
Jul 24 13:56:23.619868 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:23.619797    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7" podStartSLOduration=1.272082779 podStartE2EDuration="3.619776726s" totalImagesPullingTime="2.347693947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:56:23.618357702 +0000 UTC m=+663.279190862" watchObservedRunningTime="2026-07-24 13:56:23.619776726 +0000 UTC m=+663.280609884"
Jul 24 13:56:34.605016 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:56:34.604985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfzk7"
Jul 24 13:57:17.467207 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.467129    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dddr7"]
Jul 24 13:57:17.470392 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.470376    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.472578 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.472544    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x5xxb\""
Jul 24 13:57:17.472708 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.472573    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 13:57:17.479116 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.479050    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dddr7"]
Jul 24 13:57:17.520793 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.520764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b484b127-6eb7-4ce8-81b9-c7adfabb1818-config-file\") pod \"limitador-limitador-64c94fd64f-dddr7\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.520954 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.520851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfccr\" (UniqueName: \"kubernetes.io/projected/b484b127-6eb7-4ce8-81b9-c7adfabb1818-kube-api-access-gfccr\") pod \"limitador-limitador-64c94fd64f-dddr7\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.558253 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.558215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dddr7"]
Jul 24 13:57:17.621747 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.621719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b484b127-6eb7-4ce8-81b9-c7adfabb1818-config-file\") pod \"limitador-limitador-64c94fd64f-dddr7\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.621933 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.621772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfccr\" (UniqueName: \"kubernetes.io/projected/b484b127-6eb7-4ce8-81b9-c7adfabb1818-kube-api-access-gfccr\") pod \"limitador-limitador-64c94fd64f-dddr7\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.622410 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.622392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b484b127-6eb7-4ce8-81b9-c7adfabb1818-config-file\") pod \"limitador-limitador-64c94fd64f-dddr7\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.636210 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.636180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfccr\" (UniqueName: \"kubernetes.io/projected/b484b127-6eb7-4ce8-81b9-c7adfabb1818-kube-api-access-gfccr\") pod \"limitador-limitador-64c94fd64f-dddr7\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.782479 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.782450    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:17.914627 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.914602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dddr7"]
Jul 24 13:57:17.917237 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:57:17.917198    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb484b127_6eb7_4ce8_81b9_c7adfabb1818.slice/crio-36caf56fa10adc2263e887ade328527ea385723b38c955f25639dee48fa476b2 WatchSource:0}: Error finding container 36caf56fa10adc2263e887ade328527ea385723b38c955f25639dee48fa476b2: Status 404 returned error can't find the container with id 36caf56fa10adc2263e887ade328527ea385723b38c955f25639dee48fa476b2
Jul 24 13:57:17.919188 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:17.919169    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:57:18.880453 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:18.880419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7" event={"ID":"b484b127-6eb7-4ce8-81b9-c7adfabb1818","Type":"ContainerStarted","Data":"36caf56fa10adc2263e887ade328527ea385723b38c955f25639dee48fa476b2"}
Jul 24 13:57:20.892363 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:20.892268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7" event={"ID":"b484b127-6eb7-4ce8-81b9-c7adfabb1818","Type":"ContainerStarted","Data":"a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b"}
Jul 24 13:57:20.892729 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:20.892373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:20.915827 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:20.915770    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7" podStartSLOduration=1.2635039080000001 podStartE2EDuration="3.915749843s" totalImagesPullingTime="2.652245935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:57:20.914222644 +0000 UTC m=+720.575055814" watchObservedRunningTime="2026-07-24 13:57:20.915749843 +0000 UTC m=+720.576583003"
Jul 24 13:57:31.898543 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:31.898511    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:32.182486 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.182396    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dddr7"]
Jul 24 13:57:32.182643 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.182586    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7" podUID="b484b127-6eb7-4ce8-81b9-c7adfabb1818" containerName="limitador" containerID="cri-o://a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b" gracePeriod=30
Jul 24 13:57:32.727994 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.727968    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:32.851750 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.851657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b484b127-6eb7-4ce8-81b9-c7adfabb1818-config-file\") pod \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") "
Jul 24 13:57:32.851918 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.851805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfccr\" (UniqueName: \"kubernetes.io/projected/b484b127-6eb7-4ce8-81b9-c7adfabb1818-kube-api-access-gfccr\") pod \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\" (UID: \"b484b127-6eb7-4ce8-81b9-c7adfabb1818\") "
Jul 24 13:57:32.852313 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.852288    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b484b127-6eb7-4ce8-81b9-c7adfabb1818-config-file" (OuterVolumeSpecName: "config-file") pod "b484b127-6eb7-4ce8-81b9-c7adfabb1818" (UID: "b484b127-6eb7-4ce8-81b9-c7adfabb1818"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:57:32.853996 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.853970    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b484b127-6eb7-4ce8-81b9-c7adfabb1818-kube-api-access-gfccr" (OuterVolumeSpecName: "kube-api-access-gfccr") pod "b484b127-6eb7-4ce8-81b9-c7adfabb1818" (UID: "b484b127-6eb7-4ce8-81b9-c7adfabb1818"). InnerVolumeSpecName "kube-api-access-gfccr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:57:32.953026 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.952968    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfccr\" (UniqueName: \"kubernetes.io/projected/b484b127-6eb7-4ce8-81b9-c7adfabb1818-kube-api-access-gfccr\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:57:32.953026 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.952999    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b484b127-6eb7-4ce8-81b9-c7adfabb1818-config-file\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 13:57:32.953508 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.953356    2563 generic.go:356] "Generic (PLEG): container finished" podID="b484b127-6eb7-4ce8-81b9-c7adfabb1818" containerID="a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b" exitCode=0
Jul 24 13:57:32.953508 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.953393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7" event={"ID":"b484b127-6eb7-4ce8-81b9-c7adfabb1818","Type":"ContainerDied","Data":"a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b"}
Jul 24 13:57:32.953508 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.953405    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7"
Jul 24 13:57:32.953508 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.953438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dddr7" event={"ID":"b484b127-6eb7-4ce8-81b9-c7adfabb1818","Type":"ContainerDied","Data":"36caf56fa10adc2263e887ade328527ea385723b38c955f25639dee48fa476b2"}
Jul 24 13:57:32.953508 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.953463    2563 scope.go:117] "RemoveContainer" containerID="a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b"
Jul 24 13:57:32.962239 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.962219    2563 scope.go:117] "RemoveContainer" containerID="a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b"
Jul 24 13:57:32.962522 ip-10-0-131-103 kubenswrapper[2563]: E0724 13:57:32.962503    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b\": container with ID starting with a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b not found: ID does not exist" containerID="a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b"
Jul 24 13:57:32.962581 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.962530    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b"} err="failed to get container status \"a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b\": rpc error: code = NotFound desc = could not find container \"a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b\": container with ID starting with a9e2344f3dbf0b390af66be375bb22cb0066023c38ac8585bf3cb6236584b15b not found: ID does not exist"
Jul 24 13:57:32.971541 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.971519    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dddr7"]
Jul 24 13:57:32.978931 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:32.978914    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dddr7"]
Jul 24 13:57:34.087598 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.087566    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"]
Jul 24 13:57:34.088096 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.088077    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b484b127-6eb7-4ce8-81b9-c7adfabb1818" containerName="limitador"
Jul 24 13:57:34.088174 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.088100    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b484b127-6eb7-4ce8-81b9-c7adfabb1818" containerName="limitador"
Jul 24 13:57:34.088228 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.088214    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b484b127-6eb7-4ce8-81b9-c7adfabb1818" containerName="limitador"
Jul 24 13:57:34.092554 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.092532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.095315 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.095293    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jgjzh\""
Jul 24 13:57:34.095461 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.095295    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 13:57:34.096125 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.096106    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 13:57:34.096233 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.096136    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 13:57:34.101618 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.101594    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"]
Jul 24 13:57:34.163307 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.163268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5pq\" (UniqueName: \"kubernetes.io/projected/5c16dede-3f8e-48cb-858b-821100df2d18-kube-api-access-vc5pq\") pod \"postgres-69fb4594cf-l7ll8\" (UID: \"5c16dede-3f8e-48cb-858b-821100df2d18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.163484 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.163320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c16dede-3f8e-48cb-858b-821100df2d18-data\") pod \"postgres-69fb4594cf-l7ll8\" (UID: \"5c16dede-3f8e-48cb-858b-821100df2d18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.264706 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.264665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5pq\" (UniqueName: \"kubernetes.io/projected/5c16dede-3f8e-48cb-858b-821100df2d18-kube-api-access-vc5pq\") pod \"postgres-69fb4594cf-l7ll8\" (UID: \"5c16dede-3f8e-48cb-858b-821100df2d18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.264944 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.264724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c16dede-3f8e-48cb-858b-821100df2d18-data\") pod \"postgres-69fb4594cf-l7ll8\" (UID: \"5c16dede-3f8e-48cb-858b-821100df2d18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.265148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.265129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c16dede-3f8e-48cb-858b-821100df2d18-data\") pod \"postgres-69fb4594cf-l7ll8\" (UID: \"5c16dede-3f8e-48cb-858b-821100df2d18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.274093 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.274061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5pq\" (UniqueName: \"kubernetes.io/projected/5c16dede-3f8e-48cb-858b-821100df2d18-kube-api-access-vc5pq\") pod \"postgres-69fb4594cf-l7ll8\" (UID: \"5c16dede-3f8e-48cb-858b-821100df2d18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.403840 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.403722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:34.542002 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.541969    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"]
Jul 24 13:57:34.545483 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:57:34.545458    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c16dede_3f8e_48cb_858b_821100df2d18.slice/crio-d1408774e2737494f5f4f74fb8451aa2633f482c9c2554e139379f8b71fbc8f6 WatchSource:0}: Error finding container d1408774e2737494f5f4f74fb8451aa2633f482c9c2554e139379f8b71fbc8f6: Status 404 returned error can't find the container with id d1408774e2737494f5f4f74fb8451aa2633f482c9c2554e139379f8b71fbc8f6
Jul 24 13:57:34.864079 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.864046    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b484b127-6eb7-4ce8-81b9-c7adfabb1818" path="/var/lib/kubelet/pods/b484b127-6eb7-4ce8-81b9-c7adfabb1818/volumes"
Jul 24 13:57:34.964971 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:34.964931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8" event={"ID":"5c16dede-3f8e-48cb-858b-821100df2d18","Type":"ContainerStarted","Data":"d1408774e2737494f5f4f74fb8451aa2633f482c9c2554e139379f8b71fbc8f6"}
Jul 24 13:57:39.995347 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:39.995310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8" event={"ID":"5c16dede-3f8e-48cb-858b-821100df2d18","Type":"ContainerStarted","Data":"712b93519df04185d7f43f5ea3e766d35b407b583e625e4100ef91d6bfd058e3"}
Jul 24 13:57:39.995773 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:39.995428    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:40.011786 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:40.011733    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8" podStartSLOduration=1.018669116 podStartE2EDuration="6.011720141s" totalImagesPullingTime="4.993051025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:57:40.010756437 +0000 UTC m=+739.671589597" watchObservedRunningTime="2026-07-24 13:57:40.011720141 +0000 UTC m=+739.672553299"
Jul 24 13:57:46.030125 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:46.030091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l7ll8"
Jul 24 13:57:53.725457 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.725419    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-ljskf"]
Jul 24 13:57:53.743201 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.743173    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-ljskf"]
Jul 24 13:57:53.743359 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.743289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:53.746576 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.746550    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 13:57:53.746576 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.746568    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jjwlm\""
Jul 24 13:57:53.746725 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.746653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 13:57:53.838256 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.838216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfw6r\" (UniqueName: \"kubernetes.io/projected/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-kube-api-access-mfw6r\") pod \"maas-controller-5588d9cbf8-ljskf\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") " pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:53.838448 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.838265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-webhook-cert\") pod \"maas-controller-5588d9cbf8-ljskf\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") " pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:53.939108 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.939070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfw6r\" (UniqueName: \"kubernetes.io/projected/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-kube-api-access-mfw6r\") pod \"maas-controller-5588d9cbf8-ljskf\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") " pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:53.939108 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.939115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-webhook-cert\") pod \"maas-controller-5588d9cbf8-ljskf\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") " pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:53.941761 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.941732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-webhook-cert\") pod \"maas-controller-5588d9cbf8-ljskf\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") " pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:53.947745 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:53.947724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfw6r\" (UniqueName: \"kubernetes.io/projected/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-kube-api-access-mfw6r\") pod \"maas-controller-5588d9cbf8-ljskf\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") " pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:54.054350 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:54.054269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:54.214148 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:54.214122    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-ljskf"]
Jul 24 13:57:54.216108 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:57:54.216084    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5eb59c_f53f_41f0_87f0_3c8706a4223f.slice/crio-ea0acc0a9ed4e0a8eaa0ce65cf3c3777f9187c07e9c7757351b1fac9bfbde8be WatchSource:0}: Error finding container ea0acc0a9ed4e0a8eaa0ce65cf3c3777f9187c07e9c7757351b1fac9bfbde8be: Status 404 returned error can't find the container with id ea0acc0a9ed4e0a8eaa0ce65cf3c3777f9187c07e9c7757351b1fac9bfbde8be
Jul 24 13:57:55.080226 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:55.080183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-ljskf" event={"ID":"ef5eb59c-f53f-41f0-87f0-3c8706a4223f","Type":"ContainerStarted","Data":"ea0acc0a9ed4e0a8eaa0ce65cf3c3777f9187c07e9c7757351b1fac9bfbde8be"}
Jul 24 13:57:57.092792 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:57.092751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-ljskf" event={"ID":"ef5eb59c-f53f-41f0-87f0-3c8706a4223f","Type":"ContainerStarted","Data":"57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4"}
Jul 24 13:57:57.093241 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:57.092808    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:57:57.123347 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:57:57.123293    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5588d9cbf8-ljskf" podStartSLOduration=1.913063414 podStartE2EDuration="4.123278151s" totalImagesPullingTime="2.210214737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:57:57.121033039 +0000 UTC m=+756.781866197" watchObservedRunningTime="2026-07-24 13:57:57.123278151 +0000 UTC m=+756.784111310"
Jul 24 13:58:08.101501 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:08.101469    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 13:58:29.126294 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.126249    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"]
Jul 24 13:58:29.130969 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.130950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.133433 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.133413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ctd4l\""
Jul 24 13:58:29.133552 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.133435    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 24 13:58:29.142031 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.141998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"]
Jul 24 13:58:29.226112 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.226081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8da8947-d2ff-4ba4-9781-9523c8221101-maas-api-tls\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.226268 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.226135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8da8947-d2ff-4ba4-9781-9523c8221101-openshift-service-ca\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.226268 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.226231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2sp5\" (UniqueName: \"kubernetes.io/projected/d8da8947-d2ff-4ba4-9781-9523c8221101-kube-api-access-r2sp5\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.327435 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.327394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8da8947-d2ff-4ba4-9781-9523c8221101-maas-api-tls\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.327638 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.327470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8da8947-d2ff-4ba4-9781-9523c8221101-openshift-service-ca\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.327638 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.327536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2sp5\" (UniqueName: \"kubernetes.io/projected/d8da8947-d2ff-4ba4-9781-9523c8221101-kube-api-access-r2sp5\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.328129 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.328109    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8da8947-d2ff-4ba4-9781-9523c8221101-openshift-service-ca\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.330098 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.330081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8da8947-d2ff-4ba4-9781-9523c8221101-maas-api-tls\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.335628 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.335610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2sp5\" (UniqueName: \"kubernetes.io/projected/d8da8947-d2ff-4ba4-9781-9523c8221101-kube-api-access-r2sp5\") pod \"maas-api-5bc7cbfc95-xcjmv\" (UID: \"d8da8947-d2ff-4ba4-9781-9523c8221101\") " pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.442964 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.442884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:29.586838 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:29.586788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"]
Jul 24 13:58:29.588982 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:58:29.588952    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8da8947_d2ff_4ba4_9781_9523c8221101.slice/crio-28b9b41065b2cf39dbb31386a2a1d1a0b5c054489b1c16a0f0146f617fad6201 WatchSource:0}: Error finding container 28b9b41065b2cf39dbb31386a2a1d1a0b5c054489b1c16a0f0146f617fad6201: Status 404 returned error can't find the container with id 28b9b41065b2cf39dbb31386a2a1d1a0b5c054489b1c16a0f0146f617fad6201
Jul 24 13:58:30.256626 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:30.256587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv" event={"ID":"d8da8947-d2ff-4ba4-9781-9523c8221101","Type":"ContainerStarted","Data":"28b9b41065b2cf39dbb31386a2a1d1a0b5c054489b1c16a0f0146f617fad6201"}
Jul 24 13:58:31.263415 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:31.263376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv" event={"ID":"d8da8947-d2ff-4ba4-9781-9523c8221101","Type":"ContainerStarted","Data":"895dac7f66419be4a912f6f68c57c74bd091d2f2afcc20a22235bdb004ac5476"}
Jul 24 13:58:31.263793 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:31.263517    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:58:31.282748 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:31.282699    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv" podStartSLOduration=0.798541276 podStartE2EDuration="2.282683459s" totalImagesPullingTime="1.484142183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:58:31.281630915 +0000 UTC m=+790.942464074" watchObservedRunningTime="2026-07-24 13:58:31.282683459 +0000 UTC m=+790.943516618"
Jul 24 13:58:37.274334 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:58:37.274302    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5bc7cbfc95-xcjmv"
Jul 24 13:59:05.246797 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.246762    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"]
Jul 24 13:59:05.251757 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.251741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.254969 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.254948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 13:59:05.255094 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.254989    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 13:59:05.255094 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.255061    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 13:59:05.255094 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.255063    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xl92g\""
Jul 24 13:59:05.259504 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.259475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"]
Jul 24 13:59:05.333460 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.333420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkzf\" (UniqueName: \"kubernetes.io/projected/876aef49-b77e-40db-ba3a-dc68af0099a0-kube-api-access-xpkzf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.333639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.333550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.333639 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.333602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.333761 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.333628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876aef49-b77e-40db-ba3a-dc68af0099a0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.333761 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.333686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.333761 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.333724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434428 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkzf\" (UniqueName: \"kubernetes.io/projected/876aef49-b77e-40db-ba3a-dc68af0099a0-kube-api-access-xpkzf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434632 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434632 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434632 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876aef49-b77e-40db-ba3a-dc68af0099a0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434632 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434632 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434973 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.434973 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.434964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.435145 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.435030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.437068 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.437046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876aef49-b77e-40db-ba3a-dc68af0099a0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.437316 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.437299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876aef49-b77e-40db-ba3a-dc68af0099a0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.442853 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.442808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkzf\" (UniqueName: \"kubernetes.io/projected/876aef49-b77e-40db-ba3a-dc68af0099a0-kube-api-access-xpkzf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l25zz\" (UID: \"876aef49-b77e-40db-ba3a-dc68af0099a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.564047 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.563955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:05.699139 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:05.699112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"]
Jul 24 13:59:05.701178 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:59:05.701151    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876aef49_b77e_40db_ba3a_dc68af0099a0.slice/crio-27845d5ea9c259fa7a66bbce35ff34b33c0661494e788826800d218fd58efa11 WatchSource:0}: Error finding container 27845d5ea9c259fa7a66bbce35ff34b33c0661494e788826800d218fd58efa11: Status 404 returned error can't find the container with id 27845d5ea9c259fa7a66bbce35ff34b33c0661494e788826800d218fd58efa11
Jul 24 13:59:06.446440 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:06.446403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz" event={"ID":"876aef49-b77e-40db-ba3a-dc68af0099a0","Type":"ContainerStarted","Data":"27845d5ea9c259fa7a66bbce35ff34b33c0661494e788826800d218fd58efa11"}
Jul 24 13:59:07.453025 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:07.452993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz" event={"ID":"876aef49-b77e-40db-ba3a-dc68af0099a0","Type":"ContainerStarted","Data":"726b322d452e1f84818efe1dfc26500b8a0e70e3884c66e11ee9533904743661"}
Jul 24 13:59:07.470996 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:07.470941    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz" podStartSLOduration=1.4769747149999999 podStartE2EDuration="2.470926794s" totalImagesPullingTime="993.952079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:59:07.469921608 +0000 UTC m=+827.130754768" watchObservedRunningTime="2026-07-24 13:59:07.470926794 +0000 UTC m=+827.131759952"
Jul 24 13:59:15.565117 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:15.565066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:15.565117 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:15.565135    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:15.577522 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:15.577496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:16.507684 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:16.507655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l25zz"
Jul 24 13:59:35.538834 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.538777    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"]
Jul 24 13:59:35.542306 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.542289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.544780 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.544757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 13:59:35.549117 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.549093    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"]
Jul 24 13:59:35.697796 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.697762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.697988 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.697806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.697988 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.697899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq8mg\" (UniqueName: \"kubernetes.io/projected/6cd7baf4-8bea-47be-8d60-22ee87156188-kube-api-access-pq8mg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.697988 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.697953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.698102 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.697999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd7baf4-8bea-47be-8d60-22ee87156188-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.698102 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.698016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.798878 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.798759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.798878 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.798871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.799098 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.798907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq8mg\" (UniqueName: \"kubernetes.io/projected/6cd7baf4-8bea-47be-8d60-22ee87156188-kube-api-access-pq8mg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.799098 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.799049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.799237 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.799152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd7baf4-8bea-47be-8d60-22ee87156188-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.799237 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.799188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.799343 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.799270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.799551 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.799526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.799644 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.799553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.801156 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.801140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd7baf4-8bea-47be-8d60-22ee87156188-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.801654 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.801635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd7baf4-8bea-47be-8d60-22ee87156188-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.807637 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.807612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq8mg\" (UniqueName: \"kubernetes.io/projected/6cd7baf4-8bea-47be-8d60-22ee87156188-kube-api-access-pq8mg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5\" (UID: \"6cd7baf4-8bea-47be-8d60-22ee87156188\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.853882 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.853857    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:35.989028 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:35.988934    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"]
Jul 24 13:59:35.991448 ip-10-0-131-103 kubenswrapper[2563]: W0724 13:59:35.991419    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd7baf4_8bea_47be_8d60_22ee87156188.slice/crio-b60abbffa0ca84fcb1410c8abed0bda89bdb79430c8dba7f56c71a33eee91efd WatchSource:0}: Error finding container b60abbffa0ca84fcb1410c8abed0bda89bdb79430c8dba7f56c71a33eee91efd: Status 404 returned error can't find the container with id b60abbffa0ca84fcb1410c8abed0bda89bdb79430c8dba7f56c71a33eee91efd
Jul 24 13:59:36.606078 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:36.606042    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5" event={"ID":"6cd7baf4-8bea-47be-8d60-22ee87156188","Type":"ContainerStarted","Data":"13986ebb611db7afccf5996a66108979cdf6ce1d47215c3489ede9f97663a7b4"}
Jul 24 13:59:36.606469 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:36.606094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5" event={"ID":"6cd7baf4-8bea-47be-8d60-22ee87156188","Type":"ContainerStarted","Data":"b60abbffa0ca84fcb1410c8abed0bda89bdb79430c8dba7f56c71a33eee91efd"}
Jul 24 13:59:36.625729 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:36.625678    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5" podStartSLOduration=1.402556974 podStartE2EDuration="1.625662452s" totalImagesPullingTime="223.105478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:59:36.624550803 +0000 UTC m=+856.285383965" watchObservedRunningTime="2026-07-24 13:59:36.625662452 +0000 UTC m=+856.286495611"
Jul 24 13:59:45.854292 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:45.854254    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:45.854687 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:45.854331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:45.866902 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:45.866874    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 13:59:46.669196 ip-10-0-131-103 kubenswrapper[2563]: I0724 13:59:46.669167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5"
Jul 24 14:00:00.142323 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:00.142290    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj"]
Jul 24 14:00:00.146136 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:00.146114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj"
Jul 24 14:00:00.148277 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:00.148252    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:00:00.152597 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:00.152563    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj"]
Jul 24 14:00:00.158608 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:00.158591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj"
Jul 24 14:00:00.300525 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:00.300490    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj"]
Jul 24 14:00:00.303829 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:00:00.303775    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32251318_3895_463b_9616_4b991c27b8ef.slice/crio-18255039f3f6b5230e2355ee64e32fd9b24a6be12988f106a948cd6c08f74193 WatchSource:0}: Error finding container 18255039f3f6b5230e2355ee64e32fd9b24a6be12988f106a948cd6c08f74193: Status 404 returned error can't find the container with id 18255039f3f6b5230e2355ee64e32fd9b24a6be12988f106a948cd6c08f74193
Jul 24 14:00:00.729155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:00.729119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj" event={"ID":"32251318-3895-463b-9616-4b991c27b8ef","Type":"ContainerStarted","Data":"18255039f3f6b5230e2355ee64e32fd9b24a6be12988f106a948cd6c08f74193"}
Jul 24 14:00:03.748069 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:03.747978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj" event={"ID":"32251318-3895-463b-9616-4b991c27b8ef","Type":"ContainerStarted","Data":"8db044ed7db9ac8ce49df812e24d1f56fb40026a384c2ec3d4c89d50a4d3503e"}
Jul 24 14:00:03.763666 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:03.763617    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj" podStartSLOduration=0.825442091 podStartE2EDuration="3.763602833s" totalImagesPullingTime="2.938160742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:00:03.762731766 +0000 UTC m=+883.423564925" watchObservedRunningTime="2026-07-24 14:00:03.763602833 +0000 UTC m=+883.424436020"
Jul 24 14:00:04.754633 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:04.754597    2563 generic.go:356] "Generic (PLEG): container finished" podID="32251318-3895-463b-9616-4b991c27b8ef" containerID="8db044ed7db9ac8ce49df812e24d1f56fb40026a384c2ec3d4c89d50a4d3503e" exitCode=0
Jul 24 14:00:04.755016 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:04.754685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj" event={"ID":"32251318-3895-463b-9616-4b991c27b8ef","Type":"ContainerDied","Data":"8db044ed7db9ac8ce49df812e24d1f56fb40026a384c2ec3d4c89d50a4d3503e"}
Jul 24 14:00:05.893368 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:05.893341    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj"
Jul 24 14:00:06.766261 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:06.766236    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj"
Jul 24 14:00:06.766513 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:06.766231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748360-t84zj" event={"ID":"32251318-3895-463b-9616-4b991c27b8ef","Type":"ContainerDied","Data":"18255039f3f6b5230e2355ee64e32fd9b24a6be12988f106a948cd6c08f74193"}
Jul 24 14:00:06.766513 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:00:06.766382    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18255039f3f6b5230e2355ee64e32fd9b24a6be12988f106a948cd6c08f74193"
Jul 24 14:01:40.820419 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:40.820377    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-ljskf"]
Jul 24 14:01:40.821057 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:40.820658    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5588d9cbf8-ljskf" podUID="ef5eb59c-f53f-41f0-87f0-3c8706a4223f" containerName="manager" containerID="cri-o://57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4" gracePeriod=30
Jul 24 14:01:41.076881 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.076800    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 14:01:41.120014 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.119986    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfw6r\" (UniqueName: \"kubernetes.io/projected/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-kube-api-access-mfw6r\") pod \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") "
Jul 24 14:01:41.120187 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.120103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-webhook-cert\") pod \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\" (UID: \"ef5eb59c-f53f-41f0-87f0-3c8706a4223f\") "
Jul 24 14:01:41.122325 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.122297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ef5eb59c-f53f-41f0-87f0-3c8706a4223f" (UID: "ef5eb59c-f53f-41f0-87f0-3c8706a4223f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:01:41.122438 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.122353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-kube-api-access-mfw6r" (OuterVolumeSpecName: "kube-api-access-mfw6r") pod "ef5eb59c-f53f-41f0-87f0-3c8706a4223f" (UID: "ef5eb59c-f53f-41f0-87f0-3c8706a4223f"). InnerVolumeSpecName "kube-api-access-mfw6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:01:41.221675 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.221641    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfw6r\" (UniqueName: \"kubernetes.io/projected/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-kube-api-access-mfw6r\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:01:41.221675 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.221671    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5eb59c-f53f-41f0-87f0-3c8706a4223f-webhook-cert\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:01:41.272459 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.272431    2563 generic.go:356] "Generic (PLEG): container finished" podID="ef5eb59c-f53f-41f0-87f0-3c8706a4223f" containerID="57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4" exitCode=0
Jul 24 14:01:41.272596 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.272477    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-ljskf"
Jul 24 14:01:41.272596 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.272535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-ljskf" event={"ID":"ef5eb59c-f53f-41f0-87f0-3c8706a4223f","Type":"ContainerDied","Data":"57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4"}
Jul 24 14:01:41.272720 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.272626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-ljskf" event={"ID":"ef5eb59c-f53f-41f0-87f0-3c8706a4223f","Type":"ContainerDied","Data":"ea0acc0a9ed4e0a8eaa0ce65cf3c3777f9187c07e9c7757351b1fac9bfbde8be"}
Jul 24 14:01:41.272720 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.272661    2563 scope.go:117] "RemoveContainer" containerID="57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4"
Jul 24 14:01:41.282176 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.282161    2563 scope.go:117] "RemoveContainer" containerID="57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4"
Jul 24 14:01:41.282404 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:01:41.282388    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4\": container with ID starting with 57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4 not found: ID does not exist" containerID="57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4"
Jul 24 14:01:41.282463 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.282414    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4"} err="failed to get container status \"57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4\": rpc error: code = NotFound desc = could not find container \"57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4\": container with ID starting with 57c0c0b654e6981e6509efca9e28f61dd450cdb4ec873f454776ade78923efa4 not found: ID does not exist"
Jul 24 14:01:41.295292 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.295270    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-ljskf"]
Jul 24 14:01:41.301767 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:41.301745    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-ljskf"]
Jul 24 14:01:42.865153 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:01:42.865112    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef5eb59c-f53f-41f0-87f0-3c8706a4223f" path="/var/lib/kubelet/pods/ef5eb59c-f53f-41f0-87f0-3c8706a4223f/volumes"
Jul 24 14:02:42.146599 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.146563    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-zpkzt"]
Jul 24 14:02:42.147060 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.146937    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5eb59c-f53f-41f0-87f0-3c8706a4223f" containerName="manager"
Jul 24 14:02:42.147060 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.146948    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5eb59c-f53f-41f0-87f0-3c8706a4223f" containerName="manager"
Jul 24 14:02:42.147060 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.146958    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32251318-3895-463b-9616-4b991c27b8ef" containerName="cleanup"
Jul 24 14:02:42.147060 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.146965    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="32251318-3895-463b-9616-4b991c27b8ef" containerName="cleanup"
Jul 24 14:02:42.147060 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.147047    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="32251318-3895-463b-9616-4b991c27b8ef" containerName="cleanup"
Jul 24 14:02:42.147060 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.147057    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef5eb59c-f53f-41f0-87f0-3c8706a4223f" containerName="manager"
Jul 24 14:02:42.149172 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.149152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.151906 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.151879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:02:42.152709 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.152677    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:02:42.152854 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.152682    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jjwlm\""
Jul 24 14:02:42.162326 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.162301    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-zpkzt"]
Jul 24 14:02:42.253752 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.253710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25e791d7-e143-4dbe-bcb1-c1d4406351a5-webhook-cert\") pod \"maas-controller-5588d9cbf8-zpkzt\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") " pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.253752 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.253750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwg9x\" (UniqueName: \"kubernetes.io/projected/25e791d7-e143-4dbe-bcb1-c1d4406351a5-kube-api-access-kwg9x\") pod \"maas-controller-5588d9cbf8-zpkzt\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") " pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.354730 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.354696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25e791d7-e143-4dbe-bcb1-c1d4406351a5-webhook-cert\") pod \"maas-controller-5588d9cbf8-zpkzt\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") " pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.354730 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.354731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwg9x\" (UniqueName: \"kubernetes.io/projected/25e791d7-e143-4dbe-bcb1-c1d4406351a5-kube-api-access-kwg9x\") pod \"maas-controller-5588d9cbf8-zpkzt\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") " pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.357290 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.357262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25e791d7-e143-4dbe-bcb1-c1d4406351a5-webhook-cert\") pod \"maas-controller-5588d9cbf8-zpkzt\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") " pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.363050 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.363027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwg9x\" (UniqueName: \"kubernetes.io/projected/25e791d7-e143-4dbe-bcb1-c1d4406351a5-kube-api-access-kwg9x\") pod \"maas-controller-5588d9cbf8-zpkzt\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") " pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.460372 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.460299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:42.595662 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.595639    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-zpkzt"]
Jul 24 14:02:42.597528 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:02:42.597504    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e791d7_e143_4dbe_bcb1_c1d4406351a5.slice/crio-7897a7eac0da86c12d545306abb21e67a7e8d1e8aa29f0433a224525af22b0e9 WatchSource:0}: Error finding container 7897a7eac0da86c12d545306abb21e67a7e8d1e8aa29f0433a224525af22b0e9: Status 404 returned error can't find the container with id 7897a7eac0da86c12d545306abb21e67a7e8d1e8aa29f0433a224525af22b0e9
Jul 24 14:02:42.598760 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:42.598742    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:02:43.590977 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:43.590937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt" event={"ID":"25e791d7-e143-4dbe-bcb1-c1d4406351a5","Type":"ContainerStarted","Data":"736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240"}
Jul 24 14:02:43.591405 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:43.590996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt" event={"ID":"25e791d7-e143-4dbe-bcb1-c1d4406351a5","Type":"ContainerStarted","Data":"7897a7eac0da86c12d545306abb21e67a7e8d1e8aa29f0433a224525af22b0e9"}
Jul 24 14:02:43.591405 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:43.591041    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:43.608008 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:43.607962    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt" podStartSLOduration=1.052798464 podStartE2EDuration="1.607945984s" totalImagesPullingTime="555.14752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:02:43.606879807 +0000 UTC m=+1043.267712966" watchObservedRunningTime="2026-07-24 14:02:43.607945984 +0000 UTC m=+1043.268779143"
Jul 24 14:02:54.598137 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:54.598106    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:59.256367 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.256332    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-zpkzt"]
Jul 24 14:02:59.256878 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.256531    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt" podUID="25e791d7-e143-4dbe-bcb1-c1d4406351a5" containerName="manager" containerID="cri-o://736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240" gracePeriod=30
Jul 24 14:02:59.505872 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.505847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:59.514308 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.514256    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwg9x\" (UniqueName: \"kubernetes.io/projected/25e791d7-e143-4dbe-bcb1-c1d4406351a5-kube-api-access-kwg9x\") pod \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") "
Jul 24 14:02:59.514392 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.514366    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25e791d7-e143-4dbe-bcb1-c1d4406351a5-webhook-cert\") pod \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\" (UID: \"25e791d7-e143-4dbe-bcb1-c1d4406351a5\") "
Jul 24 14:02:59.516425 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.516385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e791d7-e143-4dbe-bcb1-c1d4406351a5-kube-api-access-kwg9x" (OuterVolumeSpecName: "kube-api-access-kwg9x") pod "25e791d7-e143-4dbe-bcb1-c1d4406351a5" (UID: "25e791d7-e143-4dbe-bcb1-c1d4406351a5"). InnerVolumeSpecName "kube-api-access-kwg9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:02:59.516425 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.516398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25e791d7-e143-4dbe-bcb1-c1d4406351a5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "25e791d7-e143-4dbe-bcb1-c1d4406351a5" (UID: "25e791d7-e143-4dbe-bcb1-c1d4406351a5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:02:59.615129 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.615090    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwg9x\" (UniqueName: \"kubernetes.io/projected/25e791d7-e143-4dbe-bcb1-c1d4406351a5-kube-api-access-kwg9x\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:02:59.615129 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.615120    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25e791d7-e143-4dbe-bcb1-c1d4406351a5-webhook-cert\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:02:59.676185 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.676149    2563 generic.go:356] "Generic (PLEG): container finished" podID="25e791d7-e143-4dbe-bcb1-c1d4406351a5" containerID="736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240" exitCode=0
Jul 24 14:02:59.676361 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.676195    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt"
Jul 24 14:02:59.676361 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.676228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt" event={"ID":"25e791d7-e143-4dbe-bcb1-c1d4406351a5","Type":"ContainerDied","Data":"736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240"}
Jul 24 14:02:59.676361 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.676274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-zpkzt" event={"ID":"25e791d7-e143-4dbe-bcb1-c1d4406351a5","Type":"ContainerDied","Data":"7897a7eac0da86c12d545306abb21e67a7e8d1e8aa29f0433a224525af22b0e9"}
Jul 24 14:02:59.676361 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.676299    2563 scope.go:117] "RemoveContainer" containerID="736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240"
Jul 24 14:02:59.686190 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.686170    2563 scope.go:117] "RemoveContainer" containerID="736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240"
Jul 24 14:02:59.686447 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:02:59.686429    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240\": container with ID starting with 736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240 not found: ID does not exist" containerID="736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240"
Jul 24 14:02:59.686487 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.686457    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240"} err="failed to get container status \"736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240\": rpc error: code = NotFound desc = could not find container \"736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240\": container with ID starting with 736ca98ab5245b802cceed99c250e99489a80b629b60fd7461bea35add205240 not found: ID does not exist"
Jul 24 14:02:59.697878 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.697852    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-zpkzt"]
Jul 24 14:02:59.702053 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:02:59.702029    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-zpkzt"]
Jul 24 14:03:00.529392 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.529356    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-cg582"]
Jul 24 14:03:00.529751 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.529715    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e791d7-e143-4dbe-bcb1-c1d4406351a5" containerName="manager"
Jul 24 14:03:00.529751 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.529725    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e791d7-e143-4dbe-bcb1-c1d4406351a5" containerName="manager"
Jul 24 14:03:00.529897 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.529781    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e791d7-e143-4dbe-bcb1-c1d4406351a5" containerName="manager"
Jul 24 14:03:00.532641 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.532622    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.535117 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.535100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:03:00.536181 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.536164    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:03:00.536271 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.536251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jjwlm\""
Jul 24 14:03:00.542143 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.542123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-cg582"]
Jul 24 14:03:00.623361 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.623325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14a0a40b-8c2b-435a-a88f-a5dc8aeb0749-webhook-cert\") pod \"maas-controller-5588d9cbf8-cg582\" (UID: \"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749\") " pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.623527 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.623368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwt2c\" (UniqueName: \"kubernetes.io/projected/14a0a40b-8c2b-435a-a88f-a5dc8aeb0749-kube-api-access-kwt2c\") pod \"maas-controller-5588d9cbf8-cg582\" (UID: \"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749\") " pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.724063 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.724023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14a0a40b-8c2b-435a-a88f-a5dc8aeb0749-webhook-cert\") pod \"maas-controller-5588d9cbf8-cg582\" (UID: \"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749\") " pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.724063 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.724061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwt2c\" (UniqueName: \"kubernetes.io/projected/14a0a40b-8c2b-435a-a88f-a5dc8aeb0749-kube-api-access-kwt2c\") pod \"maas-controller-5588d9cbf8-cg582\" (UID: \"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749\") " pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.726705 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.726681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14a0a40b-8c2b-435a-a88f-a5dc8aeb0749-webhook-cert\") pod \"maas-controller-5588d9cbf8-cg582\" (UID: \"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749\") " pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.733240 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.733217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwt2c\" (UniqueName: \"kubernetes.io/projected/14a0a40b-8c2b-435a-a88f-a5dc8aeb0749-kube-api-access-kwt2c\") pod \"maas-controller-5588d9cbf8-cg582\" (UID: \"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749\") " pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.843745 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.843659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:00.865250 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.865224    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e791d7-e143-4dbe-bcb1-c1d4406351a5" path="/var/lib/kubelet/pods/25e791d7-e143-4dbe-bcb1-c1d4406351a5/volumes"
Jul 24 14:03:00.976620 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:00.976597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5588d9cbf8-cg582"]
Jul 24 14:03:00.978623 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:03:00.978599    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a0a40b_8c2b_435a_a88f_a5dc8aeb0749.slice/crio-5f063c4f426619b913f7cfb0466a080b7b4fd2e7b68975553fdfd7eb67a68ca4 WatchSource:0}: Error finding container 5f063c4f426619b913f7cfb0466a080b7b4fd2e7b68975553fdfd7eb67a68ca4: Status 404 returned error can't find the container with id 5f063c4f426619b913f7cfb0466a080b7b4fd2e7b68975553fdfd7eb67a68ca4
Jul 24 14:03:01.689537 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:01.689447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-cg582" event={"ID":"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749","Type":"ContainerStarted","Data":"de7ad97fb7768edd1de682511506d287470ada1ef546fde047f13b7c2fc0eb45"}
Jul 24 14:03:01.689537 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:01.689532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5588d9cbf8-cg582" event={"ID":"14a0a40b-8c2b-435a-a88f-a5dc8aeb0749","Type":"ContainerStarted","Data":"5f063c4f426619b913f7cfb0466a080b7b4fd2e7b68975553fdfd7eb67a68ca4"}
Jul 24 14:03:01.689977 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:01.689555    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:03:01.707028 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:01.706977    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5588d9cbf8-cg582" podStartSLOduration=1.250257863 podStartE2EDuration="1.706960646s" totalImagesPullingTime="456.702783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:03:01.705769145 +0000 UTC m=+1061.366602304" watchObservedRunningTime="2026-07-24 14:03:01.706960646 +0000 UTC m=+1061.367793806"
Jul 24 14:03:12.698099 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:03:12.698016    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5588d9cbf8-cg582"
Jul 24 14:15:00.136546 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:00.136501    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np"]
Jul 24 14:15:00.139998 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:00.139983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np"
Jul 24 14:15:00.142431 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:00.142411    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:15:00.151959 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:00.151938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np"
Jul 24 14:15:00.152543 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:00.152521    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np"]
Jul 24 14:15:00.498780 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:00.498756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np"]
Jul 24 14:15:00.501047 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:15:00.501023    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65258123_7b89_4613_9a54_8a7cf1d2480b.slice/crio-e791d341f0531a09d84446f878564fb22f7d5af7989f39c4b244c160597500b3 WatchSource:0}: Error finding container e791d341f0531a09d84446f878564fb22f7d5af7989f39c4b244c160597500b3: Status 404 returned error can't find the container with id e791d341f0531a09d84446f878564fb22f7d5af7989f39c4b244c160597500b3
Jul 24 14:15:01.450638 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:01.450603    2563 generic.go:356] "Generic (PLEG): container finished" podID="65258123-7b89-4613-9a54-8a7cf1d2480b" containerID="9d17840a69fb78cb4d03d4d3a5d4174e187ec928f9f70898934cb4e302e03498" exitCode=0
Jul 24 14:15:01.451056 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:01.450680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np" event={"ID":"65258123-7b89-4613-9a54-8a7cf1d2480b","Type":"ContainerDied","Data":"9d17840a69fb78cb4d03d4d3a5d4174e187ec928f9f70898934cb4e302e03498"}
Jul 24 14:15:01.451056 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:01.450720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np" event={"ID":"65258123-7b89-4613-9a54-8a7cf1d2480b","Type":"ContainerStarted","Data":"e791d341f0531a09d84446f878564fb22f7d5af7989f39c4b244c160597500b3"}
Jul 24 14:15:02.592684 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:02.592652    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np"
Jul 24 14:15:03.463229 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:03.463197    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np"
Jul 24 14:15:03.463423 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:03.463192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748375-hm2np" event={"ID":"65258123-7b89-4613-9a54-8a7cf1d2480b","Type":"ContainerDied","Data":"e791d341f0531a09d84446f878564fb22f7d5af7989f39c4b244c160597500b3"}
Jul 24 14:15:03.463423 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:15:03.463332    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e791d341f0531a09d84446f878564fb22f7d5af7989f39c4b244c160597500b3"
Jul 24 14:16:16.769528 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.769490    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"]
Jul 24 14:16:16.770075 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.770052    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65258123-7b89-4613-9a54-8a7cf1d2480b" containerName="cleanup"
Jul 24 14:16:16.770120 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.770080    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="65258123-7b89-4613-9a54-8a7cf1d2480b" containerName="cleanup"
Jul 24 14:16:16.770178 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.770165    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="65258123-7b89-4613-9a54-8a7cf1d2480b" containerName="cleanup"
Jul 24 14:16:16.773288 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.773272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.776467 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.776447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-600fea54-serving-cert\""
Jul 24 14:16:16.785585 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.785555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"]
Jul 24 14:16:16.876262 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.876228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.876445 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.876290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34b1e00f-6169-48c0-8d2e-873dc7215679-openshift-service-ca\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.876445 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.876353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbvgp\" (UniqueName: \"kubernetes.io/projected/34b1e00f-6169-48c0-8d2e-873dc7215679-kube-api-access-cbvgp\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.977399 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.977358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbvgp\" (UniqueName: \"kubernetes.io/projected/34b1e00f-6169-48c0-8d2e-873dc7215679-kube-api-access-cbvgp\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.977597 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.977426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.977597 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.977488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34b1e00f-6169-48c0-8d2e-873dc7215679-openshift-service-ca\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.977597 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:16:16.977567    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-serving-cert: secret "maas-api-e2e-ait-600fea54-serving-cert" not found
Jul 24 14:16:16.977790 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:16:16.977627    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls podName:34b1e00f-6169-48c0-8d2e-873dc7215679 nodeName:}" failed. No retries permitted until 2026-07-24 14:16:17.4776116 +0000 UTC m=+1857.138444737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls") pod "maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg" (UID: "34b1e00f-6169-48c0-8d2e-873dc7215679") : secret "maas-api-e2e-ait-600fea54-serving-cert" not found
Jul 24 14:16:16.978204 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.978181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34b1e00f-6169-48c0-8d2e-873dc7215679-openshift-service-ca\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:16.990050 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:16.990023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbvgp\" (UniqueName: \"kubernetes.io/projected/34b1e00f-6169-48c0-8d2e-873dc7215679-kube-api-access-cbvgp\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:17.482759 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:17.482728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:17.485623 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:17.485598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls\") pod \"maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:17.684061 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:17.684023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:17.826597 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:17.826563    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"]
Jul 24 14:16:17.827649 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:16:17.827613    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b1e00f_6169_48c0_8d2e_873dc7215679.slice/crio-34ebabf3796d120124a795506d0e520490f84a15480bf86bedc130aabe2ac6d9 WatchSource:0}: Error finding container 34ebabf3796d120124a795506d0e520490f84a15480bf86bedc130aabe2ac6d9: Status 404 returned error can't find the container with id 34ebabf3796d120124a795506d0e520490f84a15480bf86bedc130aabe2ac6d9
Jul 24 14:16:17.829124 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:17.829106    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:16:17.858414 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:17.858376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg" event={"ID":"34b1e00f-6169-48c0-8d2e-873dc7215679","Type":"ContainerStarted","Data":"34ebabf3796d120124a795506d0e520490f84a15480bf86bedc130aabe2ac6d9"}
Jul 24 14:16:18.865462 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:18.865420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg" event={"ID":"34b1e00f-6169-48c0-8d2e-873dc7215679","Type":"ContainerStarted","Data":"4d4fa10c6ba38b1be6cd43bff1e1729b529d3dbd0f65a1a33e4255e4f49e4d9a"}
Jul 24 14:16:18.865942 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:18.865538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:18.883100 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:18.883050    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg" podStartSLOduration=2.280020262 podStartE2EDuration="2.883034755s" totalImagesPullingTime="603.014493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:16:18.882546812 +0000 UTC m=+1858.543379972" watchObservedRunningTime="2026-07-24 14:16:18.883034755 +0000 UTC m=+1858.543867917"
Jul 24 14:16:24.882238 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:24.882204    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:52.818512 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:52.818426    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"]
Jul 24 14:16:52.819083 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:52.818624    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg" podUID="34b1e00f-6169-48c0-8d2e-873dc7215679" containerName="maas-api" containerID="cri-o://4d4fa10c6ba38b1be6cd43bff1e1729b529d3dbd0f65a1a33e4255e4f49e4d9a" gracePeriod=30
Jul 24 14:16:53.052233 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.052194    2563 generic.go:356] "Generic (PLEG): container finished" podID="34b1e00f-6169-48c0-8d2e-873dc7215679" containerID="4d4fa10c6ba38b1be6cd43bff1e1729b529d3dbd0f65a1a33e4255e4f49e4d9a" exitCode=0
Jul 24 14:16:53.052382 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.052274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg" event={"ID":"34b1e00f-6169-48c0-8d2e-873dc7215679","Type":"ContainerDied","Data":"4d4fa10c6ba38b1be6cd43bff1e1729b529d3dbd0f65a1a33e4255e4f49e4d9a"}
Jul 24 14:16:53.076049 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.075987    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:53.197494 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.197466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbvgp\" (UniqueName: \"kubernetes.io/projected/34b1e00f-6169-48c0-8d2e-873dc7215679-kube-api-access-cbvgp\") pod \"34b1e00f-6169-48c0-8d2e-873dc7215679\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") "
Jul 24 14:16:53.197723 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.197506    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34b1e00f-6169-48c0-8d2e-873dc7215679-openshift-service-ca\") pod \"34b1e00f-6169-48c0-8d2e-873dc7215679\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") "
Jul 24 14:16:53.197723 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.197538    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls\") pod \"34b1e00f-6169-48c0-8d2e-873dc7215679\" (UID: \"34b1e00f-6169-48c0-8d2e-873dc7215679\") "
Jul 24 14:16:53.197936 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.197909    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34b1e00f-6169-48c0-8d2e-873dc7215679-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34b1e00f-6169-48c0-8d2e-873dc7215679" (UID: "34b1e00f-6169-48c0-8d2e-873dc7215679"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:16:53.199996 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.199969    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34b1e00f-6169-48c0-8d2e-873dc7215679" (UID: "34b1e00f-6169-48c0-8d2e-873dc7215679"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:16:53.199996 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.199976    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34b1e00f-6169-48c0-8d2e-873dc7215679-kube-api-access-cbvgp" (OuterVolumeSpecName: "kube-api-access-cbvgp") pod "34b1e00f-6169-48c0-8d2e-873dc7215679" (UID: "34b1e00f-6169-48c0-8d2e-873dc7215679"). InnerVolumeSpecName "kube-api-access-cbvgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:16:53.299268 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.299237    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbvgp\" (UniqueName: \"kubernetes.io/projected/34b1e00f-6169-48c0-8d2e-873dc7215679-kube-api-access-cbvgp\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:16:53.299268 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.299263    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34b1e00f-6169-48c0-8d2e-873dc7215679-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:16:53.299268 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:53.299273    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34b1e00f-6169-48c0-8d2e-873dc7215679-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:16:54.058504 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:54.058473    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"
Jul 24 14:16:54.058978 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:54.058506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg" event={"ID":"34b1e00f-6169-48c0-8d2e-873dc7215679","Type":"ContainerDied","Data":"34ebabf3796d120124a795506d0e520490f84a15480bf86bedc130aabe2ac6d9"}
Jul 24 14:16:54.058978 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:54.058567    2563 scope.go:117] "RemoveContainer" containerID="4d4fa10c6ba38b1be6cd43bff1e1729b529d3dbd0f65a1a33e4255e4f49e4d9a"
Jul 24 14:16:54.082064 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:54.082035    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"]
Jul 24 14:16:54.084191 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:54.084169    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-600fea54-5755b6fd5f-l6hjg"]
Jul 24 14:16:54.864037 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:16:54.864002    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34b1e00f-6169-48c0-8d2e-873dc7215679" path="/var/lib/kubelet/pods/34b1e00f-6169-48c0-8d2e-873dc7215679/volumes"
Jul 24 14:17:00.941959 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:00.941916    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"]
Jul 24 14:17:00.942529 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:00.942507    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b1e00f-6169-48c0-8d2e-873dc7215679" containerName="maas-api"
Jul 24 14:17:00.942611 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:00.942533    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b1e00f-6169-48c0-8d2e-873dc7215679" containerName="maas-api"
Jul 24 14:17:00.942667 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:00.942649    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b1e00f-6169-48c0-8d2e-873dc7215679" containerName="maas-api"
Jul 24 14:17:00.947307 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:00.947286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:00.950668 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:00.950650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a7e2221a-serving-cert\""
Jul 24 14:17:00.960392 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:00.960364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"]
Jul 24 14:17:01.072028 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.071991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d37798bc-7410-4680-942b-ea54923088e4-maas-api-tls\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.072215 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.072048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d37798bc-7410-4680-942b-ea54923088e4-openshift-service-ca\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.072215 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.072108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxfm5\" (UniqueName: \"kubernetes.io/projected/d37798bc-7410-4680-942b-ea54923088e4-kube-api-access-xxfm5\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.172955 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.172910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d37798bc-7410-4680-942b-ea54923088e4-maas-api-tls\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.173148 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.172981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d37798bc-7410-4680-942b-ea54923088e4-openshift-service-ca\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.173148 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.173008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxfm5\" (UniqueName: \"kubernetes.io/projected/d37798bc-7410-4680-942b-ea54923088e4-kube-api-access-xxfm5\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.173691 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.173666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d37798bc-7410-4680-942b-ea54923088e4-openshift-service-ca\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.175412 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.175393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d37798bc-7410-4680-942b-ea54923088e4-maas-api-tls\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.182104 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.182078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxfm5\" (UniqueName: \"kubernetes.io/projected/d37798bc-7410-4680-942b-ea54923088e4-kube-api-access-xxfm5\") pod \"maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.258061 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.258025    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:01.408173 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:01.408136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"]
Jul 24 14:17:01.411294 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:17:01.411262    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37798bc_7410_4680_942b_ea54923088e4.slice/crio-1af1608b161202240545b5790cf72b2cb0bb559fb60e3b2903ddda19fd98b7bc WatchSource:0}: Error finding container 1af1608b161202240545b5790cf72b2cb0bb559fb60e3b2903ddda19fd98b7bc: Status 404 returned error can't find the container with id 1af1608b161202240545b5790cf72b2cb0bb559fb60e3b2903ddda19fd98b7bc
Jul 24 14:17:02.102867 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:02.102808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b" event={"ID":"d37798bc-7410-4680-942b-ea54923088e4","Type":"ContainerStarted","Data":"1af1608b161202240545b5790cf72b2cb0bb559fb60e3b2903ddda19fd98b7bc"}
Jul 24 14:17:03.109953 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:03.109918    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b" event={"ID":"d37798bc-7410-4680-942b-ea54923088e4","Type":"ContainerStarted","Data":"c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda"}
Jul 24 14:17:03.110445 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:03.110053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:03.127529 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:03.127459    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b" podStartSLOduration=2.357463818 podStartE2EDuration="3.127438696s" totalImagesPullingTime="769.974878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:17:03.12604999 +0000 UTC m=+1902.786883149" watchObservedRunningTime="2026-07-24 14:17:03.127438696 +0000 UTC m=+1902.788271855"
Jul 24 14:17:09.121088 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:09.121061    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:36.460022 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.459971    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"]
Jul 24 14:17:36.460896 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.460253    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b" podUID="d37798bc-7410-4680-942b-ea54923088e4" containerName="maas-api" containerID="cri-o://c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda" gracePeriod=30
Jul 24 14:17:36.715485 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.715411    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:36.797176 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.797147    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d37798bc-7410-4680-942b-ea54923088e4-maas-api-tls\") pod \"d37798bc-7410-4680-942b-ea54923088e4\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") "
Jul 24 14:17:36.797345 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.797192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d37798bc-7410-4680-942b-ea54923088e4-openshift-service-ca\") pod \"d37798bc-7410-4680-942b-ea54923088e4\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") "
Jul 24 14:17:36.797345 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.797227    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxfm5\" (UniqueName: \"kubernetes.io/projected/d37798bc-7410-4680-942b-ea54923088e4-kube-api-access-xxfm5\") pod \"d37798bc-7410-4680-942b-ea54923088e4\" (UID: \"d37798bc-7410-4680-942b-ea54923088e4\") "
Jul 24 14:17:36.797637 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.797601    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37798bc-7410-4680-942b-ea54923088e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d37798bc-7410-4680-942b-ea54923088e4" (UID: "d37798bc-7410-4680-942b-ea54923088e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:17:36.799561 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.799528    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d37798bc-7410-4680-942b-ea54923088e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d37798bc-7410-4680-942b-ea54923088e4" (UID: "d37798bc-7410-4680-942b-ea54923088e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:17:36.799649 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.799572    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37798bc-7410-4680-942b-ea54923088e4-kube-api-access-xxfm5" (OuterVolumeSpecName: "kube-api-access-xxfm5") pod "d37798bc-7410-4680-942b-ea54923088e4" (UID: "d37798bc-7410-4680-942b-ea54923088e4"). InnerVolumeSpecName "kube-api-access-xxfm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:17:36.898710 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.898682    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxfm5\" (UniqueName: \"kubernetes.io/projected/d37798bc-7410-4680-942b-ea54923088e4-kube-api-access-xxfm5\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:17:36.898710 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.898706    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d37798bc-7410-4680-942b-ea54923088e4-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:17:36.898710 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:36.898715    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d37798bc-7410-4680-942b-ea54923088e4-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:17:37.299184 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.299152    2563 generic.go:356] "Generic (PLEG): container finished" podID="d37798bc-7410-4680-942b-ea54923088e4" containerID="c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda" exitCode=0
Jul 24 14:17:37.299378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.299199    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"
Jul 24 14:17:37.299378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.299221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b" event={"ID":"d37798bc-7410-4680-942b-ea54923088e4","Type":"ContainerDied","Data":"c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda"}
Jul 24 14:17:37.299378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.299275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b" event={"ID":"d37798bc-7410-4680-942b-ea54923088e4","Type":"ContainerDied","Data":"1af1608b161202240545b5790cf72b2cb0bb559fb60e3b2903ddda19fd98b7bc"}
Jul 24 14:17:37.299378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.299304    2563 scope.go:117] "RemoveContainer" containerID="c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda"
Jul 24 14:17:37.308349 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.308330    2563 scope.go:117] "RemoveContainer" containerID="c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda"
Jul 24 14:17:37.308582 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:17:37.308563    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda\": container with ID starting with c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda not found: ID does not exist" containerID="c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda"
Jul 24 14:17:37.308630 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.308591    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda"} err="failed to get container status \"c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda\": rpc error: code = NotFound desc = could not find container \"c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda\": container with ID starting with c241ddbceb511536df1decc57405363955f5ed07429ac800731b1730c31aacda not found: ID does not exist"
Jul 24 14:17:37.317228 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.317192    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"]
Jul 24 14:17:37.319372 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:37.319352    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a7e2221a-dc6f59c5d-xn58b"]
Jul 24 14:17:38.865149 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:38.865113    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37798bc-7410-4680-942b-ea54923088e4" path="/var/lib/kubelet/pods/d37798bc-7410-4680-942b-ea54923088e4/volumes"
Jul 24 14:17:44.024330 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.024289    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"]
Jul 24 14:17:44.024952 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.024911    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37798bc-7410-4680-942b-ea54923088e4" containerName="maas-api"
Jul 24 14:17:44.024952 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.024933    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37798bc-7410-4680-942b-ea54923088e4" containerName="maas-api"
Jul 24 14:17:44.025050 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.025018    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37798bc-7410-4680-942b-ea54923088e4" containerName="maas-api"
Jul 24 14:17:44.028031 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.028016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.030664 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.030645    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1f2fc6f2-serving-cert\""
Jul 24 14:17:44.038176 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.038155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"]
Jul 24 14:17:44.168767 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.168724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e93ec990-5ccd-4671-9851-3aaec7323e10-openshift-service-ca\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.168969 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.168841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e93ec990-5ccd-4671-9851-3aaec7323e10-maas-api-tls\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.168969 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.168885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ghk\" (UniqueName: \"kubernetes.io/projected/e93ec990-5ccd-4671-9851-3aaec7323e10-kube-api-access-j2ghk\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.269498 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.269465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e93ec990-5ccd-4671-9851-3aaec7323e10-openshift-service-ca\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.269680 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.269529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e93ec990-5ccd-4671-9851-3aaec7323e10-maas-api-tls\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.269680 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.269565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ghk\" (UniqueName: \"kubernetes.io/projected/e93ec990-5ccd-4671-9851-3aaec7323e10-kube-api-access-j2ghk\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.270195 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.270168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e93ec990-5ccd-4671-9851-3aaec7323e10-openshift-service-ca\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.272076 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.272054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e93ec990-5ccd-4671-9851-3aaec7323e10-maas-api-tls\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.278516 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.278451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ghk\" (UniqueName: \"kubernetes.io/projected/e93ec990-5ccd-4671-9851-3aaec7323e10-kube-api-access-j2ghk\") pod \"maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.339643 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.339611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:44.498286 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:44.498258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"]
Jul 24 14:17:44.500288 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:17:44.500249    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93ec990_5ccd_4671_9851_3aaec7323e10.slice/crio-930aac56468467399f320bb731c2ea9c857168a70834d199bdc32806d0b98273 WatchSource:0}: Error finding container 930aac56468467399f320bb731c2ea9c857168a70834d199bdc32806d0b98273: Status 404 returned error can't find the container with id 930aac56468467399f320bb731c2ea9c857168a70834d199bdc32806d0b98273
Jul 24 14:17:45.344538 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:45.344512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg" event={"ID":"e93ec990-5ccd-4671-9851-3aaec7323e10","Type":"ContainerStarted","Data":"930aac56468467399f320bb731c2ea9c857168a70834d199bdc32806d0b98273"}
Jul 24 14:17:46.351789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:46.351738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg" event={"ID":"e93ec990-5ccd-4671-9851-3aaec7323e10","Type":"ContainerStarted","Data":"07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1"}
Jul 24 14:17:46.352198 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:46.351842    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:17:46.371252 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:46.371205    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg" podStartSLOduration=1.580720703 podStartE2EDuration="2.371189573s" totalImagesPullingTime="790.46887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:17:46.36977802 +0000 UTC m=+1946.030611180" watchObservedRunningTime="2026-07-24 14:17:46.371189573 +0000 UTC m=+1946.032022775"
Jul 24 14:17:52.363589 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:17:52.363560    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:18:20.280091 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.280013    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"]
Jul 24 14:18:20.280508 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.280221    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg" podUID="e93ec990-5ccd-4671-9851-3aaec7323e10" containerName="maas-api" containerID="cri-o://07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1" gracePeriod=30
Jul 24 14:18:20.536037 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.535971    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:18:20.548639 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.548606    2563 generic.go:356] "Generic (PLEG): container finished" podID="e93ec990-5ccd-4671-9851-3aaec7323e10" containerID="07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1" exitCode=0
Jul 24 14:18:20.548797 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.548656    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"
Jul 24 14:18:20.548797 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.548665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg" event={"ID":"e93ec990-5ccd-4671-9851-3aaec7323e10","Type":"ContainerDied","Data":"07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1"}
Jul 24 14:18:20.548797 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.548747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg" event={"ID":"e93ec990-5ccd-4671-9851-3aaec7323e10","Type":"ContainerDied","Data":"930aac56468467399f320bb731c2ea9c857168a70834d199bdc32806d0b98273"}
Jul 24 14:18:20.548797 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.548779    2563 scope.go:117] "RemoveContainer" containerID="07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1"
Jul 24 14:18:20.559938 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.559909    2563 scope.go:117] "RemoveContainer" containerID="07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1"
Jul 24 14:18:20.560267 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:18:20.560244    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1\": container with ID starting with 07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1 not found: ID does not exist" containerID="07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1"
Jul 24 14:18:20.560344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.560276    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1"} err="failed to get container status \"07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1\": rpc error: code = NotFound desc = could not find container \"07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1\": container with ID starting with 07e68b8c0874f489fc7955e31cf4c6964a3976638e761522b955456071a66ed1 not found: ID does not exist"
Jul 24 14:18:20.562583 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.562557    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e93ec990-5ccd-4671-9851-3aaec7323e10-openshift-service-ca\") pod \"e93ec990-5ccd-4671-9851-3aaec7323e10\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") "
Jul 24 14:18:20.562720 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.562640    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2ghk\" (UniqueName: \"kubernetes.io/projected/e93ec990-5ccd-4671-9851-3aaec7323e10-kube-api-access-j2ghk\") pod \"e93ec990-5ccd-4671-9851-3aaec7323e10\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") "
Jul 24 14:18:20.562908 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.562883    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e93ec990-5ccd-4671-9851-3aaec7323e10-maas-api-tls\") pod \"e93ec990-5ccd-4671-9851-3aaec7323e10\" (UID: \"e93ec990-5ccd-4671-9851-3aaec7323e10\") "
Jul 24 14:18:20.563050 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.563025    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e93ec990-5ccd-4671-9851-3aaec7323e10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e93ec990-5ccd-4671-9851-3aaec7323e10" (UID: "e93ec990-5ccd-4671-9851-3aaec7323e10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:18:20.563240 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.563217    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e93ec990-5ccd-4671-9851-3aaec7323e10-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:18:20.565461 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.565434    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e93ec990-5ccd-4671-9851-3aaec7323e10-kube-api-access-j2ghk" (OuterVolumeSpecName: "kube-api-access-j2ghk") pod "e93ec990-5ccd-4671-9851-3aaec7323e10" (UID: "e93ec990-5ccd-4671-9851-3aaec7323e10"). InnerVolumeSpecName "kube-api-access-j2ghk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:18:20.566414 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.566392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e93ec990-5ccd-4671-9851-3aaec7323e10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e93ec990-5ccd-4671-9851-3aaec7323e10" (UID: "e93ec990-5ccd-4671-9851-3aaec7323e10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:18:20.663811 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.663778    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2ghk\" (UniqueName: \"kubernetes.io/projected/e93ec990-5ccd-4671-9851-3aaec7323e10-kube-api-access-j2ghk\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:18:20.663811 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.663808    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e93ec990-5ccd-4671-9851-3aaec7323e10-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:18:20.874604 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.874574    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"]
Jul 24 14:18:20.879151 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:20.879128    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f2fc6f2-57b8d578db-2wmsg"]
Jul 24 14:18:22.864224 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:22.864187    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e93ec990-5ccd-4671-9851-3aaec7323e10" path="/var/lib/kubelet/pods/e93ec990-5ccd-4671-9851-3aaec7323e10/volumes"
Jul 24 14:18:29.328020 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.327985    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"]
Jul 24 14:18:29.328573 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.328556    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93ec990-5ccd-4671-9851-3aaec7323e10" containerName="maas-api"
Jul 24 14:18:29.328622 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.328576    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93ec990-5ccd-4671-9851-3aaec7323e10" containerName="maas-api"
Jul 24 14:18:29.328690 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.328679    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e93ec990-5ccd-4671-9851-3aaec7323e10" containerName="maas-api"
Jul 24 14:18:29.332364 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.332344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.334780 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.334757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8fc7075e-serving-cert\""
Jul 24 14:18:29.346313 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.346289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"]
Jul 24 14:18:29.443448 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.443404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-maas-api-tls\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.443655 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.443603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2nbl\" (UniqueName: \"kubernetes.io/projected/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-kube-api-access-d2nbl\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.443734 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.443716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-openshift-service-ca\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.544429 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.544399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-openshift-service-ca\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.544643 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.544458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-maas-api-tls\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.544643 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.544494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2nbl\" (UniqueName: \"kubernetes.io/projected/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-kube-api-access-d2nbl\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.545186 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.545125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-openshift-service-ca\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.546995 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.546970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-maas-api-tls\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.552985 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.552959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2nbl\" (UniqueName: \"kubernetes.io/projected/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-kube-api-access-d2nbl\") pod \"maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.642565 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.642475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:29.781317 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:29.781293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"]
Jul 24 14:18:29.783398 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:18:29.783354    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b3ba8a_7ab8_488d_9c40_b26e8129a8d0.slice/crio-df859a1781b8ad06b29d29e99ef2306df4054fd0e047d71b1175af232c0eb5f8 WatchSource:0}: Error finding container df859a1781b8ad06b29d29e99ef2306df4054fd0e047d71b1175af232c0eb5f8: Status 404 returned error can't find the container with id df859a1781b8ad06b29d29e99ef2306df4054fd0e047d71b1175af232c0eb5f8
Jul 24 14:18:30.602521 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:30.602483    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97" event={"ID":"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0","Type":"ContainerStarted","Data":"df859a1781b8ad06b29d29e99ef2306df4054fd0e047d71b1175af232c0eb5f8"}
Jul 24 14:18:31.610500 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:31.610452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97" event={"ID":"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0","Type":"ContainerStarted","Data":"1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca"}
Jul 24 14:18:31.610927 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:31.610551    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:18:31.627306 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:31.627254    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97" podStartSLOduration=1.761136285 podStartE2EDuration="2.627239165s" totalImagesPullingTime="866.10288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:18:31.625918344 +0000 UTC m=+1991.286751503" watchObservedRunningTime="2026-07-24 14:18:31.627239165 +0000 UTC m=+1991.288072326"
Jul 24 14:18:37.621707 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:18:37.621674    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:19:04.533886 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.533851    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"]
Jul 24 14:19:04.534474 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.534123    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97" podUID="02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" containerName="maas-api" containerID="cri-o://1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca" gracePeriod=30
Jul 24 14:19:04.791448 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.791384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:19:04.793898 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.793870    2563 generic.go:356] "Generic (PLEG): container finished" podID="02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" containerID="1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca" exitCode=0
Jul 24 14:19:04.794016 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.793907    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"
Jul 24 14:19:04.794016 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.793951    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97" event={"ID":"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0","Type":"ContainerDied","Data":"1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca"}
Jul 24 14:19:04.794016 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.794006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97" event={"ID":"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0","Type":"ContainerDied","Data":"df859a1781b8ad06b29d29e99ef2306df4054fd0e047d71b1175af232c0eb5f8"}
Jul 24 14:19:04.794141 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.794035    2563 scope.go:117] "RemoveContainer" containerID="1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca"
Jul 24 14:19:04.802699 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.802665    2563 scope.go:117] "RemoveContainer" containerID="1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca"
Jul 24 14:19:04.802971 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:19:04.802953    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca\": container with ID starting with 1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca not found: ID does not exist" containerID="1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca"
Jul 24 14:19:04.803040 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.802983    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca"} err="failed to get container status \"1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca\": rpc error: code = NotFound desc = could not find container \"1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca\": container with ID starting with 1512b257a46e969fb1cee64667d956554aa4ec583307b454256c5088f58990ca not found: ID does not exist"
Jul 24 14:19:04.866036 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.866003    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2nbl\" (UniqueName: \"kubernetes.io/projected/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-kube-api-access-d2nbl\") pod \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") "
Jul 24 14:19:04.866230 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.866082    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-openshift-service-ca\") pod \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") "
Jul 24 14:19:04.866296 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.866245    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-maas-api-tls\") pod \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\" (UID: \"02b3ba8a-7ab8-488d-9c40-b26e8129a8d0\") "
Jul 24 14:19:04.866512 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.866481    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" (UID: "02b3ba8a-7ab8-488d-9c40-b26e8129a8d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:19:04.868465 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.868430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-kube-api-access-d2nbl" (OuterVolumeSpecName: "kube-api-access-d2nbl") pod "02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" (UID: "02b3ba8a-7ab8-488d-9c40-b26e8129a8d0"). InnerVolumeSpecName "kube-api-access-d2nbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:19:04.868715 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.868689    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" (UID: "02b3ba8a-7ab8-488d-9c40-b26e8129a8d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:19:04.967565 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.967532    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:19:04.967565 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.967564    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:19:04.967722 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:04.967575    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2nbl\" (UniqueName: \"kubernetes.io/projected/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0-kube-api-access-d2nbl\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:19:05.112300 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:05.112225    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"]
Jul 24 14:19:05.116750 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:05.116724    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8fc7075e-788f6dd6d6-t5x97"]
Jul 24 14:19:06.864597 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:19:06.864561    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" path="/var/lib/kubelet/pods/02b3ba8a-7ab8-488d-9c40-b26e8129a8d0/volumes"
Jul 24 14:20:50.719686 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.719649    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"]
Jul 24 14:20:50.722290 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.720253    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" containerName="maas-api"
Jul 24 14:20:50.722290 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.720270    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" containerName="maas-api"
Jul 24 14:20:50.722290 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.720344    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="02b3ba8a-7ab8-488d-9c40-b26e8129a8d0" containerName="maas-api"
Jul 24 14:20:50.723190 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.723171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.725832 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.725796    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-89fed8b8-serving-cert\""
Jul 24 14:20:50.736452 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.736427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"]
Jul 24 14:20:50.824262 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.824221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-openshift-service-ca\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.824453 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.824277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-maas-api-tls\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.824453 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.824419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gc6v\" (UniqueName: \"kubernetes.io/projected/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-kube-api-access-7gc6v\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.925098 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.925059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gc6v\" (UniqueName: \"kubernetes.io/projected/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-kube-api-access-7gc6v\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.925270 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.925132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-openshift-service-ca\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.925270 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.925156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-maas-api-tls\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.925954 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.925931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-openshift-service-ca\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.927765 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.927738    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-maas-api-tls\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:50.941810 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:50.941788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gc6v\" (UniqueName: \"kubernetes.io/projected/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-kube-api-access-7gc6v\") pod \"maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:51.034022 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:51.033944    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:51.173415 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:51.173382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"]
Jul 24 14:20:51.175114 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:20:51.175085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545e26c0_4bbc_4bf4_850c_d81ce9a43dad.slice/crio-6c794ccc1c9c871b9d216656a9500bbd75fb30e22d65f5e358987c4d99ca560b WatchSource:0}: Error finding container 6c794ccc1c9c871b9d216656a9500bbd75fb30e22d65f5e358987c4d99ca560b: Status 404 returned error can't find the container with id 6c794ccc1c9c871b9d216656a9500bbd75fb30e22d65f5e358987c4d99ca560b
Jul 24 14:20:51.365274 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:51.365196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2" event={"ID":"545e26c0-4bbc-4bf4-850c-d81ce9a43dad","Type":"ContainerStarted","Data":"6c794ccc1c9c871b9d216656a9500bbd75fb30e22d65f5e358987c4d99ca560b"}
Jul 24 14:20:52.372571 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:52.372537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2" event={"ID":"545e26c0-4bbc-4bf4-850c-d81ce9a43dad","Type":"ContainerStarted","Data":"15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3"}
Jul 24 14:20:52.373024 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:52.372624    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:20:52.389347 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:52.389299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2" podStartSLOduration=1.948554064 podStartE2EDuration="2.389283881s" totalImagesPullingTime="440.729817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:20:52.388018298 +0000 UTC m=+2132.048851479" watchObservedRunningTime="2026-07-24 14:20:52.389283881 +0000 UTC m=+2132.050117039"
Jul 24 14:20:58.383350 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:20:58.383321    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:21:12.802893 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:12.802797    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"]
Jul 24 14:21:12.803284 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:12.803096    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2" podUID="545e26c0-4bbc-4bf4-850c-d81ce9a43dad" containerName="maas-api" containerID="cri-o://15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3" gracePeriod=30
Jul 24 14:21:13.051165 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.051139    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:21:13.130360 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.130270    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gc6v\" (UniqueName: \"kubernetes.io/projected/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-kube-api-access-7gc6v\") pod \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") "
Jul 24 14:21:13.130360 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.130342    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-openshift-service-ca\") pod \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") "
Jul 24 14:21:13.130565 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.130358    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-maas-api-tls\") pod \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\" (UID: \"545e26c0-4bbc-4bf4-850c-d81ce9a43dad\") "
Jul 24 14:21:13.130751 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.130725    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "545e26c0-4bbc-4bf4-850c-d81ce9a43dad" (UID: "545e26c0-4bbc-4bf4-850c-d81ce9a43dad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:21:13.132635 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.132608    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "545e26c0-4bbc-4bf4-850c-d81ce9a43dad" (UID: "545e26c0-4bbc-4bf4-850c-d81ce9a43dad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:21:13.132736 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.132672    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-kube-api-access-7gc6v" (OuterVolumeSpecName: "kube-api-access-7gc6v") pod "545e26c0-4bbc-4bf4-850c-d81ce9a43dad" (UID: "545e26c0-4bbc-4bf4-850c-d81ce9a43dad"). InnerVolumeSpecName "kube-api-access-7gc6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:21:13.231115 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.231065    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:21:13.231115 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.231109    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:21:13.231115 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.231117    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gc6v\" (UniqueName: \"kubernetes.io/projected/545e26c0-4bbc-4bf4-850c-d81ce9a43dad-kube-api-access-7gc6v\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:21:13.487739 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.487697    2563 generic.go:356] "Generic (PLEG): container finished" podID="545e26c0-4bbc-4bf4-850c-d81ce9a43dad" containerID="15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3" exitCode=0
Jul 24 14:21:13.487920 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.487762    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"
Jul 24 14:21:13.487920 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.487797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2" event={"ID":"545e26c0-4bbc-4bf4-850c-d81ce9a43dad","Type":"ContainerDied","Data":"15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3"}
Jul 24 14:21:13.487920 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.487897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2" event={"ID":"545e26c0-4bbc-4bf4-850c-d81ce9a43dad","Type":"ContainerDied","Data":"6c794ccc1c9c871b9d216656a9500bbd75fb30e22d65f5e358987c4d99ca560b"}
Jul 24 14:21:13.488038 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.487933    2563 scope.go:117] "RemoveContainer" containerID="15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3"
Jul 24 14:21:13.497108 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.497089    2563 scope.go:117] "RemoveContainer" containerID="15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3"
Jul 24 14:21:13.497372 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:21:13.497354    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3\": container with ID starting with 15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3 not found: ID does not exist" containerID="15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3"
Jul 24 14:21:13.497428 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.497381    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3"} err="failed to get container status \"15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3\": rpc error: code = NotFound desc = could not find container \"15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3\": container with ID starting with 15e925ced4853ecd5101a45c154201ef0b9e0a5e9bd2481a107fadb7228551c3 not found: ID does not exist"
Jul 24 14:21:13.510470 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.510437    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"]
Jul 24 14:21:13.517457 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:13.517435    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89fed8b8-6cdcf69999-cm4f2"]
Jul 24 14:21:14.865469 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:14.865439    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="545e26c0-4bbc-4bf4-850c-d81ce9a43dad" path="/var/lib/kubelet/pods/545e26c0-4bbc-4bf4-850c-d81ce9a43dad/volumes"
Jul 24 14:21:47.017549 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.017505    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"]
Jul 24 14:21:47.018008 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.017941    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545e26c0-4bbc-4bf4-850c-d81ce9a43dad" containerName="maas-api"
Jul 24 14:21:47.018008 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.017956    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="545e26c0-4bbc-4bf4-850c-d81ce9a43dad" containerName="maas-api"
Jul 24 14:21:47.018082 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.018017    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="545e26c0-4bbc-4bf4-850c-d81ce9a43dad" containerName="maas-api"
Jul 24 14:21:47.021067 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.021046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.023380 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.023359    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-676e8e92-serving-cert\""
Jul 24 14:21:47.038781 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.038756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"]
Jul 24 14:21:47.132037 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.131979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a12c95-2354-4c56-bbc3-fda715f34e92-openshift-service-ca\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.132247 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.132171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a12c95-2354-4c56-bbc3-fda715f34e92-maas-api-tls\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.132247 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.132207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jgt\" (UniqueName: \"kubernetes.io/projected/f6a12c95-2354-4c56-bbc3-fda715f34e92-kube-api-access-77jgt\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.232783 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.232736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a12c95-2354-4c56-bbc3-fda715f34e92-openshift-service-ca\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.233022 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.232872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a12c95-2354-4c56-bbc3-fda715f34e92-maas-api-tls\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.233022 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.232896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jgt\" (UniqueName: \"kubernetes.io/projected/f6a12c95-2354-4c56-bbc3-fda715f34e92-kube-api-access-77jgt\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.233430 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.233406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a12c95-2354-4c56-bbc3-fda715f34e92-openshift-service-ca\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.235539 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.235514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a12c95-2354-4c56-bbc3-fda715f34e92-maas-api-tls\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.244315 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.244293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jgt\" (UniqueName: \"kubernetes.io/projected/f6a12c95-2354-4c56-bbc3-fda715f34e92-kube-api-access-77jgt\") pod \"maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.330895 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.330793    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:47.471784 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.471747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"]
Jul 24 14:21:47.473554 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:21:47.473526    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a12c95_2354_4c56_bbc3_fda715f34e92.slice/crio-db5b952c20ab1db679ad17c65384328c88797d90ebca053434fa08993fa6cddf WatchSource:0}: Error finding container db5b952c20ab1db679ad17c65384328c88797d90ebca053434fa08993fa6cddf: Status 404 returned error can't find the container with id db5b952c20ab1db679ad17c65384328c88797d90ebca053434fa08993fa6cddf
Jul 24 14:21:47.475011 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.474992    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:21:47.669870 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:47.669770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp" event={"ID":"f6a12c95-2354-4c56-bbc3-fda715f34e92","Type":"ContainerStarted","Data":"db5b952c20ab1db679ad17c65384328c88797d90ebca053434fa08993fa6cddf"}
Jul 24 14:21:48.676982 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:48.676948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp" event={"ID":"f6a12c95-2354-4c56-bbc3-fda715f34e92","Type":"ContainerStarted","Data":"ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68"}
Jul 24 14:21:48.677397 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:48.677051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:21:48.694276 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:48.694217    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp" podStartSLOduration=2.355331762 podStartE2EDuration="2.694196737s" totalImagesPullingTime="338.864975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:21:48.692635784 +0000 UTC m=+2188.353468967" watchObservedRunningTime="2026-07-24 14:21:48.694196737 +0000 UTC m=+2188.355029897"
Jul 24 14:21:54.687014 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:21:54.686983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:22:57.349878 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.349776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"]
Jul 24 14:22:57.353203 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.353185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"
Jul 24 14:22:57.355348 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.355328    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:22:57.359558 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.359462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"]
Jul 24 14:22:57.447895 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.447863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3da97-c637-4174-a4ab-f8029f3b93d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g\" (UID: \"a6d3da97-c637-4174-a4ab-f8029f3b93d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"
Jul 24 14:22:57.549055 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.549017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3da97-c637-4174-a4ab-f8029f3b93d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g\" (UID: \"a6d3da97-c637-4174-a4ab-f8029f3b93d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"
Jul 24 14:22:57.549616 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.549597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3da97-c637-4174-a4ab-f8029f3b93d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g\" (UID: \"a6d3da97-c637-4174-a4ab-f8029f3b93d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"
Jul 24 14:22:57.665576 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.665495    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"
Jul 24 14:22:57.805725 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:57.805691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"]
Jul 24 14:22:57.806617 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:22:57.806589    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d3da97_c637_4174_a4ab_f8029f3b93d0.slice/crio-a9922a19e810dd52eecf80b08c607ea088b84f0d98752c14412f4a3cc8fa720b WatchSource:0}: Error finding container a9922a19e810dd52eecf80b08c607ea088b84f0d98752c14412f4a3cc8fa720b: Status 404 returned error can't find the container with id a9922a19e810dd52eecf80b08c607ea088b84f0d98752c14412f4a3cc8fa720b
Jul 24 14:22:58.037697 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:58.037661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g" event={"ID":"a6d3da97-c637-4174-a4ab-f8029f3b93d0","Type":"ContainerStarted","Data":"a9922a19e810dd52eecf80b08c607ea088b84f0d98752c14412f4a3cc8fa720b"}
Jul 24 14:22:59.045020 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:59.044987    2563 generic.go:356] "Generic (PLEG): container finished" podID="a6d3da97-c637-4174-a4ab-f8029f3b93d0" containerID="2bc047d461228504dcd5d52affa8f638b0c3c9dce9d1c8226368fd4005b84750" exitCode=0
Jul 24 14:22:59.045428 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:22:59.045067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g" event={"ID":"a6d3da97-c637-4174-a4ab-f8029f3b93d0","Type":"ContainerDied","Data":"2bc047d461228504dcd5d52affa8f638b0c3c9dce9d1c8226368fd4005b84750"}
Jul 24 14:23:00.190499 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:00.190476    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"
Jul 24 14:23:00.272084 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:00.272056    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3da97-c637-4174-a4ab-f8029f3b93d0-maas-api-service-ca\") pod \"a6d3da97-c637-4174-a4ab-f8029f3b93d0\" (UID: \"a6d3da97-c637-4174-a4ab-f8029f3b93d0\") "
Jul 24 14:23:00.272414 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:00.272392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d3da97-c637-4174-a4ab-f8029f3b93d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a6d3da97-c637-4174-a4ab-f8029f3b93d0" (UID: "a6d3da97-c637-4174-a4ab-f8029f3b93d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:23:00.373595 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:00.373498    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d3da97-c637-4174-a4ab-f8029f3b93d0-maas-api-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:23:01.057199 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:01.057171    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"
Jul 24 14:23:01.057368 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:01.057165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g" event={"ID":"a6d3da97-c637-4174-a4ab-f8029f3b93d0","Type":"ContainerDied","Data":"a9922a19e810dd52eecf80b08c607ea088b84f0d98752c14412f4a3cc8fa720b"}
Jul 24 14:23:01.057368 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:01.057328    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9922a19e810dd52eecf80b08c607ea088b84f0d98752c14412f4a3cc8fa720b"
Jul 24 14:23:12.803703 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:12.803665    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"]
Jul 24 14:23:12.804384 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:12.804033    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp" podUID="f6a12c95-2354-4c56-bbc3-fda715f34e92" containerName="maas-api" containerID="cri-o://ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68" gracePeriod=30
Jul 24 14:23:13.063974 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.063914    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:23:13.122271 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.122230    2563 generic.go:356] "Generic (PLEG): container finished" podID="f6a12c95-2354-4c56-bbc3-fda715f34e92" containerID="ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68" exitCode=0
Jul 24 14:23:13.122441 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.122276    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"
Jul 24 14:23:13.122441 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.122286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp" event={"ID":"f6a12c95-2354-4c56-bbc3-fda715f34e92","Type":"ContainerDied","Data":"ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68"}
Jul 24 14:23:13.122441 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.122342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp" event={"ID":"f6a12c95-2354-4c56-bbc3-fda715f34e92","Type":"ContainerDied","Data":"db5b952c20ab1db679ad17c65384328c88797d90ebca053434fa08993fa6cddf"}
Jul 24 14:23:13.122441 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.122372    2563 scope.go:117] "RemoveContainer" containerID="ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68"
Jul 24 14:23:13.131358 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.131337    2563 scope.go:117] "RemoveContainer" containerID="ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68"
Jul 24 14:23:13.131601 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:23:13.131584    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68\": container with ID starting with ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68 not found: ID does not exist" containerID="ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68"
Jul 24 14:23:13.131652 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.131608    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68"} err="failed to get container status \"ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68\": rpc error: code = NotFound desc = could not find container \"ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68\": container with ID starting with ab9b4a88f900a0027c665bfeee909f54f10086ed3aa291bec938820670be4b68 not found: ID does not exist"
Jul 24 14:23:13.185969 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.185937    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a12c95-2354-4c56-bbc3-fda715f34e92-openshift-service-ca\") pod \"f6a12c95-2354-4c56-bbc3-fda715f34e92\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") "
Jul 24 14:23:13.186219 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.186038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a12c95-2354-4c56-bbc3-fda715f34e92-maas-api-tls\") pod \"f6a12c95-2354-4c56-bbc3-fda715f34e92\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") "
Jul 24 14:23:13.186219 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.186086    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77jgt\" (UniqueName: \"kubernetes.io/projected/f6a12c95-2354-4c56-bbc3-fda715f34e92-kube-api-access-77jgt\") pod \"f6a12c95-2354-4c56-bbc3-fda715f34e92\" (UID: \"f6a12c95-2354-4c56-bbc3-fda715f34e92\") "
Jul 24 14:23:13.186392 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.186342    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a12c95-2354-4c56-bbc3-fda715f34e92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6a12c95-2354-4c56-bbc3-fda715f34e92" (UID: "f6a12c95-2354-4c56-bbc3-fda715f34e92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:23:13.188785 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.188764    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a12c95-2354-4c56-bbc3-fda715f34e92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6a12c95-2354-4c56-bbc3-fda715f34e92" (UID: "f6a12c95-2354-4c56-bbc3-fda715f34e92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:23:13.188785 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.188772    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a12c95-2354-4c56-bbc3-fda715f34e92-kube-api-access-77jgt" (OuterVolumeSpecName: "kube-api-access-77jgt") pod "f6a12c95-2354-4c56-bbc3-fda715f34e92" (UID: "f6a12c95-2354-4c56-bbc3-fda715f34e92"). InnerVolumeSpecName "kube-api-access-77jgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:23:13.287129 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.287090    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a12c95-2354-4c56-bbc3-fda715f34e92-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:23:13.287129 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.287128    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a12c95-2354-4c56-bbc3-fda715f34e92-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:23:13.287338 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.287145    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77jgt\" (UniqueName: \"kubernetes.io/projected/f6a12c95-2354-4c56-bbc3-fda715f34e92-kube-api-access-77jgt\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:23:13.445179 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.445145    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"]
Jul 24 14:23:13.447344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:13.447322    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-676e8e92-64cfc54b97-sjffp"]
Jul 24 14:23:14.864928 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:14.864892    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a12c95-2354-4c56-bbc3-fda715f34e92" path="/var/lib/kubelet/pods/f6a12c95-2354-4c56-bbc3-fda715f34e92/volumes"
Jul 24 14:23:17.460399 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:17.460369    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"]
Jul 24 14:23:17.464148 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:17.464122    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-676e8e92-4kv5g"]
Jul 24 14:23:18.867086 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:23:18.867052    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d3da97-c637-4174-a4ab-f8029f3b93d0" path="/var/lib/kubelet/pods/a6d3da97-c637-4174-a4ab-f8029f3b93d0/volumes"
Jul 24 14:25:09.137837 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.137785    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"]
Jul 24 14:25:09.138369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.138159    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d3da97-c637-4174-a4ab-f8029f3b93d0" containerName="revoke-keys"
Jul 24 14:25:09.138369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.138171    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d3da97-c637-4174-a4ab-f8029f3b93d0" containerName="revoke-keys"
Jul 24 14:25:09.138369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.138185    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a12c95-2354-4c56-bbc3-fda715f34e92" containerName="maas-api"
Jul 24 14:25:09.138369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.138190    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a12c95-2354-4c56-bbc3-fda715f34e92" containerName="maas-api"
Jul 24 14:25:09.138369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.138254    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a12c95-2354-4c56-bbc3-fda715f34e92" containerName="maas-api"
Jul 24 14:25:09.138369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.138262    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d3da97-c637-4174-a4ab-f8029f3b93d0" containerName="revoke-keys"
Jul 24 14:25:09.141287 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.141269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.145401 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.145383    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-bbfced-serving-cert\""
Jul 24 14:25:09.166059 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.166030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"]
Jul 24 14:25:09.313459 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.313417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm77l\" (UniqueName: \"kubernetes.io/projected/28c804b4-3d99-41f7-b40e-5051fa6bea83-kube-api-access-wm77l\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.313641 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.313489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c804b4-3d99-41f7-b40e-5051fa6bea83-maas-api-tls\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.313641 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.313552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c804b4-3d99-41f7-b40e-5051fa6bea83-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.414527 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.414438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c804b4-3d99-41f7-b40e-5051fa6bea83-maas-api-tls\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.414527 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.414506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c804b4-3d99-41f7-b40e-5051fa6bea83-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.414749 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.414568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm77l\" (UniqueName: \"kubernetes.io/projected/28c804b4-3d99-41f7-b40e-5051fa6bea83-kube-api-access-wm77l\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.415263 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.415234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c804b4-3d99-41f7-b40e-5051fa6bea83-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.417211 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.417192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c804b4-3d99-41f7-b40e-5051fa6bea83-maas-api-tls\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.439066 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.439040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm77l\" (UniqueName: \"kubernetes.io/projected/28c804b4-3d99-41f7-b40e-5051fa6bea83-kube-api-access-wm77l\") pod \"maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.451021 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.451001    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:09.603295 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.603258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"]
Jul 24 14:25:09.604096 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:25:09.604071    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c804b4_3d99_41f7_b40e_5051fa6bea83.slice/crio-58e1e17d72d3ac843f91bd7109de93584086243c9c88184c125a9f1b107d8f62 WatchSource:0}: Error finding container 58e1e17d72d3ac843f91bd7109de93584086243c9c88184c125a9f1b107d8f62: Status 404 returned error can't find the container with id 58e1e17d72d3ac843f91bd7109de93584086243c9c88184c125a9f1b107d8f62
Jul 24 14:25:09.727267 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:09.727230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd" event={"ID":"28c804b4-3d99-41f7-b40e-5051fa6bea83","Type":"ContainerStarted","Data":"58e1e17d72d3ac843f91bd7109de93584086243c9c88184c125a9f1b107d8f62"}
Jul 24 14:25:10.734385 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:10.734348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd" event={"ID":"28c804b4-3d99-41f7-b40e-5051fa6bea83","Type":"ContainerStarted","Data":"5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49"}
Jul 24 14:25:10.734762 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:10.734410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:10.753623 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:10.753566    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd" podStartSLOduration=1.215100824 podStartE2EDuration="1.753550864s" totalImagesPullingTime="538.45004ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:10.752463636 +0000 UTC m=+2390.413296798" watchObservedRunningTime="2026-07-24 14:25:10.753550864 +0000 UTC m=+2390.414384022"
Jul 24 14:25:16.748517 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:16.748485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:25:18.153796 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.153752    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"]
Jul 24 14:25:18.158182 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.158162    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.161848 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.161826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-aa51de-serving-cert\""
Jul 24 14:25:18.176281 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.176258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"]
Jul 24 14:25:18.290590 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.290513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn5sd\" (UniqueName: \"kubernetes.io/projected/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-kube-api-access-bn5sd\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.290590 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.290560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-maas-api-tls\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.290590 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.290595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.391912 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.391872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.392071 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.391984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn5sd\" (UniqueName: \"kubernetes.io/projected/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-kube-api-access-bn5sd\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.392071 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.392013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-maas-api-tls\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.392618 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.392594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.394519 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.394494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-maas-api-tls\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.401389 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.401369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn5sd\" (UniqueName: \"kubernetes.io/projected/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-kube-api-access-bn5sd\") pod \"maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.470038 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.470020    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:18.613429 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.613387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"]
Jul 24 14:25:18.614468 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:25:18.614439    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1e9de7_2b2d_4f02_86d5_369bf2ea4a0f.slice/crio-377cd1f2f26f3923f0fd90fb4158b4c98aca1b5e230df4653889685909f7d0a3 WatchSource:0}: Error finding container 377cd1f2f26f3923f0fd90fb4158b4c98aca1b5e230df4653889685909f7d0a3: Status 404 returned error can't find the container with id 377cd1f2f26f3923f0fd90fb4158b4c98aca1b5e230df4653889685909f7d0a3
Jul 24 14:25:18.782280 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.782195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x" event={"ID":"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f","Type":"ContainerStarted","Data":"377cd1f2f26f3923f0fd90fb4158b4c98aca1b5e230df4653889685909f7d0a3"}
Jul 24 14:25:18.912323 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.912292    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"]
Jul 24 14:25:18.916741 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.916720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:18.919773 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.919754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-aa51de-dockercfg-f6bs7\""
Jul 24 14:25:18.919883 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.919797    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-aa51de\""
Jul 24 14:25:18.925409 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:18.925244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"]
Jul 24 14:25:19.099614 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.099583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7qrv\" (UniqueName: \"kubernetes.io/projected/0034cb31-3106-4581-bd52-bac3d3763239-kube-api-access-l7qrv\") pod \"payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") " pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:19.099743 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.099650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0034cb31-3106-4581-bd52-bac3d3763239-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") " pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:19.200628 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.200593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7qrv\" (UniqueName: \"kubernetes.io/projected/0034cb31-3106-4581-bd52-bac3d3763239-kube-api-access-l7qrv\") pod \"payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") " pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:19.201024 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.200661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0034cb31-3106-4581-bd52-bac3d3763239-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") " pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:19.201385 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.201367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0034cb31-3106-4581-bd52-bac3d3763239-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") " pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:19.214500 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.214476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7qrv\" (UniqueName: \"kubernetes.io/projected/0034cb31-3106-4581-bd52-bac3d3763239-kube-api-access-l7qrv\") pod \"payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") " pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:19.229129 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.229105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:19.368291 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.368263    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"]
Jul 24 14:25:19.369667 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:25:19.369642    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0034cb31_3106_4581_bd52_bac3d3763239.slice/crio-8152845003e8791311ef2c07536e95d5ff9ed7a03cbbfce26ca16adec0dd0e10 WatchSource:0}: Error finding container 8152845003e8791311ef2c07536e95d5ff9ed7a03cbbfce26ca16adec0dd0e10: Status 404 returned error can't find the container with id 8152845003e8791311ef2c07536e95d5ff9ed7a03cbbfce26ca16adec0dd0e10
Jul 24 14:25:19.791486 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.791400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2" event={"ID":"0034cb31-3106-4581-bd52-bac3d3763239","Type":"ContainerStarted","Data":"8152845003e8791311ef2c07536e95d5ff9ed7a03cbbfce26ca16adec0dd0e10"}
Jul 24 14:25:19.796726 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.796688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x" event={"ID":"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f","Type":"ContainerStarted","Data":"b7814f2ba79a2c5620e6cdf99ddad6a13ee87693f55c5ae3f1144d83e7ced120"}
Jul 24 14:25:19.796887 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.796845    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:19.815001 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:19.814950    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x" podStartSLOduration=1.346346204 podStartE2EDuration="1.814935947s" totalImagesPullingTime="468.589743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:19.812788152 +0000 UTC m=+2399.473621318" watchObservedRunningTime="2026-07-24 14:25:19.814935947 +0000 UTC m=+2399.475769127"
Jul 24 14:25:21.810166 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:21.810127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2" event={"ID":"0034cb31-3106-4581-bd52-bac3d3763239","Type":"ContainerStarted","Data":"44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2"}
Jul 24 14:25:21.810542 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:21.810243    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:25:21.848864 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:21.848794    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2" podStartSLOduration=2.228467683 podStartE2EDuration="3.848777896s" totalImagesPullingTime="1.620310213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:21.847760061 +0000 UTC m=+2401.508593220" watchObservedRunningTime="2026-07-24 14:25:21.848777896 +0000 UTC m=+2401.509611096"
Jul 24 14:25:25.808788 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:25.808757    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:25:32.818709 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:25:32.818678    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:27:04.178208 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.178160    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"]
Jul 24 14:27:04.178776 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.178403    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd" podUID="28c804b4-3d99-41f7-b40e-5051fa6bea83" containerName="maas-api" containerID="cri-o://5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49" gracePeriod=30
Jul 24 14:27:04.643339 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.643311    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:27:04.749086 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.749041    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c804b4-3d99-41f7-b40e-5051fa6bea83-maas-api-tls\") pod \"28c804b4-3d99-41f7-b40e-5051fa6bea83\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") "
Jul 24 14:27:04.749278 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.749150    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm77l\" (UniqueName: \"kubernetes.io/projected/28c804b4-3d99-41f7-b40e-5051fa6bea83-kube-api-access-wm77l\") pod \"28c804b4-3d99-41f7-b40e-5051fa6bea83\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") "
Jul 24 14:27:04.749278 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.749176    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c804b4-3d99-41f7-b40e-5051fa6bea83-openshift-service-ca\") pod \"28c804b4-3d99-41f7-b40e-5051fa6bea83\" (UID: \"28c804b4-3d99-41f7-b40e-5051fa6bea83\") "
Jul 24 14:27:04.749536 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.749508    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28c804b4-3d99-41f7-b40e-5051fa6bea83-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28c804b4-3d99-41f7-b40e-5051fa6bea83" (UID: "28c804b4-3d99-41f7-b40e-5051fa6bea83"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:04.751205 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.751182    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28c804b4-3d99-41f7-b40e-5051fa6bea83-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28c804b4-3d99-41f7-b40e-5051fa6bea83" (UID: "28c804b4-3d99-41f7-b40e-5051fa6bea83"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:04.751333 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.751311    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c804b4-3d99-41f7-b40e-5051fa6bea83-kube-api-access-wm77l" (OuterVolumeSpecName: "kube-api-access-wm77l") pod "28c804b4-3d99-41f7-b40e-5051fa6bea83" (UID: "28c804b4-3d99-41f7-b40e-5051fa6bea83"). InnerVolumeSpecName "kube-api-access-wm77l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:27:04.850719 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.850670    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c804b4-3d99-41f7-b40e-5051fa6bea83-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:04.850719 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.850712    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm77l\" (UniqueName: \"kubernetes.io/projected/28c804b4-3d99-41f7-b40e-5051fa6bea83-kube-api-access-wm77l\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:04.850719 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:04.850723    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c804b4-3d99-41f7-b40e-5051fa6bea83-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:05.372506 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.372468    2563 generic.go:356] "Generic (PLEG): container finished" podID="28c804b4-3d99-41f7-b40e-5051fa6bea83" containerID="5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49" exitCode=0
Jul 24 14:27:05.373121 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.372518    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"
Jul 24 14:27:05.373121 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.372534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd" event={"ID":"28c804b4-3d99-41f7-b40e-5051fa6bea83","Type":"ContainerDied","Data":"5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49"}
Jul 24 14:27:05.373121 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.372589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd" event={"ID":"28c804b4-3d99-41f7-b40e-5051fa6bea83","Type":"ContainerDied","Data":"58e1e17d72d3ac843f91bd7109de93584086243c9c88184c125a9f1b107d8f62"}
Jul 24 14:27:05.373121 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.372619    2563 scope.go:117] "RemoveContainer" containerID="5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49"
Jul 24 14:27:05.383886 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.383864    2563 scope.go:117] "RemoveContainer" containerID="5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49"
Jul 24 14:27:05.384108 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:27:05.384089    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49\": container with ID starting with 5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49 not found: ID does not exist" containerID="5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49"
Jul 24 14:27:05.384164 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.384117    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49"} err="failed to get container status \"5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49\": rpc error: code = NotFound desc = could not find container \"5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49\": container with ID starting with 5b2abf8340132d4246bd6a7e0d6c80ba23472be773f3aeeeda0321b26e402e49 not found: ID does not exist"
Jul 24 14:27:05.391930 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.391906    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"]
Jul 24 14:27:05.396087 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:05.396061    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bbfced-575f58ddcf-xt5sd"]
Jul 24 14:27:06.864684 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:06.864645    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28c804b4-3d99-41f7-b40e-5051fa6bea83" path="/var/lib/kubelet/pods/28c804b4-3d99-41f7-b40e-5051fa6bea83/volumes"
Jul 24 14:27:26.134169 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.134130    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"]
Jul 24 14:27:26.135055 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.134995    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x" podUID="da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" containerName="maas-api" containerID="cri-o://b7814f2ba79a2c5620e6cdf99ddad6a13ee87693f55c5ae3f1144d83e7ced120" gracePeriod=30
Jul 24 14:27:26.195218 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.195178    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"]
Jul 24 14:27:26.195503 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.195440    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2" podUID="0034cb31-3106-4581-bd52-bac3d3763239" containerName="payload-processing" containerID="cri-o://44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2" gracePeriod=30
Jul 24 14:27:26.489406 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.489370    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:27:26.491032 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.491001    2563 generic.go:356] "Generic (PLEG): container finished" podID="0034cb31-3106-4581-bd52-bac3d3763239" containerID="44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2" exitCode=0
Jul 24 14:27:26.491185 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.491093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2" event={"ID":"0034cb31-3106-4581-bd52-bac3d3763239","Type":"ContainerDied","Data":"44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2"}
Jul 24 14:27:26.491185 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.491170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2" event={"ID":"0034cb31-3106-4581-bd52-bac3d3763239","Type":"ContainerDied","Data":"8152845003e8791311ef2c07536e95d5ff9ed7a03cbbfce26ca16adec0dd0e10"}
Jul 24 14:27:26.491306 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.491205    2563 scope.go:117] "RemoveContainer" containerID="44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2"
Jul 24 14:27:26.493114 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.493089    2563 generic.go:356] "Generic (PLEG): container finished" podID="da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" containerID="b7814f2ba79a2c5620e6cdf99ddad6a13ee87693f55c5ae3f1144d83e7ced120" exitCode=0
Jul 24 14:27:26.493229 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.493189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x" event={"ID":"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f","Type":"ContainerDied","Data":"b7814f2ba79a2c5620e6cdf99ddad6a13ee87693f55c5ae3f1144d83e7ced120"}
Jul 24 14:27:26.501406 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.501373    2563 scope.go:117] "RemoveContainer" containerID="44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2"
Jul 24 14:27:26.501697 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:27:26.501675    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2\": container with ID starting with 44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2 not found: ID does not exist" containerID="44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2"
Jul 24 14:27:26.501765 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.501710    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2"} err="failed to get container status \"44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2\": rpc error: code = NotFound desc = could not find container \"44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2\": container with ID starting with 44c03d3469cdb92bdd7677243c8ac18b3a6aac077753735b6570cb12eff749d2 not found: ID does not exist"
Jul 24 14:27:26.604390 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.604366    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:27:26.658541 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.658505    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7qrv\" (UniqueName: \"kubernetes.io/projected/0034cb31-3106-4581-bd52-bac3d3763239-kube-api-access-l7qrv\") pod \"0034cb31-3106-4581-bd52-bac3d3763239\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") "
Jul 24 14:27:26.658709 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.658557    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0034cb31-3106-4581-bd52-bac3d3763239-plugins-config-volume\") pod \"0034cb31-3106-4581-bd52-bac3d3763239\" (UID: \"0034cb31-3106-4581-bd52-bac3d3763239\") "
Jul 24 14:27:26.659020 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.658991    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0034cb31-3106-4581-bd52-bac3d3763239-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0034cb31-3106-4581-bd52-bac3d3763239" (UID: "0034cb31-3106-4581-bd52-bac3d3763239"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:26.661031 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.660971    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0034cb31-3106-4581-bd52-bac3d3763239-kube-api-access-l7qrv" (OuterVolumeSpecName: "kube-api-access-l7qrv") pod "0034cb31-3106-4581-bd52-bac3d3763239" (UID: "0034cb31-3106-4581-bd52-bac3d3763239"). InnerVolumeSpecName "kube-api-access-l7qrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:27:26.759520 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.759478    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn5sd\" (UniqueName: \"kubernetes.io/projected/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-kube-api-access-bn5sd\") pod \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") "
Jul 24 14:27:26.759708 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.759591    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-maas-api-tls\") pod \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") "
Jul 24 14:27:26.759708 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.759611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-openshift-service-ca\") pod \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\" (UID: \"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f\") "
Jul 24 14:27:26.759844 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.759797    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7qrv\" (UniqueName: \"kubernetes.io/projected/0034cb31-3106-4581-bd52-bac3d3763239-kube-api-access-l7qrv\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:26.759844 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.759808    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0034cb31-3106-4581-bd52-bac3d3763239-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:26.760052 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.760028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" (UID: "da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:26.761862 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.761839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" (UID: "da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:26.761935 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.761914    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-kube-api-access-bn5sd" (OuterVolumeSpecName: "kube-api-access-bn5sd") pod "da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" (UID: "da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f"). InnerVolumeSpecName "kube-api-access-bn5sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:27:26.860979 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.860949    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:26.860979 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.860976    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:26.860979 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:26.860986    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn5sd\" (UniqueName: \"kubernetes.io/projected/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f-kube-api-access-bn5sd\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:27:27.500014 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.499981    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"
Jul 24 14:27:27.501452 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.501431    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"
Jul 24 14:27:27.501572 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.501469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x" event={"ID":"da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f","Type":"ContainerDied","Data":"377cd1f2f26f3923f0fd90fb4158b4c98aca1b5e230df4653889685909f7d0a3"}
Jul 24 14:27:27.501572 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.501536    2563 scope.go:117] "RemoveContainer" containerID="b7814f2ba79a2c5620e6cdf99ddad6a13ee87693f55c5ae3f1144d83e7ced120"
Jul 24 14:27:27.521591 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.521566    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"]
Jul 24 14:27:27.524314 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.524292    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-aa51de-b4d894f74-br6p2"]
Jul 24 14:27:27.534989 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.534968    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"]
Jul 24 14:27:27.539191 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:27.539172    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-aa51de-76bfcb698f-2t27x"]
Jul 24 14:27:28.864968 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:28.864925    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0034cb31-3106-4581-bd52-bac3d3763239" path="/var/lib/kubelet/pods/0034cb31-3106-4581-bd52-bac3d3763239/volumes"
Jul 24 14:27:28.865511 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:28.865489    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" path="/var/lib/kubelet/pods/da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f/volumes"
Jul 24 14:27:42.059321 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059291    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"]
Jul 24 14:27:42.059693 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059661    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" containerName="maas-api"
Jul 24 14:27:42.059693 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059672    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" containerName="maas-api"
Jul 24 14:27:42.059693 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059687    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c804b4-3d99-41f7-b40e-5051fa6bea83" containerName="maas-api"
Jul 24 14:27:42.059693 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059692    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c804b4-3d99-41f7-b40e-5051fa6bea83" containerName="maas-api"
Jul 24 14:27:42.059855 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059708    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0034cb31-3106-4581-bd52-bac3d3763239" containerName="payload-processing"
Jul 24 14:27:42.059855 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059714    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0034cb31-3106-4581-bd52-bac3d3763239" containerName="payload-processing"
Jul 24 14:27:42.059855 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059770    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0034cb31-3106-4581-bd52-bac3d3763239" containerName="payload-processing"
Jul 24 14:27:42.059855 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059783    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da1e9de7-2b2d-4f02-86d5-369bf2ea4a0f" containerName="maas-api"
Jul 24 14:27:42.059855 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.059788    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c804b4-3d99-41f7-b40e-5051fa6bea83" containerName="maas-api"
Jul 24 14:27:42.062635 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.062619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.065153 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.065134    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e7d231-serving-cert\""
Jul 24 14:27:42.078986 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.078962    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"]
Jul 24 14:27:42.098411 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.098385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4844daa2-6c0b-4e35-9c43-f108aab0db26-maas-api-tls\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.098797 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.098421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4844daa2-6c0b-4e35-9c43-f108aab0db26-openshift-service-ca\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.098797 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.098466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8bs\" (UniqueName: \"kubernetes.io/projected/4844daa2-6c0b-4e35-9c43-f108aab0db26-kube-api-access-5q8bs\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.199892 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.199849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4844daa2-6c0b-4e35-9c43-f108aab0db26-maas-api-tls\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.199892 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.199895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4844daa2-6c0b-4e35-9c43-f108aab0db26-openshift-service-ca\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.200143 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.199930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8bs\" (UniqueName: \"kubernetes.io/projected/4844daa2-6c0b-4e35-9c43-f108aab0db26-kube-api-access-5q8bs\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.200728 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.200640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4844daa2-6c0b-4e35-9c43-f108aab0db26-openshift-service-ca\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.202807 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.202786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4844daa2-6c0b-4e35-9c43-f108aab0db26-maas-api-tls\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.210893 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.210872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8bs\" (UniqueName: \"kubernetes.io/projected/4844daa2-6c0b-4e35-9c43-f108aab0db26-kube-api-access-5q8bs\") pod \"maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.372860 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.372730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:42.519557 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.519531    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"]
Jul 24 14:27:42.521772 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:27:42.521747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4844daa2_6c0b_4e35_9c43_f108aab0db26.slice/crio-e3e9e5d5ee9121fb480903afbfc891e93ea0ed7a14c3f335de15c41ef30c3cba WatchSource:0}: Error finding container e3e9e5d5ee9121fb480903afbfc891e93ea0ed7a14c3f335de15c41ef30c3cba: Status 404 returned error can't find the container with id e3e9e5d5ee9121fb480903afbfc891e93ea0ed7a14c3f335de15c41ef30c3cba
Jul 24 14:27:42.523165 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.523149    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:27:42.582769 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.582735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx" event={"ID":"4844daa2-6c0b-4e35-9c43-f108aab0db26","Type":"ContainerStarted","Data":"e3e9e5d5ee9121fb480903afbfc891e93ea0ed7a14c3f335de15c41ef30c3cba"}
Jul 24 14:27:42.710026 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.709942    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"]
Jul 24 14:27:42.714541 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.714511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:42.717551 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.717527    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-e7d231\""
Jul 24 14:27:42.717795 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.717779    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-e7d231-dockercfg-drrhw\""
Jul 24 14:27:42.726549 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.726524    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"]
Jul 24 14:27:42.728981 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.728962    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"]
Jul 24 14:27:42.732475 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.732460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:42.752456 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.752421    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"]
Jul 24 14:27:42.805397 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.804848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") " pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:42.805555 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.805430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4sdx\" (UniqueName: \"kubernetes.io/projected/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-kube-api-access-b4sdx\") pod \"payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:42.805555 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.805501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:42.805638 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.805600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvtv\" (UniqueName: \"kubernetes.io/projected/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-kube-api-access-ljvtv\") pod \"payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") " pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:42.906894 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.906863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:42.907068 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.906932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvtv\" (UniqueName: \"kubernetes.io/projected/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-kube-api-access-ljvtv\") pod \"payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") " pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:42.907068 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.906958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") " pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:42.907068 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.906976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4sdx\" (UniqueName: \"kubernetes.io/projected/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-kube-api-access-b4sdx\") pod \"payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:42.907852 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.907806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:42.907938 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.907806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") " pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:42.918432 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.918408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvtv\" (UniqueName: \"kubernetes.io/projected/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-kube-api-access-ljvtv\") pod \"payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") " pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:42.918608 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:42.918588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4sdx\" (UniqueName: \"kubernetes.io/projected/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-kube-api-access-b4sdx\") pod \"payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:43.027063 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.027038    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:43.042461 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.042436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:43.200891 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.200855    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"]
Jul 24 14:27:43.203013 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:27:43.202951    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876773f0_e0f8_48d5_a0a1_8cdc71d3fef6.slice/crio-f411eed6117ba3455d42decbbcf7f6f87b8038dcbd4c19e6eee8d4583d04f9ba WatchSource:0}: Error finding container f411eed6117ba3455d42decbbcf7f6f87b8038dcbd4c19e6eee8d4583d04f9ba: Status 404 returned error can't find the container with id f411eed6117ba3455d42decbbcf7f6f87b8038dcbd4c19e6eee8d4583d04f9ba
Jul 24 14:27:43.230533 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.230509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"]
Jul 24 14:27:43.231949 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:27:43.231921    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4746e1_3b43_49bc_87b4_cdfc5cde1bd8.slice/crio-2d983781d7eb36aeff7a1a1672037211567aa89c33fca0607ae36b2e9114eb23 WatchSource:0}: Error finding container 2d983781d7eb36aeff7a1a1672037211567aa89c33fca0607ae36b2e9114eb23: Status 404 returned error can't find the container with id 2d983781d7eb36aeff7a1a1672037211567aa89c33fca0607ae36b2e9114eb23
Jul 24 14:27:43.591016 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.590919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx" event={"ID":"4844daa2-6c0b-4e35-9c43-f108aab0db26","Type":"ContainerStarted","Data":"c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c"}
Jul 24 14:27:43.591180 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.591152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:43.593110 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.593085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428" event={"ID":"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8","Type":"ContainerStarted","Data":"dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c"}
Jul 24 14:27:43.593306 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.593293    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:43.593402 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.593390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428" event={"ID":"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8","Type":"ContainerStarted","Data":"2d983781d7eb36aeff7a1a1672037211567aa89c33fca0607ae36b2e9114eb23"}
Jul 24 14:27:43.594970 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.594949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q" event={"ID":"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6","Type":"ContainerStarted","Data":"6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b"}
Jul 24 14:27:43.595061 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.594985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q" event={"ID":"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6","Type":"ContainerStarted","Data":"f411eed6117ba3455d42decbbcf7f6f87b8038dcbd4c19e6eee8d4583d04f9ba"}
Jul 24 14:27:43.595061 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.595004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:43.610035 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.609989    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx" podStartSLOduration=1.143884607 podStartE2EDuration="1.609975582s" totalImagesPullingTime="466.090975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:43.607375511 +0000 UTC m=+2543.268208670" watchObservedRunningTime="2026-07-24 14:27:43.609975582 +0000 UTC m=+2543.270808741"
Jul 24 14:27:43.626399 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.626352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428" podStartSLOduration=1.6263389259999999 podStartE2EDuration="1.626338926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:43.624805049 +0000 UTC m=+2543.285638208" watchObservedRunningTime="2026-07-24 14:27:43.626338926 +0000 UTC m=+2543.287172062"
Jul 24 14:27:43.642361 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:43.642303    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q" podStartSLOduration=1.642289725 podStartE2EDuration="1.642289725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:43.64019093 +0000 UTC m=+2543.301024092" watchObservedRunningTime="2026-07-24 14:27:43.642289725 +0000 UTC m=+2543.303122884"
Jul 24 14:27:49.606414 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:49.606383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:27:50.263877 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.263840    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"]
Jul 24 14:27:50.267581 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.267560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.269903 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.269883    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-45b6b7-serving-cert\""
Jul 24 14:27:50.277563 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.277541    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"]
Jul 24 14:27:50.371886 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.371853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.372051 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.371903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmw2\" (UniqueName: \"kubernetes.io/projected/8d8ffb13-c7d8-475d-b691-e456c3f97aad-kube-api-access-mmmw2\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.372051 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.371948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8ffb13-c7d8-475d-b691-e456c3f97aad-openshift-service-ca\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.473225 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.473191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.473369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.473239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmw2\" (UniqueName: \"kubernetes.io/projected/8d8ffb13-c7d8-475d-b691-e456c3f97aad-kube-api-access-mmmw2\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.473369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.473276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8ffb13-c7d8-475d-b691-e456c3f97aad-openshift-service-ca\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.473456 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:27:50.473360    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-serving-cert: secret "maas-api-e2e-api-b-45b6b7-serving-cert" not found
Jul 24 14:27:50.473456 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:27:50.473438    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls podName:8d8ffb13-c7d8-475d-b691-e456c3f97aad nodeName:}" failed. No retries permitted until 2026-07-24 14:27:50.973417623 +0000 UTC m=+2550.634250763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls") pod "maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7" (UID: "8d8ffb13-c7d8-475d-b691-e456c3f97aad") : secret "maas-api-e2e-api-b-45b6b7-serving-cert" not found
Jul 24 14:27:50.473899 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.473883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8ffb13-c7d8-475d-b691-e456c3f97aad-openshift-service-ca\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.515874 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.515793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmw2\" (UniqueName: \"kubernetes.io/projected/8d8ffb13-c7d8-475d-b691-e456c3f97aad-kube-api-access-mmmw2\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.977205 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.977149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:50.979963 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:50.979937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls\") pod \"maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:51.179649 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.179612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:51.307146 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.307119    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"]
Jul 24 14:27:51.312058 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.312035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.314466 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.314440    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-45b6b7\""
Jul 24 14:27:51.315001 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.314981    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-45b6b7-dockercfg-959gm\""
Jul 24 14:27:51.321911 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.321886    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"]
Jul 24 14:27:51.342344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.342322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"]
Jul 24 14:27:51.343988 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:27:51.343967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8ffb13_c7d8_475d_b691_e456c3f97aad.slice/crio-218612d68830ee2beaeaa7ad67f0b9aceab1c6fab9cd7664e34cef6a333ff2e3 WatchSource:0}: Error finding container 218612d68830ee2beaeaa7ad67f0b9aceab1c6fab9cd7664e34cef6a333ff2e3: Status 404 returned error can't find the container with id 218612d68830ee2beaeaa7ad67f0b9aceab1c6fab9cd7664e34cef6a333ff2e3
Jul 24 14:27:51.381932 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.381910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d349feb-f634-403c-9e09-4f991fecc4bb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") " pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.382059 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.381964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7np2\" (UniqueName: \"kubernetes.io/projected/2d349feb-f634-403c-9e09-4f991fecc4bb-kube-api-access-p7np2\") pod \"payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") " pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.482480 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.482447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d349feb-f634-403c-9e09-4f991fecc4bb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") " pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.482665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.482511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7np2\" (UniqueName: \"kubernetes.io/projected/2d349feb-f634-403c-9e09-4f991fecc4bb-kube-api-access-p7np2\") pod \"payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") " pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.483359 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.483334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d349feb-f634-403c-9e09-4f991fecc4bb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") " pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.492864 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.492778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7np2\" (UniqueName: \"kubernetes.io/projected/2d349feb-f634-403c-9e09-4f991fecc4bb-kube-api-access-p7np2\") pod \"payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") " pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.626616 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.626579    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:51.641592 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.641559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7" event={"ID":"8d8ffb13-c7d8-475d-b691-e456c3f97aad","Type":"ContainerStarted","Data":"218612d68830ee2beaeaa7ad67f0b9aceab1c6fab9cd7664e34cef6a333ff2e3"}
Jul 24 14:27:51.769489 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:51.769459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"]
Jul 24 14:27:51.771078 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:27:51.771051    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d349feb_f634_403c_9e09_4f991fecc4bb.slice/crio-90fb99507c5c554bfa8a96704feed1a21fe448df3505f6226812aaf28223dda8 WatchSource:0}: Error finding container 90fb99507c5c554bfa8a96704feed1a21fe448df3505f6226812aaf28223dda8: Status 404 returned error can't find the container with id 90fb99507c5c554bfa8a96704feed1a21fe448df3505f6226812aaf28223dda8
Jul 24 14:27:52.649286 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:52.649249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc" event={"ID":"2d349feb-f634-403c-9e09-4f991fecc4bb","Type":"ContainerStarted","Data":"7ab2c0d50141b39418e96be3696767c4d0d962c04aba14226ff55a4126365638"}
Jul 24 14:27:52.649721 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:52.649316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc" event={"ID":"2d349feb-f634-403c-9e09-4f991fecc4bb","Type":"ContainerStarted","Data":"90fb99507c5c554bfa8a96704feed1a21fe448df3505f6226812aaf28223dda8"}
Jul 24 14:27:52.649721 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:52.649345    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:27:52.650837 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:52.650797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7" event={"ID":"8d8ffb13-c7d8-475d-b691-e456c3f97aad","Type":"ContainerStarted","Data":"c2f16899caa7582e227802d2441d10adbac9cf5b6edaab3b35af4e12037a58af"}
Jul 24 14:27:52.650953 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:52.650946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:27:52.667918 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:52.667870    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc" podStartSLOduration=1.667858094 podStartE2EDuration="1.667858094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:52.664402758 +0000 UTC m=+2552.325235917" watchObservedRunningTime="2026-07-24 14:27:52.667858094 +0000 UTC m=+2552.328691252"
Jul 24 14:27:52.684079 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:52.684039    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7" podStartSLOduration=2.223786748 podStartE2EDuration="2.684026719s" totalImagesPullingTime="460.239971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:52.681423281 +0000 UTC m=+2552.342256443" watchObservedRunningTime="2026-07-24 14:27:52.684026719 +0000 UTC m=+2552.344859878"
Jul 24 14:27:54.601912 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:54.601875    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:27:55.607772 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:55.607742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:27:58.662028 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:27:58.661999    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:28:03.659200 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:03.659166    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:28:17.845788 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:17.845747    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"]
Jul 24 14:28:17.846217 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:17.845979    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx" podUID="4844daa2-6c0b-4e35-9c43-f108aab0db26" containerName="maas-api" containerID="cri-o://c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c" gracePeriod=30
Jul 24 14:28:17.922166 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:17.922133    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"]
Jul 24 14:28:17.922354 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:17.922331    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428" podUID="ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" containerName="payload-processing" containerID="cri-o://dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c" gracePeriod=30
Jul 24 14:28:17.942878 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:17.942850    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"]
Jul 24 14:28:17.944004 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:17.943800    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q" podUID="876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" containerName="payload-pre-processing" containerID="cri-o://6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b" gracePeriod=30
Jul 24 14:28:18.185090 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.185060    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:28:18.216595 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.216564    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4844daa2-6c0b-4e35-9c43-f108aab0db26-maas-api-tls\") pod \"4844daa2-6c0b-4e35-9c43-f108aab0db26\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") "
Jul 24 14:28:18.216735 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.216666    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4844daa2-6c0b-4e35-9c43-f108aab0db26-openshift-service-ca\") pod \"4844daa2-6c0b-4e35-9c43-f108aab0db26\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") "
Jul 24 14:28:18.216799 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.216738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q8bs\" (UniqueName: \"kubernetes.io/projected/4844daa2-6c0b-4e35-9c43-f108aab0db26-kube-api-access-5q8bs\") pod \"4844daa2-6c0b-4e35-9c43-f108aab0db26\" (UID: \"4844daa2-6c0b-4e35-9c43-f108aab0db26\") "
Jul 24 14:28:18.217145 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.217050    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4844daa2-6c0b-4e35-9c43-f108aab0db26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4844daa2-6c0b-4e35-9c43-f108aab0db26" (UID: "4844daa2-6c0b-4e35-9c43-f108aab0db26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:18.219005 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.218978    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4844daa2-6c0b-4e35-9c43-f108aab0db26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4844daa2-6c0b-4e35-9c43-f108aab0db26" (UID: "4844daa2-6c0b-4e35-9c43-f108aab0db26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.219221 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.219190    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4844daa2-6c0b-4e35-9c43-f108aab0db26-kube-api-access-5q8bs" (OuterVolumeSpecName: "kube-api-access-5q8bs") pod "4844daa2-6c0b-4e35-9c43-f108aab0db26" (UID: "4844daa2-6c0b-4e35-9c43-f108aab0db26"). InnerVolumeSpecName "kube-api-access-5q8bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:18.223334 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.223313    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:28:18.233219 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.233200    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:28:18.317976 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.317946    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-plugins-config-volume\") pod \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") "
Jul 24 14:28:18.318130 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4sdx\" (UniqueName: \"kubernetes.io/projected/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-kube-api-access-b4sdx\") pod \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\" (UID: \"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6\") "
Jul 24 14:28:18.318130 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318031    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljvtv\" (UniqueName: \"kubernetes.io/projected/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-kube-api-access-ljvtv\") pod \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") "
Jul 24 14:28:18.318130 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318085    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-plugins-config-volume\") pod \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\" (UID: \"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8\") "
Jul 24 14:28:18.318323 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318291    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4844daa2-6c0b-4e35-9c43-f108aab0db26-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.318323 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318317    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q8bs\" (UniqueName: \"kubernetes.io/projected/4844daa2-6c0b-4e35-9c43-f108aab0db26-kube-api-access-5q8bs\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.318493 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318334    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4844daa2-6c0b-4e35-9c43-f108aab0db26-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.318493 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318464    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" (UID: "876773f0-e0f8-48d5-a0a1-8cdc71d3fef6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:18.318493 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.318486    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" (UID: "ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:18.320277 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.320254    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-kube-api-access-ljvtv" (OuterVolumeSpecName: "kube-api-access-ljvtv") pod "ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" (UID: "ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8"). InnerVolumeSpecName "kube-api-access-ljvtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:18.320369 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.320292    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-kube-api-access-b4sdx" (OuterVolumeSpecName: "kube-api-access-b4sdx") pod "876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" (UID: "876773f0-e0f8-48d5-a0a1-8cdc71d3fef6"). InnerVolumeSpecName "kube-api-access-b4sdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:18.419376 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.419306    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4sdx\" (UniqueName: \"kubernetes.io/projected/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-kube-api-access-b4sdx\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.419376 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.419329    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljvtv\" (UniqueName: \"kubernetes.io/projected/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-kube-api-access-ljvtv\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.419376 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.419338    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.419376 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.419347    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.803610 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.803571    2563 generic.go:356] "Generic (PLEG): container finished" podID="4844daa2-6c0b-4e35-9c43-f108aab0db26" containerID="c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c" exitCode=0
Jul 24 14:28:18.803775 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.803621    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"
Jul 24 14:28:18.803775 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.803659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx" event={"ID":"4844daa2-6c0b-4e35-9c43-f108aab0db26","Type":"ContainerDied","Data":"c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c"}
Jul 24 14:28:18.803775 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.803715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx" event={"ID":"4844daa2-6c0b-4e35-9c43-f108aab0db26","Type":"ContainerDied","Data":"e3e9e5d5ee9121fb480903afbfc891e93ea0ed7a14c3f335de15c41ef30c3cba"}
Jul 24 14:28:18.803775 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.803748    2563 scope.go:117] "RemoveContainer" containerID="c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c"
Jul 24 14:28:18.805092 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.805070    2563 generic.go:356] "Generic (PLEG): container finished" podID="ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" containerID="dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c" exitCode=0
Jul 24 14:28:18.805190 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.805114    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"
Jul 24 14:28:18.805190 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.805156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428" event={"ID":"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8","Type":"ContainerDied","Data":"dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c"}
Jul 24 14:28:18.805300 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.805212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428" event={"ID":"ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8","Type":"ContainerDied","Data":"2d983781d7eb36aeff7a1a1672037211567aa89c33fca0607ae36b2e9114eb23"}
Jul 24 14:28:18.806754 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.806731    2563 generic.go:356] "Generic (PLEG): container finished" podID="876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" containerID="6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b" exitCode=0
Jul 24 14:28:18.806903 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.806761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q" event={"ID":"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6","Type":"ContainerDied","Data":"6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b"}
Jul 24 14:28:18.806903 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.806781    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"
Jul 24 14:28:18.806903 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.806808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q" event={"ID":"876773f0-e0f8-48d5-a0a1-8cdc71d3fef6","Type":"ContainerDied","Data":"f411eed6117ba3455d42decbbcf7f6f87b8038dcbd4c19e6eee8d4583d04f9ba"}
Jul 24 14:28:18.815001 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.814979    2563 scope.go:117] "RemoveContainer" containerID="c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c"
Jul 24 14:28:18.815283 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:28:18.815264    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c\": container with ID starting with c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c not found: ID does not exist" containerID="c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c"
Jul 24 14:28:18.815350 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.815293    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c"} err="failed to get container status \"c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c\": rpc error: code = NotFound desc = could not find container \"c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c\": container with ID starting with c743989ff5fbae2a05b112efcd3a0cf28e0928d49e1d70637db4598f01ab3b0c not found: ID does not exist"
Jul 24 14:28:18.815350 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.815310    2563 scope.go:117] "RemoveContainer" containerID="dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c"
Jul 24 14:28:18.824049 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.824035    2563 scope.go:117] "RemoveContainer" containerID="dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c"
Jul 24 14:28:18.824277 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:28:18.824261    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c\": container with ID starting with dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c not found: ID does not exist" containerID="dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c"
Jul 24 14:28:18.824320 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.824284    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c"} err="failed to get container status \"dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c\": rpc error: code = NotFound desc = could not find container \"dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c\": container with ID starting with dd47195ae892b44cf952eeb9593b765f11a7496e6299c4a27d9367020d06162c not found: ID does not exist"
Jul 24 14:28:18.824320 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.824299    2563 scope.go:117] "RemoveContainer" containerID="6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b"
Jul 24 14:28:18.832741 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.832719    2563 scope.go:117] "RemoveContainer" containerID="6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b"
Jul 24 14:28:18.832857 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.832796    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"]
Jul 24 14:28:18.833021 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:28:18.833003    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b\": container with ID starting with 6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b not found: ID does not exist" containerID="6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b"
Jul 24 14:28:18.833071 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.833027    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b"} err="failed to get container status \"6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b\": rpc error: code = NotFound desc = could not find container \"6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b\": container with ID starting with 6621c58f11feac100b10a547070ef2a33f237ec417b3334dd263cbaa4c95913b not found: ID does not exist"
Jul 24 14:28:18.839106 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.839088    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7d231-b8f4f87d-7hzrx"]
Jul 24 14:28:18.851333 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.851315    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"]
Jul 24 14:28:18.872067 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.872041    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4844daa2-6c0b-4e35-9c43-f108aab0db26" path="/var/lib/kubelet/pods/4844daa2-6c0b-4e35-9c43-f108aab0db26/volumes"
Jul 24 14:28:18.872360 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.872343    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e7d231-6bb47d5984-xm428"]
Jul 24 14:28:18.873051 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.873030    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"]
Jul 24 14:28:18.877639 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:18.877618    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e7d231-fff85b57b-r467q"]
Jul 24 14:28:20.865049 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:20.865019    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" path="/var/lib/kubelet/pods/876773f0-e0f8-48d5-a0a1-8cdc71d3fef6/volumes"
Jul 24 14:28:20.865400 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:20.865367    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" path="/var/lib/kubelet/pods/ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8/volumes"
Jul 24 14:28:46.790184 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.790084    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"]
Jul 24 14:28:46.790730 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.790343    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7" podUID="8d8ffb13-c7d8-475d-b691-e456c3f97aad" containerName="maas-api" containerID="cri-o://c2f16899caa7582e227802d2441d10adbac9cf5b6edaab3b35af4e12037a58af" gracePeriod=30
Jul 24 14:28:46.850745 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.850706    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"]
Jul 24 14:28:46.851050 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.851021    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc" podUID="2d349feb-f634-403c-9e09-4f991fecc4bb" containerName="payload-processing" containerID="cri-o://7ab2c0d50141b39418e96be3696767c4d0d962c04aba14226ff55a4126365638" gracePeriod=30
Jul 24 14:28:46.971899 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.971866    2563 generic.go:356] "Generic (PLEG): container finished" podID="2d349feb-f634-403c-9e09-4f991fecc4bb" containerID="7ab2c0d50141b39418e96be3696767c4d0d962c04aba14226ff55a4126365638" exitCode=0
Jul 24 14:28:46.972022 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.971949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc" event={"ID":"2d349feb-f634-403c-9e09-4f991fecc4bb","Type":"ContainerDied","Data":"7ab2c0d50141b39418e96be3696767c4d0d962c04aba14226ff55a4126365638"}
Jul 24 14:28:46.973667 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.973646    2563 generic.go:356] "Generic (PLEG): container finished" podID="8d8ffb13-c7d8-475d-b691-e456c3f97aad" containerID="c2f16899caa7582e227802d2441d10adbac9cf5b6edaab3b35af4e12037a58af" exitCode=0
Jul 24 14:28:46.973761 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:46.973690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7" event={"ID":"8d8ffb13-c7d8-475d-b691-e456c3f97aad","Type":"ContainerDied","Data":"c2f16899caa7582e227802d2441d10adbac9cf5b6edaab3b35af4e12037a58af"}
Jul 24 14:28:47.099196 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.099173    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:28:47.129047 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.129016    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:28:47.180789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.180750    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls\") pod \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") "
Jul 24 14:28:47.180985 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.180808    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8ffb13-c7d8-475d-b691-e456c3f97aad-openshift-service-ca\") pod \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") "
Jul 24 14:28:47.180985 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.180966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmmw2\" (UniqueName: \"kubernetes.io/projected/8d8ffb13-c7d8-475d-b691-e456c3f97aad-kube-api-access-mmmw2\") pod \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\" (UID: \"8d8ffb13-c7d8-475d-b691-e456c3f97aad\") "
Jul 24 14:28:47.181207 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.181180    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8ffb13-c7d8-475d-b691-e456c3f97aad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8d8ffb13-c7d8-475d-b691-e456c3f97aad" (UID: "8d8ffb13-c7d8-475d-b691-e456c3f97aad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:47.182929 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.182907    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8d8ffb13-c7d8-475d-b691-e456c3f97aad" (UID: "8d8ffb13-c7d8-475d-b691-e456c3f97aad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:47.183081 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.183062    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8ffb13-c7d8-475d-b691-e456c3f97aad-kube-api-access-mmmw2" (OuterVolumeSpecName: "kube-api-access-mmmw2") pod "8d8ffb13-c7d8-475d-b691-e456c3f97aad" (UID: "8d8ffb13-c7d8-475d-b691-e456c3f97aad"). InnerVolumeSpecName "kube-api-access-mmmw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:47.282162 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.282133    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d349feb-f634-403c-9e09-4f991fecc4bb-plugins-config-volume\") pod \"2d349feb-f634-403c-9e09-4f991fecc4bb\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") "
Jul 24 14:28:47.282350 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.282189    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7np2\" (UniqueName: \"kubernetes.io/projected/2d349feb-f634-403c-9e09-4f991fecc4bb-kube-api-access-p7np2\") pod \"2d349feb-f634-403c-9e09-4f991fecc4bb\" (UID: \"2d349feb-f634-403c-9e09-4f991fecc4bb\") "
Jul 24 14:28:47.282430 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.282382    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8ffb13-c7d8-475d-b691-e456c3f97aad-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:47.282430 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.282395    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmmw2\" (UniqueName: \"kubernetes.io/projected/8d8ffb13-c7d8-475d-b691-e456c3f97aad-kube-api-access-mmmw2\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:47.282430 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.282405    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8ffb13-c7d8-475d-b691-e456c3f97aad-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:47.282576 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.282470    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d349feb-f634-403c-9e09-4f991fecc4bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d349feb-f634-403c-9e09-4f991fecc4bb" (UID: "2d349feb-f634-403c-9e09-4f991fecc4bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:47.284477 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.284455    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d349feb-f634-403c-9e09-4f991fecc4bb-kube-api-access-p7np2" (OuterVolumeSpecName: "kube-api-access-p7np2") pod "2d349feb-f634-403c-9e09-4f991fecc4bb" (UID: "2d349feb-f634-403c-9e09-4f991fecc4bb"). InnerVolumeSpecName "kube-api-access-p7np2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:47.383906 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.383775    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d349feb-f634-403c-9e09-4f991fecc4bb-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:47.383906 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.383875    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7np2\" (UniqueName: \"kubernetes.io/projected/2d349feb-f634-403c-9e09-4f991fecc4bb-kube-api-access-p7np2\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:28:47.979878 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.979843    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"
Jul 24 14:28:47.979878 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.979867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7" event={"ID":"8d8ffb13-c7d8-475d-b691-e456c3f97aad","Type":"ContainerDied","Data":"218612d68830ee2beaeaa7ad67f0b9aceab1c6fab9cd7664e34cef6a333ff2e3"}
Jul 24 14:28:47.980424 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.979932    2563 scope.go:117] "RemoveContainer" containerID="c2f16899caa7582e227802d2441d10adbac9cf5b6edaab3b35af4e12037a58af"
Jul 24 14:28:47.981340 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.981181    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"
Jul 24 14:28:47.981340 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.981243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc" event={"ID":"2d349feb-f634-403c-9e09-4f991fecc4bb","Type":"ContainerDied","Data":"90fb99507c5c554bfa8a96704feed1a21fe448df3505f6226812aaf28223dda8"}
Jul 24 14:28:47.990530 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:47.990515    2563 scope.go:117] "RemoveContainer" containerID="7ab2c0d50141b39418e96be3696767c4d0d962c04aba14226ff55a4126365638"
Jul 24 14:28:48.009261 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:48.009235    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"]
Jul 24 14:28:48.014083 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:48.014062    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-45b6b7-5d448c8b7f-5jst7"]
Jul 24 14:28:48.025400 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:48.025378    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"]
Jul 24 14:28:48.034111 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:48.034091    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-45b6b7-68fdd9bc74-2pwzc"]
Jul 24 14:28:48.864370 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:48.864337    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d349feb-f634-403c-9e09-4f991fecc4bb" path="/var/lib/kubelet/pods/2d349feb-f634-403c-9e09-4f991fecc4bb/volumes"
Jul 24 14:28:48.864718 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:28:48.864706    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d8ffb13-c7d8-475d-b691-e456c3f97aad" path="/var/lib/kubelet/pods/8d8ffb13-c7d8-475d-b691-e456c3f97aad/volumes"
Jul 24 14:29:01.667184 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667146    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"]
Jul 24 14:29:01.667737 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667720    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4844daa2-6c0b-4e35-9c43-f108aab0db26" containerName="maas-api"
Jul 24 14:29:01.667789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667742    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4844daa2-6c0b-4e35-9c43-f108aab0db26" containerName="maas-api"
Jul 24 14:29:01.667789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667756    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d8ffb13-c7d8-475d-b691-e456c3f97aad" containerName="maas-api"
Jul 24 14:29:01.667789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667766    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d8ffb13-c7d8-475d-b691-e456c3f97aad" containerName="maas-api"
Jul 24 14:29:01.667789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667785    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" containerName="payload-processing"
Jul 24 14:29:01.667961 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667795    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" containerName="payload-processing"
Jul 24 14:29:01.667961 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667830    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" containerName="payload-pre-processing"
Jul 24 14:29:01.667961 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667840    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" containerName="payload-pre-processing"
Jul 24 14:29:01.667961 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667854    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d349feb-f634-403c-9e09-4f991fecc4bb" containerName="payload-processing"
Jul 24 14:29:01.667961 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667862    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d349feb-f634-403c-9e09-4f991fecc4bb" containerName="payload-processing"
Jul 24 14:29:01.668107 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667987    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="876773f0-e0f8-48d5-a0a1-8cdc71d3fef6" containerName="payload-pre-processing"
Jul 24 14:29:01.668107 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.667999    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d8ffb13-c7d8-475d-b691-e456c3f97aad" containerName="maas-api"
Jul 24 14:29:01.668107 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.668011    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d349feb-f634-403c-9e09-4f991fecc4bb" containerName="payload-processing"
Jul 24 14:29:01.668107 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.668021    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff4746e1-3b43-49bc-87b4-cdfc5cde1bd8" containerName="payload-processing"
Jul 24 14:29:01.668107 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.668031    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4844daa2-6c0b-4e35-9c43-f108aab0db26" containerName="maas-api"
Jul 24 14:29:01.671482 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.671466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.674439 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.674417    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-94af13-serving-cert\""
Jul 24 14:29:01.684297 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.684272    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"]
Jul 24 14:29:01.707496 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.707466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ndtk\" (UniqueName: \"kubernetes.io/projected/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-kube-api-access-8ndtk\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.707637 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.707521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.707685 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.707633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.808199 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.808163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.808454 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.808226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ndtk\" (UniqueName: \"kubernetes.io/projected/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-kube-api-access-8ndtk\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.808454 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.808266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.808454 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:29:01.808314    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-serving-cert: secret "maas-api-e2e-shared-a-94af13-serving-cert" not found
Jul 24 14:29:01.808454 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:29:01.808414    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls podName:3e953fd4-5f27-44d5-b5db-6e8ee7978b4b nodeName:}" failed. No retries permitted until 2026-07-24 14:29:02.308397398 +0000 UTC m=+2621.969230535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls") pod "maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl" (UID: "3e953fd4-5f27-44d5-b5db-6e8ee7978b4b") : secret "maas-api-e2e-shared-a-94af13-serving-cert" not found
Jul 24 14:29:01.808983 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.808965    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:01.817519 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:01.817498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ndtk\" (UniqueName: \"kubernetes.io/projected/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-kube-api-access-8ndtk\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:02.312609 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.312574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:02.315341 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.315313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls\") pod \"maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:02.512448 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.512415    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"]
Jul 24 14:29:02.516479 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.516461    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.519083 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.519059    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-94af13\""
Jul 24 14:29:02.519250 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.519229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-94af13-dockercfg-hf9f7\""
Jul 24 14:29:02.528487 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.528465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"]
Jul 24 14:29:02.585130 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.585035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:02.620375 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.615840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.620375 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.615976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggbjl\" (UniqueName: \"kubernetes.io/projected/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-kube-api-access-ggbjl\") pod \"payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.716535 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.716499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.716960 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.716599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggbjl\" (UniqueName: \"kubernetes.io/projected/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-kube-api-access-ggbjl\") pod \"payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.717329 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.717304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.730180 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.730148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggbjl\" (UniqueName: \"kubernetes.io/projected/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-kube-api-access-ggbjl\") pod \"payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.761732 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.761698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"]
Jul 24 14:29:02.764220 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:29:02.764191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e953fd4_5f27_44d5_b5db_6e8ee7978b4b.slice/crio-911f62ff858a145103017bd987d2ef4610521e6a10ea0b61fe5c71303343f149 WatchSource:0}: Error finding container 911f62ff858a145103017bd987d2ef4610521e6a10ea0b61fe5c71303343f149: Status 404 returned error can't find the container with id 911f62ff858a145103017bd987d2ef4610521e6a10ea0b61fe5c71303343f149
Jul 24 14:29:02.826478 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.826448    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:02.976952 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:02.976913    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"]
Jul 24 14:29:02.980647 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:29:02.980615    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbcd9e2_b9b6_4364_80ee_5373dbbf209d.slice/crio-90930fa37edea4a1d8bb018145e9633b9f236f5a5012c2f447179a3e397bb458 WatchSource:0}: Error finding container 90930fa37edea4a1d8bb018145e9633b9f236f5a5012c2f447179a3e397bb458: Status 404 returned error can't find the container with id 90930fa37edea4a1d8bb018145e9633b9f236f5a5012c2f447179a3e397bb458
Jul 24 14:29:03.075263 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:03.075231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl" event={"ID":"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b","Type":"ContainerStarted","Data":"911f62ff858a145103017bd987d2ef4610521e6a10ea0b61fe5c71303343f149"}
Jul 24 14:29:03.076781 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:03.076757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b" event={"ID":"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d","Type":"ContainerStarted","Data":"cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07"}
Jul 24 14:29:03.076902 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:03.076804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b" event={"ID":"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d","Type":"ContainerStarted","Data":"90930fa37edea4a1d8bb018145e9633b9f236f5a5012c2f447179a3e397bb458"}
Jul 24 14:29:03.076902 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:03.076858    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:03.098749 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:03.098639    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b" podStartSLOduration=1.098621691 podStartE2EDuration="1.098621691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:03.09568433 +0000 UTC m=+2622.756517492" watchObservedRunningTime="2026-07-24 14:29:03.098621691 +0000 UTC m=+2622.759454851"
Jul 24 14:29:04.083348 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:04.083306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl" event={"ID":"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b","Type":"ContainerStarted","Data":"805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce"}
Jul 24 14:29:05.089236 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:05.089202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:09.544992 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.544927    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl" podStartSLOduration=8.043605447 podStartE2EDuration="8.544901111s" totalImagesPullingTime="501.295664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:04.144736495 +0000 UTC m=+2623.805569653" watchObservedRunningTime="2026-07-24 14:29:09.544901111 +0000 UTC m=+2629.205734294"
Jul 24 14:29:09.547598 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.547574    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"]
Jul 24 14:29:09.551807 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.551784    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.554695 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.554673    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-938af8-serving-cert\""
Jul 24 14:29:09.563375 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.563355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"]
Jul 24 14:29:09.569401 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.569381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.569500 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.569443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.569500 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.569468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxwtf\" (UniqueName: \"kubernetes.io/projected/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-kube-api-access-xxwtf\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.670188 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.670156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.670344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.670199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxwtf\" (UniqueName: \"kubernetes.io/projected/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-kube-api-access-xxwtf\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.670344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.670259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.670440 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:29:09.670396    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-serving-cert: secret "maas-api-e2e-shared-b-938af8-serving-cert" not found
Jul 24 14:29:09.670482 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:29:09.670455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls podName:ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce nodeName:}" failed. No retries permitted until 2026-07-24 14:29:10.170437768 +0000 UTC m=+2629.831270905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls") pod "maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf" (UID: "ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce") : secret "maas-api-e2e-shared-b-938af8-serving-cert" not found
Jul 24 14:29:09.670915 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.670898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:09.679379 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:09.679348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxwtf\" (UniqueName: \"kubernetes.io/projected/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-kube-api-access-xxwtf\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:10.174645 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.174612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:10.177362 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.177331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:10.416598 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.416566    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"]
Jul 24 14:29:10.420312 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.420292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.422728 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.422700    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-938af8\""
Jul 24 14:29:10.439078 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.439053    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"]
Jul 24 14:29:10.465145 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.465123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:10.470264 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.470242    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"]
Jul 24 14:29:10.473606 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.473590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.476214 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.476196    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-938af8-dockercfg-g8cjb\""
Jul 24 14:29:10.477559 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.477537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7r9f\" (UniqueName: \"kubernetes.io/projected/0e721040-a379-4c2f-a67e-c1c42f512f61-kube-api-access-p7r9f\") pod \"payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.477669 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.477573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e721040-a379-4c2f-a67e-c1c42f512f61-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.492665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.492633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"]
Jul 24 14:29:10.578573 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.578537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7r9f\" (UniqueName: \"kubernetes.io/projected/0e721040-a379-4c2f-a67e-c1c42f512f61-kube-api-access-p7r9f\") pod \"payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.578934 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.578597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzmj\" (UniqueName: \"kubernetes.io/projected/bcdad442-d3eb-4479-a274-71921a5ef6fb-kube-api-access-mpzmj\") pod \"payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.578934 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.578636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e721040-a379-4c2f-a67e-c1c42f512f61-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.578934 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.578679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcdad442-d3eb-4479-a274-71921a5ef6fb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.579487 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.579454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e721040-a379-4c2f-a67e-c1c42f512f61-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.591548 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.591524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7r9f\" (UniqueName: \"kubernetes.io/projected/0e721040-a379-4c2f-a67e-c1c42f512f61-kube-api-access-p7r9f\") pod \"payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.622781 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.622754    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"]
Jul 24 14:29:10.624155 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:29:10.624125    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3cbdab_4f36_49f5_b5e8_9b702e6da7ce.slice/crio-9c74bb4110c5ed433b68f68f93716aa71f513cabd738f9c476d2440f0d98032b WatchSource:0}: Error finding container 9c74bb4110c5ed433b68f68f93716aa71f513cabd738f9c476d2440f0d98032b: Status 404 returned error can't find the container with id 9c74bb4110c5ed433b68f68f93716aa71f513cabd738f9c476d2440f0d98032b
Jul 24 14:29:10.679750 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.679661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzmj\" (UniqueName: \"kubernetes.io/projected/bcdad442-d3eb-4479-a274-71921a5ef6fb-kube-api-access-mpzmj\") pod \"payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.679750 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.679715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcdad442-d3eb-4479-a274-71921a5ef6fb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.680510 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.680490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcdad442-d3eb-4479-a274-71921a5ef6fb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.689663 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.689634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzmj\" (UniqueName: \"kubernetes.io/projected/bcdad442-d3eb-4479-a274-71921a5ef6fb-kube-api-access-mpzmj\") pod \"payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.731216 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.731180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:10.802987 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.802951    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:10.879950 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.879921    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"]
Jul 24 14:29:10.882517 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:29:10.882489    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e721040_a379_4c2f_a67e_c1c42f512f61.slice/crio-61b3ed59837412c53d3d3e1b0c110921bf5ab0f1e6d5e9743a5ebc65285da813 WatchSource:0}: Error finding container 61b3ed59837412c53d3d3e1b0c110921bf5ab0f1e6d5e9743a5ebc65285da813: Status 404 returned error can't find the container with id 61b3ed59837412c53d3d3e1b0c110921bf5ab0f1e6d5e9743a5ebc65285da813
Jul 24 14:29:10.962727 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:10.962702    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"]
Jul 24 14:29:10.964979 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:29:10.964957    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdad442_d3eb_4479_a274_71921a5ef6fb.slice/crio-1a3c85bc85af54b971640f65906d835c6a2296253d65b55a09b52fd55135b38a WatchSource:0}: Error finding container 1a3c85bc85af54b971640f65906d835c6a2296253d65b55a09b52fd55135b38a: Status 404 returned error can't find the container with id 1a3c85bc85af54b971640f65906d835c6a2296253d65b55a09b52fd55135b38a
Jul 24 14:29:11.100715 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.100692    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:29:11.124620 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.124579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf" event={"ID":"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce","Type":"ContainerStarted","Data":"60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59"}
Jul 24 14:29:11.124778 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.124640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf" event={"ID":"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce","Type":"ContainerStarted","Data":"9c74bb4110c5ed433b68f68f93716aa71f513cabd738f9c476d2440f0d98032b"}
Jul 24 14:29:11.124778 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.124685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:11.126294 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.126270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5" event={"ID":"bcdad442-d3eb-4479-a274-71921a5ef6fb","Type":"ContainerStarted","Data":"0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc"}
Jul 24 14:29:11.126410 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.126322    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:29:11.126410 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.126344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5" event={"ID":"bcdad442-d3eb-4479-a274-71921a5ef6fb","Type":"ContainerStarted","Data":"1a3c85bc85af54b971640f65906d835c6a2296253d65b55a09b52fd55135b38a"}
Jul 24 14:29:11.127721 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.127700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h" event={"ID":"0e721040-a379-4c2f-a67e-c1c42f512f61","Type":"ContainerStarted","Data":"f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086"}
Jul 24 14:29:11.127829 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.127736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h" event={"ID":"0e721040-a379-4c2f-a67e-c1c42f512f61","Type":"ContainerStarted","Data":"61b3ed59837412c53d3d3e1b0c110921bf5ab0f1e6d5e9743a5ebc65285da813"}
Jul 24 14:29:11.127829 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.127767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:11.212218 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.212120    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h" podStartSLOduration=1.21210269 podStartE2EDuration="1.21210269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:11.210889673 +0000 UTC m=+2630.871722834" watchObservedRunningTime="2026-07-24 14:29:11.21210269 +0000 UTC m=+2630.872935826"
Jul 24 14:29:11.289064 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.289000    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5" podStartSLOduration=1.288983059 podStartE2EDuration="1.288983059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:11.28568594 +0000 UTC m=+2630.946519101" watchObservedRunningTime="2026-07-24 14:29:11.288983059 +0000 UTC m=+2630.949816217"
Jul 24 14:29:11.336708 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:11.336653    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf" podStartSLOduration=1.939529683 podStartE2EDuration="2.336635774s" totalImagesPullingTime="397.106091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:11.33186568 +0000 UTC m=+2630.992698836" watchObservedRunningTime="2026-07-24 14:29:11.336635774 +0000 UTC m=+2630.997468933"
Jul 24 14:29:14.085438 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:14.085407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:29:17.140581 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:17.140554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:29:21.097576 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:21.097542    2563 scope.go:117] "RemoveContainer" containerID="2bc047d461228504dcd5d52affa8f638b0c3c9dce9d1c8226368fd4005b84750"
Jul 24 14:29:22.136611 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:22.136577    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:29:22.137110 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:29:22.136883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:30:00.137453 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:00.137414    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"]
Jul 24 14:30:00.141022 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:00.141004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"
Jul 24 14:30:00.143574 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:00.143555    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:30:00.151372 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:00.151354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"
Jul 24 14:30:00.163186 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:00.163159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"]
Jul 24 14:30:00.295647 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:00.295620    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"]
Jul 24 14:30:00.297215 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:30:00.297184    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9efa85b2_986f_4fe8_8cff_9b41b0902424.slice/crio-1b6aabe57f43646dd29b6d4e56328de1211eb8bce99a58761189de2a8cb729e2 WatchSource:0}: Error finding container 1b6aabe57f43646dd29b6d4e56328de1211eb8bce99a58761189de2a8cb729e2: Status 404 returned error can't find the container with id 1b6aabe57f43646dd29b6d4e56328de1211eb8bce99a58761189de2a8cb729e2
Jul 24 14:30:00.404598 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:00.404491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s" event={"ID":"9efa85b2-986f-4fe8-8cff-9b41b0902424","Type":"ContainerStarted","Data":"1b6aabe57f43646dd29b6d4e56328de1211eb8bce99a58761189de2a8cb729e2"}
Jul 24 14:30:01.411673 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:01.411575    2563 generic.go:356] "Generic (PLEG): container finished" podID="9efa85b2-986f-4fe8-8cff-9b41b0902424" containerID="370d79ac666e37a23db868649a3f41ddc622da4d0e3d1fa3386053379de75579" exitCode=0
Jul 24 14:30:01.412105 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:01.411673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s" event={"ID":"9efa85b2-986f-4fe8-8cff-9b41b0902424","Type":"ContainerDied","Data":"370d79ac666e37a23db868649a3f41ddc622da4d0e3d1fa3386053379de75579"}
Jul 24 14:30:02.560584 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:02.560559    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"
Jul 24 14:30:03.424334 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:03.424302    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"
Jul 24 14:30:03.424541 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:03.424333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s" event={"ID":"9efa85b2-986f-4fe8-8cff-9b41b0902424","Type":"ContainerDied","Data":"1b6aabe57f43646dd29b6d4e56328de1211eb8bce99a58761189de2a8cb729e2"}
Jul 24 14:30:03.424541 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:30:03.424404    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b6aabe57f43646dd29b6d4e56328de1211eb8bce99a58761189de2a8cb729e2"
Jul 24 14:35:30.441728 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.441693    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"]
Jul 24 14:35:30.442314 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.442275    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9efa85b2-986f-4fe8-8cff-9b41b0902424" containerName="cleanup"
Jul 24 14:35:30.442314 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.442293    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9efa85b2-986f-4fe8-8cff-9b41b0902424" containerName="cleanup"
Jul 24 14:35:30.442432 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.442384    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9efa85b2-986f-4fe8-8cff-9b41b0902424" containerName="cleanup"
Jul 24 14:35:30.445504 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.445484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.450052 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.450031    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-106097-serving-cert\""
Jul 24 14:35:30.461933 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.461903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"]
Jul 24 14:35:30.558424 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.558384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f4c6b1-6476-4043-93cf-76bd4a371148-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.558607 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.558491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f4c6b1-6476-4043-93cf-76bd4a371148-maas-api-tls\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.558607 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.558585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42vv4\" (UniqueName: \"kubernetes.io/projected/f5f4c6b1-6476-4043-93cf-76bd4a371148-kube-api-access-42vv4\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.659272 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.659238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f4c6b1-6476-4043-93cf-76bd4a371148-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.659495 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.659301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f4c6b1-6476-4043-93cf-76bd4a371148-maas-api-tls\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.659495 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.659346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42vv4\" (UniqueName: \"kubernetes.io/projected/f5f4c6b1-6476-4043-93cf-76bd4a371148-kube-api-access-42vv4\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.659996 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.659972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f4c6b1-6476-4043-93cf-76bd4a371148-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.661886 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.661866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f4c6b1-6476-4043-93cf-76bd4a371148-maas-api-tls\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.668635 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.668612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42vv4\" (UniqueName: \"kubernetes.io/projected/f5f4c6b1-6476-4043-93cf-76bd4a371148-kube-api-access-42vv4\") pod \"maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.755873 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.755807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:30.913265 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.913237    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"]
Jul 24 14:35:30.914879 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:35:30.914803    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f4c6b1_6476_4043_93cf_76bd4a371148.slice/crio-7531879cdf271f3858cd0bad8bdf613b1aa7e03062fea5400bd7b2c8c5db03aa WatchSource:0}: Error finding container 7531879cdf271f3858cd0bad8bdf613b1aa7e03062fea5400bd7b2c8c5db03aa: Status 404 returned error can't find the container with id 7531879cdf271f3858cd0bad8bdf613b1aa7e03062fea5400bd7b2c8c5db03aa
Jul 24 14:35:30.916515 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:30.916496    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:35:31.257461 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.257426    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c" event={"ID":"f5f4c6b1-6476-4043-93cf-76bd4a371148","Type":"ContainerStarted","Data":"7531879cdf271f3858cd0bad8bdf613b1aa7e03062fea5400bd7b2c8c5db03aa"}
Jul 24 14:35:31.275272 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.275239    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"]
Jul 24 14:35:31.280348 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.280327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.283228 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.283146    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-106097\""
Jul 24 14:35:31.291559 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.291536    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"]
Jul 24 14:35:31.295764 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.295746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"]
Jul 24 14:35:31.295875 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.295841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.298300 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.298281    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-106097-dockercfg-jk94t\""
Jul 24 14:35:31.309767 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.309742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"]
Jul 24 14:35:31.365870 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.365834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76nxk\" (UniqueName: \"kubernetes.io/projected/8c7318c9-0099-4781-a47b-f56df3246d68-kube-api-access-76nxk\") pod \"payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.366052 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.365890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be764454-c672-4f72-953e-356ecbcf0b79-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-106097-8595d46896-jz46n\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.366052 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.365917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj5fp\" (UniqueName: \"kubernetes.io/projected/be764454-c672-4f72-953e-356ecbcf0b79-kube-api-access-bj5fp\") pod \"payload-processing-e2e-ipp-a-106097-8595d46896-jz46n\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.366052 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.365982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c7318c9-0099-4781-a47b-f56df3246d68-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.466804 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.466765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76nxk\" (UniqueName: \"kubernetes.io/projected/8c7318c9-0099-4781-a47b-f56df3246d68-kube-api-access-76nxk\") pod \"payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.467310 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.466860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be764454-c672-4f72-953e-356ecbcf0b79-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-106097-8595d46896-jz46n\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.467310 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.466905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj5fp\" (UniqueName: \"kubernetes.io/projected/be764454-c672-4f72-953e-356ecbcf0b79-kube-api-access-bj5fp\") pod \"payload-processing-e2e-ipp-a-106097-8595d46896-jz46n\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.467310 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.466963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c7318c9-0099-4781-a47b-f56df3246d68-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.467565 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.467544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be764454-c672-4f72-953e-356ecbcf0b79-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-106097-8595d46896-jz46n\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.467848 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.467798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c7318c9-0099-4781-a47b-f56df3246d68-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.475437 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.475405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj5fp\" (UniqueName: \"kubernetes.io/projected/be764454-c672-4f72-953e-356ecbcf0b79-kube-api-access-bj5fp\") pod \"payload-processing-e2e-ipp-a-106097-8595d46896-jz46n\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.475527 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.475497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76nxk\" (UniqueName: \"kubernetes.io/projected/8c7318c9-0099-4781-a47b-f56df3246d68-kube-api-access-76nxk\") pod \"payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.594857 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.594834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:31.607908 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.607884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:31.782559 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.782535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"]
Jul 24 14:35:31.784325 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:35:31.784298    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7318c9_0099_4781_a47b_f56df3246d68.slice/crio-22267cfa58dc5e75867f74147913097fb5cbde9c1565df47e8f8dd3355a1e716 WatchSource:0}: Error finding container 22267cfa58dc5e75867f74147913097fb5cbde9c1565df47e8f8dd3355a1e716: Status 404 returned error can't find the container with id 22267cfa58dc5e75867f74147913097fb5cbde9c1565df47e8f8dd3355a1e716
Jul 24 14:35:31.963629 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:31.963600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"]
Jul 24 14:35:31.964930 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:35:31.964899    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe764454_c672_4f72_953e_356ecbcf0b79.slice/crio-a81841f202d92651e7c58283b6894d5b4585060e16ebbb9f78dab2f72c049c0d WatchSource:0}: Error finding container a81841f202d92651e7c58283b6894d5b4585060e16ebbb9f78dab2f72c049c0d: Status 404 returned error can't find the container with id a81841f202d92651e7c58283b6894d5b4585060e16ebbb9f78dab2f72c049c0d
Jul 24 14:35:32.264405 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.264371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c" event={"ID":"f5f4c6b1-6476-4043-93cf-76bd4a371148","Type":"ContainerStarted","Data":"c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2"}
Jul 24 14:35:32.264604 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.264456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:32.266356 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.266328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n" event={"ID":"be764454-c672-4f72-953e-356ecbcf0b79","Type":"ContainerStarted","Data":"428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071"}
Jul 24 14:35:32.266505 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.266381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n" event={"ID":"be764454-c672-4f72-953e-356ecbcf0b79","Type":"ContainerStarted","Data":"a81841f202d92651e7c58283b6894d5b4585060e16ebbb9f78dab2f72c049c0d"}
Jul 24 14:35:32.266505 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.266411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:32.267983 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.267960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn" event={"ID":"8c7318c9-0099-4781-a47b-f56df3246d68","Type":"ContainerStarted","Data":"7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6"}
Jul 24 14:35:32.268072 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.267998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn" event={"ID":"8c7318c9-0099-4781-a47b-f56df3246d68","Type":"ContainerStarted","Data":"22267cfa58dc5e75867f74147913097fb5cbde9c1565df47e8f8dd3355a1e716"}
Jul 24 14:35:32.268072 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.268016    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:35:32.284440 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.284386    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c" podStartSLOduration=1.661104683 podStartE2EDuration="2.284368627s" totalImagesPullingTime="623.263944ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:32.282082257 +0000 UTC m=+3011.942915440" watchObservedRunningTime="2026-07-24 14:35:32.284368627 +0000 UTC m=+3011.945201787"
Jul 24 14:35:32.303830 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.303758    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn" podStartSLOduration=1.303736385 podStartE2EDuration="1.303736385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:32.300857594 +0000 UTC m=+3011.961690774" watchObservedRunningTime="2026-07-24 14:35:32.303736385 +0000 UTC m=+3011.964569550"
Jul 24 14:35:32.319248 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:32.319195    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n" podStartSLOduration=1.319178813 podStartE2EDuration="1.319178813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:32.318952767 +0000 UTC m=+3011.979785943" watchObservedRunningTime="2026-07-24 14:35:32.319178813 +0000 UTC m=+3011.980011973"
Jul 24 14:35:38.278807 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:38.278778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:35:43.275781 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:43.275731    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn" podUID="8c7318c9-0099-4781-a47b-f56df3246d68" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.66:9004: connect: connection refused"
Jul 24 14:35:43.276265 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:43.276246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:35:53.274935 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:35:53.274902    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:36:00.282132 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.282094    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"]
Jul 24 14:36:00.285606 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.285579    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.288247 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.288219    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-fde43a\""
Jul 24 14:36:00.288502 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.288486    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-fde43a-dockercfg-lb74n\""
Jul 24 14:36:00.308029 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.308004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"]
Jul 24 14:36:00.316386 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.316360    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"]
Jul 24 14:36:00.319831 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.319795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.329076 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.328879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"]
Jul 24 14:36:00.340100 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.340071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e035709d-7532-43da-9d9f-4ff8b423aecc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.340215 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.340133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqp5h\" (UniqueName: \"kubernetes.io/projected/e035709d-7532-43da-9d9f-4ff8b423aecc-kube-api-access-nqp5h\") pod \"payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.441155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.441115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bb54885-b1ba-4f7f-a77c-745b029d7b51-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.441365 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.441203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-972r9\" (UniqueName: \"kubernetes.io/projected/7bb54885-b1ba-4f7f-a77c-745b029d7b51-kube-api-access-972r9\") pod \"payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.441495 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.441471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e035709d-7532-43da-9d9f-4ff8b423aecc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.441791 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.441761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqp5h\" (UniqueName: \"kubernetes.io/projected/e035709d-7532-43da-9d9f-4ff8b423aecc-kube-api-access-nqp5h\") pod \"payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.442553 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.442520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e035709d-7532-43da-9d9f-4ff8b423aecc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.452950 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.452923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqp5h\" (UniqueName: \"kubernetes.io/projected/e035709d-7532-43da-9d9f-4ff8b423aecc-kube-api-access-nqp5h\") pod \"payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.542724 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.542636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bb54885-b1ba-4f7f-a77c-745b029d7b51-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.542724 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.542694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-972r9\" (UniqueName: \"kubernetes.io/projected/7bb54885-b1ba-4f7f-a77c-745b029d7b51-kube-api-access-972r9\") pod \"payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.543429 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.543402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bb54885-b1ba-4f7f-a77c-745b029d7b51-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.550973 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.550948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-972r9\" (UniqueName: \"kubernetes.io/projected/7bb54885-b1ba-4f7f-a77c-745b029d7b51-kube-api-access-972r9\") pod \"payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.596844 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.596781    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:00.633078 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.633049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:00.753256 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.753219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"]
Jul 24 14:36:00.754763 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:36:00.754718    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode035709d_7532_43da_9d9f_4ff8b423aecc.slice/crio-938078742d3ec1c9e0a154f2991ee3e413f8e907d786a0bbbd4fe0d1c67032fb WatchSource:0}: Error finding container 938078742d3ec1c9e0a154f2991ee3e413f8e907d786a0bbbd4fe0d1c67032fb: Status 404 returned error can't find the container with id 938078742d3ec1c9e0a154f2991ee3e413f8e907d786a0bbbd4fe0d1c67032fb
Jul 24 14:36:00.796897 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:00.796868    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"]
Jul 24 14:36:00.805082 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:36:00.805054    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb54885_b1ba_4f7f_a77c_745b029d7b51.slice/crio-9dbeea7733be02b4360b664f0988278391d8bc7f3887c03cc639dfb3710984d8 WatchSource:0}: Error finding container 9dbeea7733be02b4360b664f0988278391d8bc7f3887c03cc639dfb3710984d8: Status 404 returned error can't find the container with id 9dbeea7733be02b4360b664f0988278391d8bc7f3887c03cc639dfb3710984d8
Jul 24 14:36:01.438451 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.438414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz" event={"ID":"7bb54885-b1ba-4f7f-a77c-745b029d7b51","Type":"ContainerStarted","Data":"94121d8b2d89c69f9c5cfe5adf91cda37fd45d6d2dd7967bd7bcf725a4a6967b"}
Jul 24 14:36:01.439065 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.438476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz" event={"ID":"7bb54885-b1ba-4f7f-a77c-745b029d7b51","Type":"ContainerStarted","Data":"9dbeea7733be02b4360b664f0988278391d8bc7f3887c03cc639dfb3710984d8"}
Jul 24 14:36:01.439065 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.438614    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:01.440225 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.440201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx" event={"ID":"e035709d-7532-43da-9d9f-4ff8b423aecc","Type":"ContainerStarted","Data":"46f967ded351600408721141235f233cc7ffc8bac2641ac0d32190b1c957e25a"}
Jul 24 14:36:01.440350 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.440237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx" event={"ID":"e035709d-7532-43da-9d9f-4ff8b423aecc","Type":"ContainerStarted","Data":"938078742d3ec1c9e0a154f2991ee3e413f8e907d786a0bbbd4fe0d1c67032fb"}
Jul 24 14:36:01.440350 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.440276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:01.455696 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.455648    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz" podStartSLOduration=1.455631331 podStartE2EDuration="1.455631331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:01.454639882 +0000 UTC m=+3041.115473042" watchObservedRunningTime="2026-07-24 14:36:01.455631331 +0000 UTC m=+3041.116464520"
Jul 24 14:36:01.471962 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:01.471910    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx" podStartSLOduration=1.471894249 podStartE2EDuration="1.471894249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:01.47027071 +0000 UTC m=+3041.131103869" watchObservedRunningTime="2026-07-24 14:36:01.471894249 +0000 UTC m=+3041.132727408"
Jul 24 14:36:12.447473 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:12.447378    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:36:12.447872 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:12.447527    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:36:21.560486 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:36:21.560454    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz_7bb54885-b1ba-4f7f-a77c-745b029d7b51/payload-processing/0.log"
Jul 24 14:37:00.291099 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:00.291064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-106097-8595d46896-jz46n_be764454-c672-4f72-953e-356ecbcf0b79/payload-processing/0.log"
Jul 24 14:37:00.549456 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:00.549371    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz_7bb54885-b1ba-4f7f-a77c-745b029d7b51/payload-processing/0.log"
Jul 24 14:37:04.882990 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.882960    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"]
Jul 24 14:37:04.886848 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.886808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:04.889222 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.889195    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-57f095-dockercfg-hcw7z\""
Jul 24 14:37:04.889337 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.889240    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-57f095\""
Jul 24 14:37:04.904662 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.896585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"]
Jul 24 14:37:04.942068 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.942040    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"]
Jul 24 14:37:04.945525 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.945505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:04.960207 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:04.960178    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"]
Jul 24 14:37:05.045094 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.045059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.045094 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.045104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57dc1f4b-aebc-4350-b32a-064f67561424-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.045325 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.045189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxjzl\" (UniqueName: \"kubernetes.io/projected/57dc1f4b-aebc-4350-b32a-064f67561424-kube-api-access-pxjzl\") pod \"payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.045325 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.045276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz69g\" (UniqueName: \"kubernetes.io/projected/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-kube-api-access-gz69g\") pod \"payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.146705 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.146603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz69g\" (UniqueName: \"kubernetes.io/projected/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-kube-api-access-gz69g\") pod \"payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.146705 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.146672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.146705 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.146697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57dc1f4b-aebc-4350-b32a-064f67561424-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.147041 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.146738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxjzl\" (UniqueName: \"kubernetes.io/projected/57dc1f4b-aebc-4350-b32a-064f67561424-kube-api-access-pxjzl\") pod \"payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.147691 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.147666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.147738 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.147666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57dc1f4b-aebc-4350-b32a-064f67561424-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.156730 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.156704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz69g\" (UniqueName: \"kubernetes.io/projected/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-kube-api-access-gz69g\") pod \"payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.158217 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.158194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxjzl\" (UniqueName: \"kubernetes.io/projected/57dc1f4b-aebc-4350-b32a-064f67561424-kube-api-access-pxjzl\") pod \"payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.205189 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.205155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.259629 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.259597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.564195 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.564169    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"]
Jul 24 14:37:05.566680 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:37:05.566650    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dc1f4b_aebc_4350_b32a_064f67561424.slice/crio-65472b7417702ed2214c48a1380796f2d589def579a20a5c31c295d25e7109ea WatchSource:0}: Error finding container 65472b7417702ed2214c48a1380796f2d589def579a20a5c31c295d25e7109ea: Status 404 returned error can't find the container with id 65472b7417702ed2214c48a1380796f2d589def579a20a5c31c295d25e7109ea
Jul 24 14:37:05.626723 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.626694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"]
Jul 24 14:37:05.629804 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:37:05.629778    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb6ac4d_dbb7_4c88_a5af_dd5e6d999784.slice/crio-c04c61e1eed4ce648bf097c366a95a4e7114be7d292357045bf14edc79d05910 WatchSource:0}: Error finding container c04c61e1eed4ce648bf097c366a95a4e7114be7d292357045bf14edc79d05910: Status 404 returned error can't find the container with id c04c61e1eed4ce648bf097c366a95a4e7114be7d292357045bf14edc79d05910
Jul 24 14:37:05.816168 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.816082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr" event={"ID":"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784","Type":"ContainerStarted","Data":"00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30"}
Jul 24 14:37:05.816168 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.816145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr" event={"ID":"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784","Type":"ContainerStarted","Data":"c04c61e1eed4ce648bf097c366a95a4e7114be7d292357045bf14edc79d05910"}
Jul 24 14:37:05.816403 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.816292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:05.817767 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.817745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5" event={"ID":"57dc1f4b-aebc-4350-b32a-064f67561424","Type":"ContainerStarted","Data":"f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672"}
Jul 24 14:37:05.817902 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.817792    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:05.817902 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.817843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5" event={"ID":"57dc1f4b-aebc-4350-b32a-064f67561424","Type":"ContainerStarted","Data":"65472b7417702ed2214c48a1380796f2d589def579a20a5c31c295d25e7109ea"}
Jul 24 14:37:05.837362 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.837308    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr" podStartSLOduration=1.837294317 podStartE2EDuration="1.837294317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:05.836749556 +0000 UTC m=+3105.497582717" watchObservedRunningTime="2026-07-24 14:37:05.837294317 +0000 UTC m=+3105.498127476"
Jul 24 14:37:05.857929 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:05.857875    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5" podStartSLOduration=1.857857935 podStartE2EDuration="1.857857935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:05.856735577 +0000 UTC m=+3105.517568764" watchObservedRunningTime="2026-07-24 14:37:05.857857935 +0000 UTC m=+3105.518691093"
Jul 24 14:37:16.826031 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:16.825990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:16.826517 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:16.826498    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:29.944907 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:29.944863    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"]
Jul 24 14:37:29.945442 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:29.945095    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr" podUID="fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" containerName="payload-processing" containerID="cri-o://00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30" gracePeriod=30
Jul 24 14:37:29.950889 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:29.950859    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"]
Jul 24 14:37:29.951121 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:29.951078    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5" podUID="57dc1f4b-aebc-4350-b32a-064f67561424" containerName="payload-pre-processing" containerID="cri-o://f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672" gracePeriod=30
Jul 24 14:37:30.214655 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.214630    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:30.245166 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.245148    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:30.264044 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.264015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz69g\" (UniqueName: \"kubernetes.io/projected/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-kube-api-access-gz69g\") pod \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") "
Jul 24 14:37:30.264196 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.264125    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-plugins-config-volume\") pod \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\" (UID: \"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784\") "
Jul 24 14:37:30.264196 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.264157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57dc1f4b-aebc-4350-b32a-064f67561424-plugins-config-volume\") pod \"57dc1f4b-aebc-4350-b32a-064f67561424\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") "
Jul 24 14:37:30.264324 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.264253    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxjzl\" (UniqueName: \"kubernetes.io/projected/57dc1f4b-aebc-4350-b32a-064f67561424-kube-api-access-pxjzl\") pod \"57dc1f4b-aebc-4350-b32a-064f67561424\" (UID: \"57dc1f4b-aebc-4350-b32a-064f67561424\") "
Jul 24 14:37:30.264748 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.264642    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" (UID: "fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:37:30.264748 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.264711    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57dc1f4b-aebc-4350-b32a-064f67561424-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57dc1f4b-aebc-4350-b32a-064f67561424" (UID: "57dc1f4b-aebc-4350-b32a-064f67561424"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:37:30.266345 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.266323    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-kube-api-access-gz69g" (OuterVolumeSpecName: "kube-api-access-gz69g") pod "fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" (UID: "fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784"). InnerVolumeSpecName "kube-api-access-gz69g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:37:30.266639 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.266619    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57dc1f4b-aebc-4350-b32a-064f67561424-kube-api-access-pxjzl" (OuterVolumeSpecName: "kube-api-access-pxjzl") pod "57dc1f4b-aebc-4350-b32a-064f67561424" (UID: "57dc1f4b-aebc-4350-b32a-064f67561424"). InnerVolumeSpecName "kube-api-access-pxjzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:37:30.365340 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.365301    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:37:30.365340 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.365335    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57dc1f4b-aebc-4350-b32a-064f67561424-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:37:30.365563 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.365349    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxjzl\" (UniqueName: \"kubernetes.io/projected/57dc1f4b-aebc-4350-b32a-064f67561424-kube-api-access-pxjzl\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:37:30.365563 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.365374    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz69g\" (UniqueName: \"kubernetes.io/projected/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784-kube-api-access-gz69g\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:37:30.968989 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.968954    2563 generic.go:356] "Generic (PLEG): container finished" podID="fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" containerID="00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30" exitCode=0
Jul 24 14:37:30.969394 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.968996    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"
Jul 24 14:37:30.969394 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.969042    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr" event={"ID":"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784","Type":"ContainerDied","Data":"00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30"}
Jul 24 14:37:30.969394 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.969093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr" event={"ID":"fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784","Type":"ContainerDied","Data":"c04c61e1eed4ce648bf097c366a95a4e7114be7d292357045bf14edc79d05910"}
Jul 24 14:37:30.969394 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.969124    2563 scope.go:117] "RemoveContainer" containerID="00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30"
Jul 24 14:37:30.970565 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.970549    2563 generic.go:356] "Generic (PLEG): container finished" podID="57dc1f4b-aebc-4350-b32a-064f67561424" containerID="f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672" exitCode=0
Jul 24 14:37:30.970637 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.970591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5" event={"ID":"57dc1f4b-aebc-4350-b32a-064f67561424","Type":"ContainerDied","Data":"f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672"}
Jul 24 14:37:30.970637 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.970611    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"
Jul 24 14:37:30.970637 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.970626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5" event={"ID":"57dc1f4b-aebc-4350-b32a-064f67561424","Type":"ContainerDied","Data":"65472b7417702ed2214c48a1380796f2d589def579a20a5c31c295d25e7109ea"}
Jul 24 14:37:30.978740 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.978719    2563 scope.go:117] "RemoveContainer" containerID="00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30"
Jul 24 14:37:30.978998 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:37:30.978978    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30\": container with ID starting with 00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30 not found: ID does not exist" containerID="00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30"
Jul 24 14:37:30.979062 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.979007    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30"} err="failed to get container status \"00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30\": rpc error: code = NotFound desc = could not find container \"00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30\": container with ID starting with 00238ae97c261c09e5386f46ec0224d94c512d470a2088f49f6cec818ad47b30 not found: ID does not exist"
Jul 24 14:37:30.979062 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.979035    2563 scope.go:117] "RemoveContainer" containerID="f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672"
Jul 24 14:37:30.987803 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.987778    2563 scope.go:117] "RemoveContainer" containerID="f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672"
Jul 24 14:37:30.988097 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:37:30.988078    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672\": container with ID starting with f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672 not found: ID does not exist" containerID="f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672"
Jul 24 14:37:30.988185 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.988104    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672"} err="failed to get container status \"f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672\": rpc error: code = NotFound desc = could not find container \"f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672\": container with ID starting with f6c1b99c053049414c44331ccfa72b45ba9d347b2522c42e0fc5eb0dce316672 not found: ID does not exist"
Jul 24 14:37:30.990176 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.990156    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"]
Jul 24 14:37:30.994209 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:30.994188    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-57f095-56654b7c8d-5ncf5"]
Jul 24 14:37:31.004864 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:31.004843    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"]
Jul 24 14:37:31.008987 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:31.008966    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-57f095-5bbb99547b-nfzmr"]
Jul 24 14:37:32.865539 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:32.865507    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57dc1f4b-aebc-4350-b32a-064f67561424" path="/var/lib/kubelet/pods/57dc1f4b-aebc-4350-b32a-064f67561424/volumes"
Jul 24 14:37:32.866005 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:37:32.865890    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" path="/var/lib/kubelet/pods/fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784/volumes"
Jul 24 14:38:00.196340 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.196260    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"]
Jul 24 14:38:00.196847 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.196520    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c" podUID="f5f4c6b1-6476-4043-93cf-76bd4a371148" containerName="maas-api" containerID="cri-o://c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2" gracePeriod=30
Jul 24 14:38:00.252593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.252559    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"]
Jul 24 14:38:00.252796 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.252771    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n" podUID="be764454-c672-4f72-953e-356ecbcf0b79" containerName="payload-processing" containerID="cri-o://428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071" gracePeriod=30
Jul 24 14:38:00.262482 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.262450    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"]
Jul 24 14:38:00.262697 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.262674    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn" podUID="8c7318c9-0099-4781-a47b-f56df3246d68" containerName="payload-pre-processing" containerID="cri-o://7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6" gracePeriod=30
Jul 24 14:38:00.533230 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.533200    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:38:00.562757 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.562727    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:38:00.576407 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.576380    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:38:00.657561 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.657533    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj5fp\" (UniqueName: \"kubernetes.io/projected/be764454-c672-4f72-953e-356ecbcf0b79-kube-api-access-bj5fp\") pod \"be764454-c672-4f72-953e-356ecbcf0b79\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") "
Jul 24 14:38:00.657749 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.657644    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be764454-c672-4f72-953e-356ecbcf0b79-plugins-config-volume\") pod \"be764454-c672-4f72-953e-356ecbcf0b79\" (UID: \"be764454-c672-4f72-953e-356ecbcf0b79\") "
Jul 24 14:38:00.658059 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.658033    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be764454-c672-4f72-953e-356ecbcf0b79-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be764454-c672-4f72-953e-356ecbcf0b79" (UID: "be764454-c672-4f72-953e-356ecbcf0b79"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:38:00.659732 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.659712    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be764454-c672-4f72-953e-356ecbcf0b79-kube-api-access-bj5fp" (OuterVolumeSpecName: "kube-api-access-bj5fp") pod "be764454-c672-4f72-953e-356ecbcf0b79" (UID: "be764454-c672-4f72-953e-356ecbcf0b79"). InnerVolumeSpecName "kube-api-access-bj5fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:00.759120 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759078    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f4c6b1-6476-4043-93cf-76bd4a371148-openshift-service-ca\") pod \"f5f4c6b1-6476-4043-93cf-76bd4a371148\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") "
Jul 24 14:38:00.759378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76nxk\" (UniqueName: \"kubernetes.io/projected/8c7318c9-0099-4781-a47b-f56df3246d68-kube-api-access-76nxk\") pod \"8c7318c9-0099-4781-a47b-f56df3246d68\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") "
Jul 24 14:38:00.759378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759182    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c7318c9-0099-4781-a47b-f56df3246d68-plugins-config-volume\") pod \"8c7318c9-0099-4781-a47b-f56df3246d68\" (UID: \"8c7318c9-0099-4781-a47b-f56df3246d68\") "
Jul 24 14:38:00.759378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759210    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42vv4\" (UniqueName: \"kubernetes.io/projected/f5f4c6b1-6476-4043-93cf-76bd4a371148-kube-api-access-42vv4\") pod \"f5f4c6b1-6476-4043-93cf-76bd4a371148\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") "
Jul 24 14:38:00.759378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759266    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f4c6b1-6476-4043-93cf-76bd4a371148-maas-api-tls\") pod \"f5f4c6b1-6476-4043-93cf-76bd4a371148\" (UID: \"f5f4c6b1-6476-4043-93cf-76bd4a371148\") "
Jul 24 14:38:00.759585 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759479    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5f4c6b1-6476-4043-93cf-76bd4a371148-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5f4c6b1-6476-4043-93cf-76bd4a371148" (UID: "f5f4c6b1-6476-4043-93cf-76bd4a371148"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:38:00.759649 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759598    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7318c9-0099-4781-a47b-f56df3246d68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8c7318c9-0099-4781-a47b-f56df3246d68" (UID: "8c7318c9-0099-4781-a47b-f56df3246d68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:38:00.759649 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759612    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5f4c6b1-6476-4043-93cf-76bd4a371148-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:38:00.759649 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759640    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be764454-c672-4f72-953e-356ecbcf0b79-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:38:00.759785 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.759668    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj5fp\" (UniqueName: \"kubernetes.io/projected/be764454-c672-4f72-953e-356ecbcf0b79-kube-api-access-bj5fp\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:38:00.761609 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.761573    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5f4c6b1-6476-4043-93cf-76bd4a371148-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5f4c6b1-6476-4043-93cf-76bd4a371148" (UID: "f5f4c6b1-6476-4043-93cf-76bd4a371148"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:38:00.761716 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.761627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f4c6b1-6476-4043-93cf-76bd4a371148-kube-api-access-42vv4" (OuterVolumeSpecName: "kube-api-access-42vv4") pod "f5f4c6b1-6476-4043-93cf-76bd4a371148" (UID: "f5f4c6b1-6476-4043-93cf-76bd4a371148"). InnerVolumeSpecName "kube-api-access-42vv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:00.761716 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.761648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7318c9-0099-4781-a47b-f56df3246d68-kube-api-access-76nxk" (OuterVolumeSpecName: "kube-api-access-76nxk") pod "8c7318c9-0099-4781-a47b-f56df3246d68" (UID: "8c7318c9-0099-4781-a47b-f56df3246d68"). InnerVolumeSpecName "kube-api-access-76nxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:00.861161 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.861124    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76nxk\" (UniqueName: \"kubernetes.io/projected/8c7318c9-0099-4781-a47b-f56df3246d68-kube-api-access-76nxk\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:38:00.861161 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.861153    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c7318c9-0099-4781-a47b-f56df3246d68-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:38:00.861161 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.861164    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42vv4\" (UniqueName: \"kubernetes.io/projected/f5f4c6b1-6476-4043-93cf-76bd4a371148-kube-api-access-42vv4\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:38:00.861161 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:00.861173    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5f4c6b1-6476-4043-93cf-76bd4a371148-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:38:01.147889 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.147768    2563 generic.go:356] "Generic (PLEG): container finished" podID="8c7318c9-0099-4781-a47b-f56df3246d68" containerID="7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6" exitCode=0
Jul 24 14:38:01.147889 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.147858    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"
Jul 24 14:38:01.148119 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.147855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn" event={"ID":"8c7318c9-0099-4781-a47b-f56df3246d68","Type":"ContainerDied","Data":"7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6"}
Jul 24 14:38:01.148119 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.148013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn" event={"ID":"8c7318c9-0099-4781-a47b-f56df3246d68","Type":"ContainerDied","Data":"22267cfa58dc5e75867f74147913097fb5cbde9c1565df47e8f8dd3355a1e716"}
Jul 24 14:38:01.148119 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.148046    2563 scope.go:117] "RemoveContainer" containerID="7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6"
Jul 24 14:38:01.149418 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.149395    2563 generic.go:356] "Generic (PLEG): container finished" podID="f5f4c6b1-6476-4043-93cf-76bd4a371148" containerID="c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2" exitCode=0
Jul 24 14:38:01.149542 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.149464    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"
Jul 24 14:38:01.149542 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.149498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c" event={"ID":"f5f4c6b1-6476-4043-93cf-76bd4a371148","Type":"ContainerDied","Data":"c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2"}
Jul 24 14:38:01.149643 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.149541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c" event={"ID":"f5f4c6b1-6476-4043-93cf-76bd4a371148","Type":"ContainerDied","Data":"7531879cdf271f3858cd0bad8bdf613b1aa7e03062fea5400bd7b2c8c5db03aa"}
Jul 24 14:38:01.151138 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.151112    2563 generic.go:356] "Generic (PLEG): container finished" podID="be764454-c672-4f72-953e-356ecbcf0b79" containerID="428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071" exitCode=0
Jul 24 14:38:01.151257 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.151167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n" event={"ID":"be764454-c672-4f72-953e-356ecbcf0b79","Type":"ContainerDied","Data":"428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071"}
Jul 24 14:38:01.151257 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.151175    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"
Jul 24 14:38:01.151257 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.151206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n" event={"ID":"be764454-c672-4f72-953e-356ecbcf0b79","Type":"ContainerDied","Data":"a81841f202d92651e7c58283b6894d5b4585060e16ebbb9f78dab2f72c049c0d"}
Jul 24 14:38:01.158789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.158770    2563 scope.go:117] "RemoveContainer" containerID="7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6"
Jul 24 14:38:01.159070 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:38:01.159049    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6\": container with ID starting with 7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6 not found: ID does not exist" containerID="7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6"
Jul 24 14:38:01.159145 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.159077    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6"} err="failed to get container status \"7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6\": rpc error: code = NotFound desc = could not find container \"7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6\": container with ID starting with 7286887d3b3e444a565a19cd12f825275f4f4bd249f874c6d4d4447c6eb4c1d6 not found: ID does not exist"
Jul 24 14:38:01.159145 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.159094    2563 scope.go:117] "RemoveContainer" containerID="c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2"
Jul 24 14:38:01.167452 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.167424    2563 scope.go:117] "RemoveContainer" containerID="c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2"
Jul 24 14:38:01.167700 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:38:01.167682    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2\": container with ID starting with c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2 not found: ID does not exist" containerID="c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2"
Jul 24 14:38:01.167754 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.167709    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2"} err="failed to get container status \"c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2\": rpc error: code = NotFound desc = could not find container \"c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2\": container with ID starting with c1bb0e3884b27912905768a3f2d010ca8005d0de486d763faa1f7e60a4142bf2 not found: ID does not exist"
Jul 24 14:38:01.167754 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.167729    2563 scope.go:117] "RemoveContainer" containerID="428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071"
Jul 24 14:38:01.174360 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.174332    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"]
Jul 24 14:38:01.176451 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.176432    2563 scope.go:117] "RemoveContainer" containerID="428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071"
Jul 24 14:38:01.176720 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:38:01.176701    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071\": container with ID starting with 428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071 not found: ID does not exist" containerID="428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071"
Jul 24 14:38:01.176778 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.176731    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071"} err="failed to get container status \"428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071\": rpc error: code = NotFound desc = could not find container \"428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071\": container with ID starting with 428e340daae8c79a67cab827747b37105fbc170e132f1fa93069c74855854071 not found: ID does not exist"
Jul 24 14:38:01.178968 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.178946    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-106097-8595d46896-jz46n"]
Jul 24 14:38:01.189612 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.189590    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"]
Jul 24 14:38:01.201761 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.201737    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-106097-754ffc7c7d-f7l2c"]
Jul 24 14:38:01.214389 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.214367    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"]
Jul 24 14:38:01.221178 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:01.221152    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-106097-85b8b676b8-nmkkn"]
Jul 24 14:38:02.866040 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:02.866009    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7318c9-0099-4781-a47b-f56df3246d68" path="/var/lib/kubelet/pods/8c7318c9-0099-4781-a47b-f56df3246d68/volumes"
Jul 24 14:38:02.866432 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:02.866408    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be764454-c672-4f72-953e-356ecbcf0b79" path="/var/lib/kubelet/pods/be764454-c672-4f72-953e-356ecbcf0b79/volumes"
Jul 24 14:38:02.866747 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:38:02.866733    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5f4c6b1-6476-4043-93cf-76bd4a371148" path="/var/lib/kubelet/pods/f5f4c6b1-6476-4043-93cf-76bd4a371148/volumes"
Jul 24 14:39:10.267111 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.267073    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"]
Jul 24 14:39:10.268113 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.268052    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz" podUID="7bb54885-b1ba-4f7f-a77c-745b029d7b51" containerName="payload-processing" containerID="cri-o://94121d8b2d89c69f9c5cfe5adf91cda37fd45d6d2dd7967bd7bcf725a4a6967b" gracePeriod=30
Jul 24 14:39:10.282129 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.282097    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"]
Jul 24 14:39:10.282541 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.282492    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx" podUID="e035709d-7532-43da-9d9f-4ff8b423aecc" containerName="payload-pre-processing" containerID="cri-o://46f967ded351600408721141235f233cc7ffc8bac2641ac0d32190b1c957e25a" gracePeriod=30
Jul 24 14:39:10.550427 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.550342    2563 generic.go:356] "Generic (PLEG): container finished" podID="7bb54885-b1ba-4f7f-a77c-745b029d7b51" containerID="94121d8b2d89c69f9c5cfe5adf91cda37fd45d6d2dd7967bd7bcf725a4a6967b" exitCode=0
Jul 24 14:39:10.550590 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.550472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz" event={"ID":"7bb54885-b1ba-4f7f-a77c-745b029d7b51","Type":"ContainerDied","Data":"94121d8b2d89c69f9c5cfe5adf91cda37fd45d6d2dd7967bd7bcf725a4a6967b"}
Jul 24 14:39:10.552407 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.552386    2563 generic.go:356] "Generic (PLEG): container finished" podID="e035709d-7532-43da-9d9f-4ff8b423aecc" containerID="46f967ded351600408721141235f233cc7ffc8bac2641ac0d32190b1c957e25a" exitCode=0
Jul 24 14:39:10.552503 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.552459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx" event={"ID":"e035709d-7532-43da-9d9f-4ff8b423aecc","Type":"ContainerDied","Data":"46f967ded351600408721141235f233cc7ffc8bac2641ac0d32190b1c957e25a"}
Jul 24 14:39:10.576563 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.576541    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:39:10.579629 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.579603    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:39:10.687710 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.687676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e035709d-7532-43da-9d9f-4ff8b423aecc-plugins-config-volume\") pod \"e035709d-7532-43da-9d9f-4ff8b423aecc\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") "
Jul 24 14:39:10.687941 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.687794    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-972r9\" (UniqueName: \"kubernetes.io/projected/7bb54885-b1ba-4f7f-a77c-745b029d7b51-kube-api-access-972r9\") pod \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") "
Jul 24 14:39:10.687941 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.687891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqp5h\" (UniqueName: \"kubernetes.io/projected/e035709d-7532-43da-9d9f-4ff8b423aecc-kube-api-access-nqp5h\") pod \"e035709d-7532-43da-9d9f-4ff8b423aecc\" (UID: \"e035709d-7532-43da-9d9f-4ff8b423aecc\") "
Jul 24 14:39:10.687941 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.687923    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bb54885-b1ba-4f7f-a77c-745b029d7b51-plugins-config-volume\") pod \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\" (UID: \"7bb54885-b1ba-4f7f-a77c-745b029d7b51\") "
Jul 24 14:39:10.688234 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.688203    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e035709d-7532-43da-9d9f-4ff8b423aecc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e035709d-7532-43da-9d9f-4ff8b423aecc" (UID: "e035709d-7532-43da-9d9f-4ff8b423aecc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:10.688385 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.688358    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb54885-b1ba-4f7f-a77c-745b029d7b51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7bb54885-b1ba-4f7f-a77c-745b029d7b51" (UID: "7bb54885-b1ba-4f7f-a77c-745b029d7b51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:10.690115 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.690087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb54885-b1ba-4f7f-a77c-745b029d7b51-kube-api-access-972r9" (OuterVolumeSpecName: "kube-api-access-972r9") pod "7bb54885-b1ba-4f7f-a77c-745b029d7b51" (UID: "7bb54885-b1ba-4f7f-a77c-745b029d7b51"). InnerVolumeSpecName "kube-api-access-972r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:10.690231 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.690192    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e035709d-7532-43da-9d9f-4ff8b423aecc-kube-api-access-nqp5h" (OuterVolumeSpecName: "kube-api-access-nqp5h") pod "e035709d-7532-43da-9d9f-4ff8b423aecc" (UID: "e035709d-7532-43da-9d9f-4ff8b423aecc"). InnerVolumeSpecName "kube-api-access-nqp5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:10.789339 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.789304    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-972r9\" (UniqueName: \"kubernetes.io/projected/7bb54885-b1ba-4f7f-a77c-745b029d7b51-kube-api-access-972r9\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:10.789339 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.789340    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqp5h\" (UniqueName: \"kubernetes.io/projected/e035709d-7532-43da-9d9f-4ff8b423aecc-kube-api-access-nqp5h\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:10.789519 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.789355    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bb54885-b1ba-4f7f-a77c-745b029d7b51-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:10.789519 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:10.789369    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e035709d-7532-43da-9d9f-4ff8b423aecc-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:11.558935 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.558901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz" event={"ID":"7bb54885-b1ba-4f7f-a77c-745b029d7b51","Type":"ContainerDied","Data":"9dbeea7733be02b4360b664f0988278391d8bc7f3887c03cc639dfb3710984d8"}
Jul 24 14:39:11.559413 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.558967    2563 scope.go:117] "RemoveContainer" containerID="94121d8b2d89c69f9c5cfe5adf91cda37fd45d6d2dd7967bd7bcf725a4a6967b"
Jul 24 14:39:11.559413 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.558906    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"
Jul 24 14:39:11.560351 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.560331    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"
Jul 24 14:39:11.560427 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.560378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx" event={"ID":"e035709d-7532-43da-9d9f-4ff8b423aecc","Type":"ContainerDied","Data":"938078742d3ec1c9e0a154f2991ee3e413f8e907d786a0bbbd4fe0d1c67032fb"}
Jul 24 14:39:11.568361 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.568340    2563 scope.go:117] "RemoveContainer" containerID="46f967ded351600408721141235f233cc7ffc8bac2641ac0d32190b1c957e25a"
Jul 24 14:39:11.578667 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.578642    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"]
Jul 24 14:39:11.583212 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.583183    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fde43a-5786f59c84-s56qx"]
Jul 24 14:39:11.592832 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.592795    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"]
Jul 24 14:39:11.597056 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:11.597034    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-fde43a-785b557574-smlpz"]
Jul 24 14:39:12.865482 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:12.865449    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bb54885-b1ba-4f7f-a77c-745b029d7b51" path="/var/lib/kubelet/pods/7bb54885-b1ba-4f7f-a77c-745b029d7b51/volumes"
Jul 24 14:39:12.865899 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:12.865834    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e035709d-7532-43da-9d9f-4ff8b423aecc" path="/var/lib/kubelet/pods/e035709d-7532-43da-9d9f-4ff8b423aecc/volumes"
Jul 24 14:39:31.911517 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:31.911476    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"]
Jul 24 14:39:31.912065 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:31.911754    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl" podUID="3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" containerName="maas-api" containerID="cri-o://805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce" gracePeriod=30
Jul 24 14:39:31.945770 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:31.945735    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"]
Jul 24 14:39:31.949496 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:31.949469    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94af13-29748390-6459s"]
Jul 24 14:39:31.984555 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:31.984522    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"]
Jul 24 14:39:31.984808 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:31.984765    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b" podUID="1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" containerName="payload-pre-processing" containerID="cri-o://cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07" gracePeriod=30
Jul 24 14:39:32.242841 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.242796    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:39:32.278344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.278320    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:39:32.397881 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.397852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-plugins-config-volume\") pod \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") "
Jul 24 14:39:32.398082 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.397906    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls\") pod \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") "
Jul 24 14:39:32.398082 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.397935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-openshift-service-ca\") pod \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") "
Jul 24 14:39:32.398082 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.397975    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggbjl\" (UniqueName: \"kubernetes.io/projected/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-kube-api-access-ggbjl\") pod \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\" (UID: \"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d\") "
Jul 24 14:39:32.398082 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.398014    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ndtk\" (UniqueName: \"kubernetes.io/projected/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-kube-api-access-8ndtk\") pod \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\" (UID: \"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b\") "
Jul 24 14:39:32.398344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.398316    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" (UID: "1cbcd9e2-b9b6-4364-80ee-5373dbbf209d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:32.398432 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.398404    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" (UID: "3e953fd4-5f27-44d5-b5db-6e8ee7978b4b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:32.400289 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.400257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-kube-api-access-8ndtk" (OuterVolumeSpecName: "kube-api-access-8ndtk") pod "3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" (UID: "3e953fd4-5f27-44d5-b5db-6e8ee7978b4b"). InnerVolumeSpecName "kube-api-access-8ndtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:32.400692 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.400671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" (UID: "3e953fd4-5f27-44d5-b5db-6e8ee7978b4b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:39:32.400692 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.400679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-kube-api-access-ggbjl" (OuterVolumeSpecName: "kube-api-access-ggbjl") pod "1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" (UID: "1cbcd9e2-b9b6-4364-80ee-5373dbbf209d"). InnerVolumeSpecName "kube-api-access-ggbjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:32.499483 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.499446    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:32.499660 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.499479    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:32.499660 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.499503    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:32.499660 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.499512    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggbjl\" (UniqueName: \"kubernetes.io/projected/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d-kube-api-access-ggbjl\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:32.499660 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.499521    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ndtk\" (UniqueName: \"kubernetes.io/projected/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b-kube-api-access-8ndtk\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:32.692188 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.692151    2563 generic.go:356] "Generic (PLEG): container finished" podID="1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" containerID="cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07" exitCode=0
Jul 24 14:39:32.692377 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.692198    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"
Jul 24 14:39:32.692377 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.692243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b" event={"ID":"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d","Type":"ContainerDied","Data":"cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07"}
Jul 24 14:39:32.692377 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.692297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b" event={"ID":"1cbcd9e2-b9b6-4364-80ee-5373dbbf209d","Type":"ContainerDied","Data":"90930fa37edea4a1d8bb018145e9633b9f236f5a5012c2f447179a3e397bb458"}
Jul 24 14:39:32.692377 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.692318    2563 scope.go:117] "RemoveContainer" containerID="cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07"
Jul 24 14:39:32.693798 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.693771    2563 generic.go:356] "Generic (PLEG): container finished" podID="3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" containerID="805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce" exitCode=0
Jul 24 14:39:32.693935 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.693848    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"
Jul 24 14:39:32.693935 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.693850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl" event={"ID":"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b","Type":"ContainerDied","Data":"805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce"}
Jul 24 14:39:32.693935 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.693909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl" event={"ID":"3e953fd4-5f27-44d5-b5db-6e8ee7978b4b","Type":"ContainerDied","Data":"911f62ff858a145103017bd987d2ef4610521e6a10ea0b61fe5c71303343f149"}
Jul 24 14:39:32.702265 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.702244    2563 scope.go:117] "RemoveContainer" containerID="cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07"
Jul 24 14:39:32.702549 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:39:32.702528    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07\": container with ID starting with cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07 not found: ID does not exist" containerID="cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07"
Jul 24 14:39:32.702636 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.702561    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07"} err="failed to get container status \"cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07\": rpc error: code = NotFound desc = could not find container \"cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07\": container with ID starting with cdee0fae8fd851a1de891d6742b6d6cd10c58136b0f8fa052cc729bc4fdcdb07 not found: ID does not exist"
Jul 24 14:39:32.702636 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.702585    2563 scope.go:117] "RemoveContainer" containerID="805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce"
Jul 24 14:39:32.711076 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.711060    2563 scope.go:117] "RemoveContainer" containerID="805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce"
Jul 24 14:39:32.711315 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:39:32.711296    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce\": container with ID starting with 805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce not found: ID does not exist" containerID="805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce"
Jul 24 14:39:32.711366 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.711322    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce"} err="failed to get container status \"805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce\": rpc error: code = NotFound desc = could not find container \"805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce\": container with ID starting with 805eb29283de71963c4d43aba2ea27b0154d20017bb251b0873cfb53ad2707ce not found: ID does not exist"
Jul 24 14:39:32.718054 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.718033    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"]
Jul 24 14:39:32.722108 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.722082    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-94af13-657f5c75f5-jlqbl"]
Jul 24 14:39:32.731841 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.731806    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"]
Jul 24 14:39:32.736146 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.736127    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94af13-68fc497cd4-q2r7b"]
Jul 24 14:39:32.865366 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.865284    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" path="/var/lib/kubelet/pods/1cbcd9e2-b9b6-4364-80ee-5373dbbf209d/volumes"
Jul 24 14:39:32.865685 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.865671    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" path="/var/lib/kubelet/pods/3e953fd4-5f27-44d5-b5db-6e8ee7978b4b/volumes"
Jul 24 14:39:32.865934 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:32.865922    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9efa85b2-986f-4fe8-8cff-9b41b0902424" path="/var/lib/kubelet/pods/9efa85b2-986f-4fe8-8cff-9b41b0902424/volumes"
Jul 24 14:39:54.274729 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.274684    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"]
Jul 24 14:39:54.275342 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.275062    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf" podUID="ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" containerName="maas-api" containerID="cri-o://60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59" gracePeriod=30
Jul 24 14:39:54.322469 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.322419    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"]
Jul 24 14:39:54.322690 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.322657    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5" podUID="bcdad442-d3eb-4479-a274-71921a5ef6fb" containerName="payload-processing" containerID="cri-o://0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc" gracePeriod=30
Jul 24 14:39:54.325471 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.325442    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"]
Jul 24 14:39:54.325721 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.325675    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h" podUID="0e721040-a379-4c2f-a67e-c1c42f512f61" containerName="payload-pre-processing" containerID="cri-o://f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086" gracePeriod=30
Jul 24 14:39:54.586718 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.586689    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:39:54.594571 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.594548    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:39:54.640609 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.640585    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:39:54.684381 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls\") pod \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") "
Jul 24 14:39:54.684556 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e721040-a379-4c2f-a67e-c1c42f512f61-plugins-config-volume\") pod \"0e721040-a379-4c2f-a67e-c1c42f512f61\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") "
Jul 24 14:39:54.684556 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684442    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpzmj\" (UniqueName: \"kubernetes.io/projected/bcdad442-d3eb-4479-a274-71921a5ef6fb-kube-api-access-mpzmj\") pod \"bcdad442-d3eb-4479-a274-71921a5ef6fb\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") "
Jul 24 14:39:54.684556 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684505    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7r9f\" (UniqueName: \"kubernetes.io/projected/0e721040-a379-4c2f-a67e-c1c42f512f61-kube-api-access-p7r9f\") pod \"0e721040-a379-4c2f-a67e-c1c42f512f61\" (UID: \"0e721040-a379-4c2f-a67e-c1c42f512f61\") "
Jul 24 14:39:54.684725 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxwtf\" (UniqueName: \"kubernetes.io/projected/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-kube-api-access-xxwtf\") pod \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") "
Jul 24 14:39:54.684725 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcdad442-d3eb-4479-a274-71921a5ef6fb-plugins-config-volume\") pod \"bcdad442-d3eb-4479-a274-71921a5ef6fb\" (UID: \"bcdad442-d3eb-4479-a274-71921a5ef6fb\") "
Jul 24 14:39:54.684883 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684757    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-openshift-service-ca\") pod \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\" (UID: \"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce\") "
Jul 24 14:39:54.684883 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.684838    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e721040-a379-4c2f-a67e-c1c42f512f61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e721040-a379-4c2f-a67e-c1c42f512f61" (UID: "0e721040-a379-4c2f-a67e-c1c42f512f61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:54.685139 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.685068    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcdad442-d3eb-4479-a274-71921a5ef6fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bcdad442-d3eb-4479-a274-71921a5ef6fb" (UID: "bcdad442-d3eb-4479-a274-71921a5ef6fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:54.685428 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.685237    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e721040-a379-4c2f-a67e-c1c42f512f61-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:54.685531 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.685507    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" (UID: "ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:54.686858 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.686810    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e721040-a379-4c2f-a67e-c1c42f512f61-kube-api-access-p7r9f" (OuterVolumeSpecName: "kube-api-access-p7r9f") pod "0e721040-a379-4c2f-a67e-c1c42f512f61" (UID: "0e721040-a379-4c2f-a67e-c1c42f512f61"). InnerVolumeSpecName "kube-api-access-p7r9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:54.687056 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.687036    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" (UID: "ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:39:54.687289 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.687260    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdad442-d3eb-4479-a274-71921a5ef6fb-kube-api-access-mpzmj" (OuterVolumeSpecName: "kube-api-access-mpzmj") pod "bcdad442-d3eb-4479-a274-71921a5ef6fb" (UID: "bcdad442-d3eb-4479-a274-71921a5ef6fb"). InnerVolumeSpecName "kube-api-access-mpzmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:54.687527 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.687502    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-kube-api-access-xxwtf" (OuterVolumeSpecName: "kube-api-access-xxwtf") pod "ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" (UID: "ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce"). InnerVolumeSpecName "kube-api-access-xxwtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:54.786279 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.786194    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpzmj\" (UniqueName: \"kubernetes.io/projected/bcdad442-d3eb-4479-a274-71921a5ef6fb-kube-api-access-mpzmj\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:54.786279 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.786238    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7r9f\" (UniqueName: \"kubernetes.io/projected/0e721040-a379-4c2f-a67e-c1c42f512f61-kube-api-access-p7r9f\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:54.786279 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.786253    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxwtf\" (UniqueName: \"kubernetes.io/projected/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-kube-api-access-xxwtf\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:54.786279 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.786267    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcdad442-d3eb-4479-a274-71921a5ef6fb-plugins-config-volume\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:54.786279 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.786280    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-openshift-service-ca\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:54.786539 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.786295    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce-maas-api-tls\") on node \"ip-10-0-131-103.ec2.internal\" DevicePath \"\""
Jul 24 14:39:54.817930 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.817899    2563 generic.go:356] "Generic (PLEG): container finished" podID="bcdad442-d3eb-4479-a274-71921a5ef6fb" containerID="0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc" exitCode=0
Jul 24 14:39:54.818085 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.817947    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"
Jul 24 14:39:54.818085 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.817998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5" event={"ID":"bcdad442-d3eb-4479-a274-71921a5ef6fb","Type":"ContainerDied","Data":"0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc"}
Jul 24 14:39:54.818085 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.818059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5" event={"ID":"bcdad442-d3eb-4479-a274-71921a5ef6fb","Type":"ContainerDied","Data":"1a3c85bc85af54b971640f65906d835c6a2296253d65b55a09b52fd55135b38a"}
Jul 24 14:39:54.818255 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.818091    2563 scope.go:117] "RemoveContainer" containerID="0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc"
Jul 24 14:39:54.819326 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.819306    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" containerID="60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59" exitCode=0
Jul 24 14:39:54.819415 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.819360    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"
Jul 24 14:39:54.819487 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.819406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf" event={"ID":"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce","Type":"ContainerDied","Data":"60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59"}
Jul 24 14:39:54.819487 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.819477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf" event={"ID":"ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce","Type":"ContainerDied","Data":"9c74bb4110c5ed433b68f68f93716aa71f513cabd738f9c476d2440f0d98032b"}
Jul 24 14:39:54.820980 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.820953    2563 generic.go:356] "Generic (PLEG): container finished" podID="0e721040-a379-4c2f-a67e-c1c42f512f61" containerID="f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086" exitCode=0
Jul 24 14:39:54.821102 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.820990    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"
Jul 24 14:39:54.821102 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.821040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h" event={"ID":"0e721040-a379-4c2f-a67e-c1c42f512f61","Type":"ContainerDied","Data":"f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086"}
Jul 24 14:39:54.821102 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.821089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h" event={"ID":"0e721040-a379-4c2f-a67e-c1c42f512f61","Type":"ContainerDied","Data":"61b3ed59837412c53d3d3e1b0c110921bf5ab0f1e6d5e9743a5ebc65285da813"}
Jul 24 14:39:54.829604 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.829584    2563 scope.go:117] "RemoveContainer" containerID="0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc"
Jul 24 14:39:54.830018 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:39:54.829888    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc\": container with ID starting with 0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc not found: ID does not exist" containerID="0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc"
Jul 24 14:39:54.830018 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.829923    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc"} err="failed to get container status \"0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc\": rpc error: code = NotFound desc = could not find container \"0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc\": container with ID starting with 0684f4e8d77b51433df253d56bdfdc60698bf0c197295244eb77dc4b52a877fc not found: ID does not exist"
Jul 24 14:39:54.830018 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.829940    2563 scope.go:117] "RemoveContainer" containerID="60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59"
Jul 24 14:39:54.838499 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.838484    2563 scope.go:117] "RemoveContainer" containerID="60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59"
Jul 24 14:39:54.838726 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:39:54.838709    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59\": container with ID starting with 60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59 not found: ID does not exist" containerID="60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59"
Jul 24 14:39:54.838782 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.838732    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59"} err="failed to get container status \"60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59\": rpc error: code = NotFound desc = could not find container \"60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59\": container with ID starting with 60a2455cf8fe03825c4b73e1909f3a85fcc183ba387dd3ac45c4111348a6ca59 not found: ID does not exist"
Jul 24 14:39:54.838782 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.838749    2563 scope.go:117] "RemoveContainer" containerID="f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086"
Jul 24 14:39:54.844219 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.844197    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"]
Jul 24 14:39:54.847892 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.847844    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-938af8-6ffd96d6c4-jnnj5"]
Jul 24 14:39:54.848096 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.848078    2563 scope.go:117] "RemoveContainer" containerID="f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086"
Jul 24 14:39:54.848399 ip-10-0-131-103 kubenswrapper[2563]: E0724 14:39:54.848379    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086\": container with ID starting with f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086 not found: ID does not exist" containerID="f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086"
Jul 24 14:39:54.848450 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.848406    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086"} err="failed to get container status \"f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086\": rpc error: code = NotFound desc = could not find container \"f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086\": container with ID starting with f4b2b595aea5bb6f1d2931bc29ab34cade0a9d3d018cdd0a7b441b1f1ec6c086 not found: ID does not exist"
Jul 24 14:39:54.858698 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.858677    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"]
Jul 24 14:39:54.864955 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.864934    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcdad442-d3eb-4479-a274-71921a5ef6fb" path="/var/lib/kubelet/pods/bcdad442-d3eb-4479-a274-71921a5ef6fb/volumes"
Jul 24 14:39:54.865191 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.865178    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-938af8-bc45fcfb7-fk6mf"]
Jul 24 14:39:54.870108 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.870089    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"]
Jul 24 14:39:54.873680 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:54.873660    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-938af8-57c4bc587b-ftq7h"]
Jul 24 14:39:56.865168 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:56.865134    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e721040-a379-4c2f-a67e-c1c42f512f61" path="/var/lib/kubelet/pods/0e721040-a379-4c2f-a67e-c1c42f512f61/volumes"
Jul 24 14:39:56.865551 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:39:56.865514    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" path="/var/lib/kubelet/pods/ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce/volumes"
Jul 24 14:40:11.756775 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:11.756746    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zdd87_3bfe74c5-a810-4e6e-87c8-1f3fe754db47/manager/0.log"
Jul 24 14:40:11.874345 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:11.874311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dwdlh_5482c673-181d-4be0-b2af-39783491a149/manager/0.log"
Jul 24 14:40:11.991052 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:11.991027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5588d9cbf8-cg582_14a0a40b-8c2b-435a-a88f-a5dc8aeb0749/manager/0.log"
Jul 24 14:40:12.485356 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:12.485327    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw_fe69d097-1d0e-429e-8f07-5b154a5920a6/copy-manifests/0.log"
Jul 24 14:40:12.492907 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:12.492878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw_fe69d097-1d0e-429e-8f07-5b154a5920a6/manager/0.log"
Jul 24 14:40:12.984639 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:12.984609    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5bc7cbfc95-xcjmv_d8da8947-d2ff-4ba4-9781-9523c8221101/maas-api/0.log"
Jul 24 14:40:13.101514 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:13.101484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748360-t84zj_32251318-3895-463b-9616-4b991c27b8ef/cleanup/0.log"
Jul 24 14:40:13.222128 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:13.222096    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748375-hm2np_65258123-7b89-4613-9a54-8a7cf1d2480b/cleanup/0.log"
Jul 24 14:40:13.467075 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:13.466994    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-l7ll8_5c16dede-3f8e-48cb-858b-821100df2d18/postgres/0.log"
Jul 24 14:40:14.287676 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.287646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs_75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4/extract/0.log"
Jul 24 14:40:14.294258 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.294236    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs_75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4/util/0.log"
Jul 24 14:40:14.315375 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.315352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs_75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4/pull/0.log"
Jul 24 14:40:14.434731 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.434696    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6_6c96cf45-aaa6-46fa-98b3-4bc21da31898/util/0.log"
Jul 24 14:40:14.441348 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.441324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6_6c96cf45-aaa6-46fa-98b3-4bc21da31898/pull/0.log"
Jul 24 14:40:14.447837 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.447800    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6_6c96cf45-aaa6-46fa-98b3-4bc21da31898/extract/0.log"
Jul 24 14:40:14.563074 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.563007    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z_2fecc45f-d8bb-4207-9ac7-8c080ac34df7/util/0.log"
Jul 24 14:40:14.569764 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.569744    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z_2fecc45f-d8bb-4207-9ac7-8c080ac34df7/pull/0.log"
Jul 24 14:40:14.577063 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.577046    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z_2fecc45f-d8bb-4207-9ac7-8c080ac34df7/extract/0.log"
Jul 24 14:40:14.702469 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.702444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9_bdcbfc9d-2439-43ec-a348-d466728e1344/util/0.log"
Jul 24 14:40:14.709115 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.709094    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9_bdcbfc9d-2439-43ec-a348-d466728e1344/pull/0.log"
Jul 24 14:40:14.715473 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.715448    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9_bdcbfc9d-2439-43ec-a348-d466728e1344/extract/0.log"
Jul 24 14:40:14.961322 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:14.961238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mfzk7_58d88bd2-d583-4839-9566-bf4c8d9599a6/manager/0.log"
Jul 24 14:40:16.168119 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:16.168088    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-25j98_d8a10396-e3ca-4706-9bea-80e313874fde/discovery/0.log"
Jul 24 14:40:16.395829 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:16.395781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-c5vvx_ecaf1bf7-15eb-443d-8357-5a8d95f51f46/kube-auth-proxy/0.log"
Jul 24 14:40:17.370896 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:17.370864    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-l25zz_876aef49-b77e-40db-ba3a-dc68af0099a0/main/0.log"
Jul 24 14:40:17.630222 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:17.630137    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2gfm5_6cd7baf4-8bea-47be-8d60-22ee87156188/main/0.log"
Jul 24 14:40:21.244727 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:21.244694    2563 scope.go:117] "RemoveContainer" containerID="370d79ac666e37a23db868649a3f41ddc622da4d0e3d1fa3386053379de75579"
Jul 24 14:40:26.063252 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:26.063221    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wk5nd_f7eadae5-68df-4f23-b0ee-36f6973a1b9b/global-pull-secret-syncer/0.log"
Jul 24 14:40:26.195370 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:26.195335    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j9ft7_a7606e18-0654-40a1-9414-adbc29c32dcd/konnectivity-agent/0.log"
Jul 24 14:40:26.251516 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:26.251483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-103.ec2.internal_7345f365a424f5fd3d9488d8c14814f8/haproxy/0.log"
Jul 24 14:40:30.136083 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.136051    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs_75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4/extract/0.log"
Jul 24 14:40:30.157909 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.157886    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs_75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4/util/0.log"
Jul 24 14:40:30.186547 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.186526    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rwqvs_75e8fcf9-f7cb-4e6c-8d6a-a6cc895efca4/pull/0.log"
Jul 24 14:40:30.216276 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.216253    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6_6c96cf45-aaa6-46fa-98b3-4bc21da31898/extract/0.log"
Jul 24 14:40:30.242563 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.242543    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6_6c96cf45-aaa6-46fa-98b3-4bc21da31898/util/0.log"
Jul 24 14:40:30.263643 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.263625    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w6cw6_6c96cf45-aaa6-46fa-98b3-4bc21da31898/pull/0.log"
Jul 24 14:40:30.305189 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.305166    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z_2fecc45f-d8bb-4207-9ac7-8c080ac34df7/extract/0.log"
Jul 24 14:40:30.333919 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.333893    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z_2fecc45f-d8bb-4207-9ac7-8c080ac34df7/util/0.log"
Jul 24 14:40:30.358942 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.358916    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqr2z_2fecc45f-d8bb-4207-9ac7-8c080ac34df7/pull/0.log"
Jul 24 14:40:30.389791 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.389731    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9_bdcbfc9d-2439-43ec-a348-d466728e1344/extract/0.log"
Jul 24 14:40:30.424025 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.424000    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9_bdcbfc9d-2439-43ec-a348-d466728e1344/util/0.log"
Jul 24 14:40:30.448807 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.448777    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xwmk9_bdcbfc9d-2439-43ec-a348-d466728e1344/pull/0.log"
Jul 24 14:40:30.974691 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:30.974658    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mfzk7_58d88bd2-d583-4839-9566-bf4c8d9599a6/manager/0.log"
Jul 24 14:40:32.946626 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:32.946595    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f097df21-193b-4017-a46f-c27df2835884/alertmanager/0.log"
Jul 24 14:40:32.976914 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:32.976889    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f097df21-193b-4017-a46f-c27df2835884/config-reloader/0.log"
Jul 24 14:40:33.003260 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.003238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f097df21-193b-4017-a46f-c27df2835884/kube-rbac-proxy-web/0.log"
Jul 24 14:40:33.030327 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.030308    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f097df21-193b-4017-a46f-c27df2835884/kube-rbac-proxy/0.log"
Jul 24 14:40:33.053672 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.053649    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f097df21-193b-4017-a46f-c27df2835884/kube-rbac-proxy-metric/0.log"
Jul 24 14:40:33.082119 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.082093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f097df21-193b-4017-a46f-c27df2835884/prom-label-proxy/0.log"
Jul 24 14:40:33.105133 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.105104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f097df21-193b-4017-a46f-c27df2835884/init-config-reloader/0.log"
Jul 24 14:40:33.155777 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.155749    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-ql9hc_dfcd24cc-942f-4735-8cbb-8e3f14f38b63/cluster-monitoring-operator/0.log"
Jul 24 14:40:33.323991 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.323963    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xt5v_a68b7195-58a9-4495-a22c-f04b9a8446d8/node-exporter/0.log"
Jul 24 14:40:33.351378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.351354    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xt5v_a68b7195-58a9-4495-a22c-f04b9a8446d8/kube-rbac-proxy/0.log"
Jul 24 14:40:33.375425 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.375404    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xt5v_a68b7195-58a9-4495-a22c-f04b9a8446d8/init-textfile/0.log"
Jul 24 14:40:33.955384 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.955304    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db9dd69f6-959xq_821f17d4-dc63-41dc-a5d6-20561832f119/telemeter-client/0.log"
Jul 24 14:40:33.979556 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:33.979533    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db9dd69f6-959xq_821f17d4-dc63-41dc-a5d6-20561832f119/reload/0.log"
Jul 24 14:40:34.016618 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:34.016594    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db9dd69f6-959xq_821f17d4-dc63-41dc-a5d6-20561832f119/kube-rbac-proxy/0.log"
Jul 24 14:40:34.078022 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:34.077998    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-545b948ffd-w9xcr_88b111c8-31fc-4fc2-8522-44973e5ba769/thanos-query/0.log"
Jul 24 14:40:34.104789 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:34.104763    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-545b948ffd-w9xcr_88b111c8-31fc-4fc2-8522-44973e5ba769/kube-rbac-proxy-web/0.log"
Jul 24 14:40:34.129688 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:34.129662    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-545b948ffd-w9xcr_88b111c8-31fc-4fc2-8522-44973e5ba769/kube-rbac-proxy/0.log"
Jul 24 14:40:34.153844 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:34.153796    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-545b948ffd-w9xcr_88b111c8-31fc-4fc2-8522-44973e5ba769/prom-label-proxy/0.log"
Jul 24 14:40:34.178751 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:34.178725    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-545b948ffd-w9xcr_88b111c8-31fc-4fc2-8522-44973e5ba769/kube-rbac-proxy-rules/0.log"
Jul 24 14:40:34.202398 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:34.202377    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-545b948ffd-w9xcr_88b111c8-31fc-4fc2-8522-44973e5ba769/kube-rbac-proxy-metrics/0.log"
Jul 24 14:40:36.666023 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.665992    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"]
Jul 24 14:40:36.666395 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666387    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" containerName="payload-processing"
Jul 24 14:40:36.666438 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666399    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" containerName="payload-processing"
Jul 24 14:40:36.666438 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666411    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dc1f4b-aebc-4350-b32a-064f67561424" containerName="payload-pre-processing"
Jul 24 14:40:36.666438 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666417    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dc1f4b-aebc-4350-b32a-064f67561424" containerName="payload-pre-processing"
Jul 24 14:40:36.666438 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666426    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e721040-a379-4c2f-a67e-c1c42f512f61" containerName="payload-pre-processing"
Jul 24 14:40:36.666438 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666432    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e721040-a379-4c2f-a67e-c1c42f512f61" containerName="payload-pre-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666440    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb54885-b1ba-4f7f-a77c-745b029d7b51" containerName="payload-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666445    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb54885-b1ba-4f7f-a77c-745b029d7b51" containerName="payload-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666458    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f4c6b1-6476-4043-93cf-76bd4a371148" containerName="maas-api"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666463    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f4c6b1-6476-4043-93cf-76bd4a371148" containerName="maas-api"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666468    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be764454-c672-4f72-953e-356ecbcf0b79" containerName="payload-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666473    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="be764454-c672-4f72-953e-356ecbcf0b79" containerName="payload-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666482    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdad442-d3eb-4479-a274-71921a5ef6fb" containerName="payload-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666487    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdad442-d3eb-4479-a274-71921a5ef6fb" containerName="payload-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666494    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" containerName="maas-api"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666498    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" containerName="maas-api"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666504    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e035709d-7532-43da-9d9f-4ff8b423aecc" containerName="payload-pre-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666509    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e035709d-7532-43da-9d9f-4ff8b423aecc" containerName="payload-pre-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666516    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" containerName="maas-api"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666520    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" containerName="maas-api"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666526    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7318c9-0099-4781-a47b-f56df3246d68" containerName="payload-pre-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666531    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7318c9-0099-4781-a47b-f56df3246d68" containerName="payload-pre-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666537    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" containerName="payload-pre-processing"
Jul 24 14:40:36.666593 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666542    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" containerName="payload-pre-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666603    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3cbdab-4f36-49f5-b5e8-9b702e6da7ce" containerName="maas-api"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666610    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="be764454-c672-4f72-953e-356ecbcf0b79" containerName="payload-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666615    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7318c9-0099-4781-a47b-f56df3246d68" containerName="payload-pre-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666620    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb6ac4d-dbb7-4c88-a5af-dd5e6d999784" containerName="payload-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666628    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bb54885-b1ba-4f7f-a77c-745b029d7b51" containerName="payload-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666633    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e035709d-7532-43da-9d9f-4ff8b423aecc" containerName="payload-pre-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666639    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cbcd9e2-b9b6-4364-80ee-5373dbbf209d" containerName="payload-pre-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666644    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e721040-a379-4c2f-a67e-c1c42f512f61" containerName="payload-pre-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666650    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="57dc1f4b-aebc-4350-b32a-064f67561424" containerName="payload-pre-processing"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e953fd4-5f27-44d5-b5db-6e8ee7978b4b" containerName="maas-api"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666658    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5f4c6b1-6476-4043-93cf-76bd4a371148" containerName="maas-api"
Jul 24 14:40:36.667155 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.666667    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcdad442-d3eb-4479-a274-71921a5ef6fb" containerName="payload-processing"
Jul 24 14:40:36.670224 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.670205    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.672680 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.672661    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmxsf\"/\"openshift-service-ca.crt\""
Jul 24 14:40:36.672799 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.672761    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmxsf\"/\"kube-root-ca.crt\""
Jul 24 14:40:36.673481 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.673466    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mmxsf\"/\"default-dockercfg-jjn97\""
Jul 24 14:40:36.679373 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.679350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"]
Jul 24 14:40:36.764210 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.764174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-lib-modules\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.764404 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.764215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-proc\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.764404 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.764239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-sys\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.764404 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.764319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dpnl\" (UniqueName: \"kubernetes.io/projected/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-kube-api-access-4dpnl\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.764404 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.764354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-podres\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865426 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-lib-modules\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865426 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-proc\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-sys\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dpnl\" (UniqueName: \"kubernetes.io/projected/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-kube-api-access-4dpnl\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-podres\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-proc\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-lib-modules\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-sys\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.865665 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.865608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-podres\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.873984 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.873959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dpnl\" (UniqueName: \"kubernetes.io/projected/e26093bc-c3f5-4531-b6f2-7da0b9c98e94-kube-api-access-4dpnl\") pod \"perf-node-gather-daemonset-db77p\" (UID: \"e26093bc-c3f5-4531-b6f2-7da0b9c98e94\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:36.947497 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.947409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-m5j4c_49450a75-baf1-4f50-b5f0-8c82e4aee3a5/download-server/0.log"
Jul 24 14:40:36.980207 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:36.980176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:37.113944 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:37.113920    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"]
Jul 24 14:40:37.115649 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:40:37.115628    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode26093bc_c3f5_4531_b6f2_7da0b9c98e94.slice/crio-926a375389ff43dcd3ba707c706eb954c66c2d8938fb638b02c25c332303a09f WatchSource:0}: Error finding container 926a375389ff43dcd3ba707c706eb954c66c2d8938fb638b02c25c332303a09f: Status 404 returned error can't find the container with id 926a375389ff43dcd3ba707c706eb954c66c2d8938fb638b02c25c332303a09f
Jul 24 14:40:38.066933 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:38.066897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p" event={"ID":"e26093bc-c3f5-4531-b6f2-7da0b9c98e94","Type":"ContainerStarted","Data":"10648f1403a3a0122c7fe1d4b4832d2496f8308433bd2f090c04ca6192b6f65b"}
Jul 24 14:40:38.067340 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:38.066952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p" event={"ID":"e26093bc-c3f5-4531-b6f2-7da0b9c98e94","Type":"ContainerStarted","Data":"926a375389ff43dcd3ba707c706eb954c66c2d8938fb638b02c25c332303a09f"}
Jul 24 14:40:38.067340 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:38.066984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:38.084333 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:38.084288    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p" podStartSLOduration=2.0842723420000002 podStartE2EDuration="2.084272342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:38.082029837 +0000 UTC m=+3317.742862997" watchObservedRunningTime="2026-07-24 14:40:38.084272342 +0000 UTC m=+3317.745105501"
Jul 24 14:40:38.601087 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:38.601058    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lckcr_7484e221-d2ef-49df-9f6d-694edcc4b4bf/dns/0.log"
Jul 24 14:40:38.622805 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:38.622783    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lckcr_7484e221-d2ef-49df-9f6d-694edcc4b4bf/kube-rbac-proxy/0.log"
Jul 24 14:40:38.790850 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:38.790807    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kwxst_dba78e9a-afcb-4a83-ba48-0b7cdba7f480/dns-node-resolver/0.log"
Jul 24 14:40:39.417344 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:39.417312    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bfcdt_090e2288-7ba1-4606-9f4f-6845109b2f21/node-ca/0.log"
Jul 24 14:40:40.554047 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:40.554010    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-25j98_d8a10396-e3ca-4706-9bea-80e313874fde/discovery/0.log"
Jul 24 14:40:40.610652 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:40.610620    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-c5vvx_ecaf1bf7-15eb-443d-8357-5a8d95f51f46/kube-auth-proxy/0.log"
Jul 24 14:40:41.611297 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:41.611263    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kgqz2_9b87842e-6bb1-4435-9b5f-efbb63a4ba38/serve-healthcheck-canary/0.log"
Jul 24 14:40:42.448019 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:42.447989    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m64p8_5fd02cc8-40df-471d-94c5-e0386f9c6ed2/kube-rbac-proxy/0.log"
Jul 24 14:40:42.488577 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:42.488556    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m64p8_5fd02cc8-40df-471d-94c5-e0386f9c6ed2/exporter/0.log"
Jul 24 14:40:42.523292 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:42.523265    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m64p8_5fd02cc8-40df-471d-94c5-e0386f9c6ed2/extractor/0.log"
Jul 24 14:40:44.081616 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:44.081590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-db77p"
Jul 24 14:40:44.689081 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:44.689052    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zdd87_3bfe74c5-a810-4e6e-87c8-1f3fe754db47/manager/0.log"
Jul 24 14:40:44.879805 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:44.879775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dwdlh_5482c673-181d-4be0-b2af-39783491a149/manager/0.log"
Jul 24 14:40:44.999316 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:44.999284    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5588d9cbf8-cg582_14a0a40b-8c2b-435a-a88f-a5dc8aeb0749/manager/0.log"
Jul 24 14:40:45.257059 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:45.256978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw_fe69d097-1d0e-429e-8f07-5b154a5920a6/manager/0.log"
Jul 24 14:40:45.279599 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:45.279574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mv2dw_fe69d097-1d0e-429e-8f07-5b154a5920a6/copy-manifests/0.log"
Jul 24 14:40:46.813431 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:46.813357    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z8gqs_2ef26a27-65b7-46b2-9018-94c61dee1309/openshift-lws-operator/0.log"
Jul 24 14:40:47.405681 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.405649    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-25j98_d8a10396-e3ca-4706-9bea-80e313874fde/discovery/0.log"
Jul 24 14:40:47.460530 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.460498    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-c5vvx_ecaf1bf7-15eb-443d-8357-5a8d95f51f46/kube-auth-proxy/0.log"
Jul 24 14:40:47.771051 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.771017    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9rkrj"]
Jul 24 14:40:47.774851 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.774835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9rkrj"
Jul 24 14:40:47.777229 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.777207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jqfvs\""
Jul 24 14:40:47.783241 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.783219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9rkrj"]
Jul 24 14:40:47.860692 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.860661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5s78\" (UniqueName: \"kubernetes.io/projected/d5f50c77-580d-41dd-a8b7-3537a3c1f5d9-kube-api-access-d5s78\") pod \"kuadrant-operator-catalog-9rkrj\" (UID: \"d5f50c77-580d-41dd-a8b7-3537a3c1f5d9\") " pod="kuadrant-system/kuadrant-operator-catalog-9rkrj"
Jul 24 14:40:47.962086 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.962047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5s78\" (UniqueName: \"kubernetes.io/projected/d5f50c77-580d-41dd-a8b7-3537a3c1f5d9-kube-api-access-d5s78\") pod \"kuadrant-operator-catalog-9rkrj\" (UID: \"d5f50c77-580d-41dd-a8b7-3537a3c1f5d9\") " pod="kuadrant-system/kuadrant-operator-catalog-9rkrj"
Jul 24 14:40:47.970413 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:47.970393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5s78\" (UniqueName: \"kubernetes.io/projected/d5f50c77-580d-41dd-a8b7-3537a3c1f5d9-kube-api-access-d5s78\") pod \"kuadrant-operator-catalog-9rkrj\" (UID: \"d5f50c77-580d-41dd-a8b7-3537a3c1f5d9\") " pod="kuadrant-system/kuadrant-operator-catalog-9rkrj"
Jul 24 14:40:48.084847 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:48.084729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9rkrj"
Jul 24 14:40:48.224775 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:48.224749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9rkrj"]
Jul 24 14:40:48.226321 ip-10-0-131-103 kubenswrapper[2563]: W0724 14:40:48.226295    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f50c77_580d_41dd_a8b7_3537a3c1f5d9.slice/crio-9dd6394cd1fb3dd3b5ce339f3601a461dbd6370f77bfc844bc8941ffff8f6409 WatchSource:0}: Error finding container 9dd6394cd1fb3dd3b5ce339f3601a461dbd6370f77bfc844bc8941ffff8f6409: Status 404 returned error can't find the container with id 9dd6394cd1fb3dd3b5ce339f3601a461dbd6370f77bfc844bc8941ffff8f6409
Jul 24 14:40:48.227645 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:48.227627    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:40:49.130000 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:49.129935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9rkrj" event={"ID":"d5f50c77-580d-41dd-a8b7-3537a3c1f5d9","Type":"ContainerStarted","Data":"9dd6394cd1fb3dd3b5ce339f3601a461dbd6370f77bfc844bc8941ffff8f6409"}
Jul 24 14:40:49.374146 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:49.374112    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-25j98_d8a10396-e3ca-4706-9bea-80e313874fde/discovery/0.log"
Jul 24 14:40:49.407875 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:49.407661    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-c5vvx_ecaf1bf7-15eb-443d-8357-5a8d95f51f46/kube-auth-proxy/0.log"
Jul 24 14:40:51.143009 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:51.142977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9rkrj" event={"ID":"d5f50c77-580d-41dd-a8b7-3537a3c1f5d9","Type":"ContainerStarted","Data":"b8f05d829a55542a32b28a10f0f1325d4bc63677f9b26931ecd0166bdd5aee55"}
Jul 24 14:40:51.160378 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:51.160331    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9rkrj" podStartSLOduration=1.9194826520000001 podStartE2EDuration="4.160316247s" totalImagesPullingTime="2.240833595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:51.157612503 +0000 UTC m=+3330.818445663" watchObservedRunningTime="2026-07-24 14:40:51.160316247 +0000 UTC m=+3330.821149404"
Jul 24 14:40:53.431388 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.431357    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnsdl_b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66/kube-multus-additional-cni-plugins/0.log"
Jul 24 14:40:53.453093 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.453068    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnsdl_b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66/egress-router-binary-copy/0.log"
Jul 24 14:40:53.476889 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.476869    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnsdl_b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66/cni-plugins/0.log"
Jul 24 14:40:53.500178 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.500158    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnsdl_b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66/bond-cni-plugin/0.log"
Jul 24 14:40:53.523475 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.523444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnsdl_b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66/routeoverride-cni/0.log"
Jul 24 14:40:53.546994 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.546969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnsdl_b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66/whereabouts-cni-bincopy/0.log"
Jul 24 14:40:53.573743 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.573720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnsdl_b9eda48c-dc2e-4ec5-81bd-fb8bb2bbbf66/whereabouts-cni/0.log"
Jul 24 14:40:53.939726 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:53.939690    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nvr92_442e6b14-6417-445c-af8d-59a6eca71a57/kube-multus/0.log"
Jul 24 14:40:54.038958 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:54.038924    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-772jm_8f166484-6e22-42a7-a142-39336af9517a/network-metrics-daemon/0.log"
Jul 24 14:40:54.058847 ip-10-0-131-103 kubenswrapper[2563]: I0724 14:40:54.058799    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-772jm_8f166484-6e22-42a7-a142-39336af9517a/kube-rbac-proxy/0.log"