Jul 06 12:20:44.669616 ip-10-0-138-192 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 12:20:44.669627 ip-10-0-138-192 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 12:20:44.669634 ip-10-0-138-192 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 12:20:44.669881 ip-10-0-138-192 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 12:20:54.739214 ip-10-0-138-192 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 12:20:54.739230 ip-10-0-138-192 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 41424357b03d41b386c79299bec48907 --
Jul 06 12:22:33.133776 ip-10-0-138-192 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.541090    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547189    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547201    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547205    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547208    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547217    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547220    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547223    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:33.578646 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547226    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547228    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547232    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547235    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547237    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547240    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547243    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547246    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547249    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547252    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547254    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547257    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547259    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547262    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547265    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547268    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547271    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547273    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547277    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:33.591801 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547281    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547284    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547287    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547289    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547292    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547294    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547297    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547299    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547301    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547304    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547308    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547312    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547315    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547318    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547321    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547323    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547326    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547328    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547331    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:33.609400 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547333    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547336    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547339    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547342    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547344    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547347    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547349    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547352    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547355    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547358    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547361    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547363    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547366    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547369    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547371    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547374    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547377    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547379    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547382    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547384    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:33.636709 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547387    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:33.611838 ip-10-0-138-192 systemd[1]: Started Kubernetes Kubelet.
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547390    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547392    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547395    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547397    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547400    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547403    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547406    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547408    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547410    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547413    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547415    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547418    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547420    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547423    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547425    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547428    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547431    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547433    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547435    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:33.667422 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547439    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547442    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547445    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547447    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547450    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547452    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547456    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547459    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547462    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547465    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547467    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547470    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547472    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.547475    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551923    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551933    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551936    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551938    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551941    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551944    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:33.675501 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551947    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551949    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551952    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551955    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551958    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551961    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551965    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551968    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551970    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551973    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551975    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551978    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551981    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551983    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551986    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551989    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551992    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551994    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.551997    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:33.838520 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552000    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552003    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552006    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552008    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552012    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552014    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552017    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552021    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552025    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552029    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552031    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552034    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552037    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552039    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552042    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552045    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552047    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552050    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552053    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:33.840976 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552058    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552061    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552064    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552067    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552070    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552073    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552077    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552080    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552083    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552085    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552088    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552090    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552092    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552095    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552097    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552101    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552104    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552106    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552109    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552111    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:33.841970 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552114    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552116    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552119    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552123    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552128    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552131    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552134    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552137    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552139    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552142    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552144    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552147    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552151    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552154    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552156    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552159    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552161    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552164    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552166    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:33.842807 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552169    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552172    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552174    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552176    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552179    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552181    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552184    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552186    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552192    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552195    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552197    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552199    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552202    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552204    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552207    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.552210    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553120    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553126    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553129    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553133    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:33.845187 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553135    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553138    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553141    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553144    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553146    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553151    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553154    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553156    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553159    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553162    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553164    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553167    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553170    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553173    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553175    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553178    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553181    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553183    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553185    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553188    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:33.845883 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553192    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553194    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553197    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553199    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553202    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553204    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553207    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553209    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553212    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553214    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553217    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553219    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553221    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553224    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553226    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553229    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553231    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553235    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553238    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553240    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:34.000562 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553243    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553245    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553248    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553252    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553255    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553259    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553262    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553265    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553267    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553270    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553272    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553275    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553279    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553281    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553284    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553287    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553291    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553293    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553295    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:34.001344 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553298    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553300    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553303    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553305    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553308    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553310    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553313    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553315    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553318    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553320    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553324    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553327    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553329    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553332    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553334    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553337    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553339    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553341    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553344    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553347    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:34.001951 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553350    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553352    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553355    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553358    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553361    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553366    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553369    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553372    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553375    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553378    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553380    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553383    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553385    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553388    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553390    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.553393    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553459    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553466    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553471    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553475    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553479    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 12:22:34.002771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553482    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553488    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553492    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553495    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553498    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553502    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553505    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553508    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553511    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553513    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553516    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553520    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553523    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553542    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553545    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553548    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553552    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553556    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553564    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553567    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553569    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553573    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553576    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553579    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 12:22:34.003366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553583    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553586    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553588    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553592    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553595    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553598    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553601    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553604    2565 flags.go:64] FLAG: --enable-server="true"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553606    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553612    2565 flags.go:64] FLAG: --event-burst="100"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553615    2565 flags.go:64] FLAG: --event-qps="50"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553618    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553621    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553624    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553627    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553630    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553633    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553636    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553638    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553641    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553645    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553647    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553650    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553653    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553657    2565 flags.go:64] FLAG: --feature-gates=""
Jul 06 12:22:34.004081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553661    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553664    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553667    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553670    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553673    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553676    2565 flags.go:64] FLAG: --help="false"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553678    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553681    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553684    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553687    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553690    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553693    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553696    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553699    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553702    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553705    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553710    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553713    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553715    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553718    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553721    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553724    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553726    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553729    2565 flags.go:64] FLAG: --lock-file=""
Jul 06 12:22:34.004813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553732    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553735    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553738    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553743    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553746    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553749    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553751    2565 flags.go:64] FLAG: --logging-format="text"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553755    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553759    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553761    2565 flags.go:64] FLAG: --manifest-url=""
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553764    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553768    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553771    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553778    2565 flags.go:64] FLAG: --max-pods="110"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553781    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553784    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553787    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553789    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553792    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553795    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553798    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553804    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553807    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553810    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 12:22:34.005481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553814    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553817    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553822    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553825    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553829    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553832    2565 flags.go:64] FLAG: --port="10250"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553834    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553837    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-033f4b61097f8d16e"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553840    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553843    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553846    2565 flags.go:64] FLAG: --register-node="true"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553848    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553852    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553855    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553858    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553861    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553868    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553873    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553877    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553882    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553886    2565 flags.go:64] FLAG: --runonce="false"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553890    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553895    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553900    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553903    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 12:22:34.006131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553906    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553909    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553912    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553915    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553918    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553921    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553923    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553927    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553930    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553933    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553936    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553941    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553944    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553947    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553951    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553954    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553957    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553960    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553962    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553965    2565 flags.go:64] FLAG: --v="2"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553969    2565 flags.go:64] FLAG: --version="false"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553973    2565 flags.go:64] FLAG: --vmodule=""
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553977    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.553981    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554096    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:34.006857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554100    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554104    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554107    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554110    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554113    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554115    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554118    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554121    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554124    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554127    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554129    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554132    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554134    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554137    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554141    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554144    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554146    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554149    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554152    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554154    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:34.007505 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554157    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554159    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554162    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554166    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554169    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554172    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554176    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554178    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554181    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554184    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554188    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554191    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554194    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554196    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554199    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554201    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554204    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554206    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554209    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:34.008093 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554211    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554214    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554216    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554220    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554223    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554226    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554229    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554233    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554235    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554238    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554241    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554244    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554246    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554249    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554252    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554254    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554257    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554260    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554262    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:34.008621 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554265    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554267    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554269    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554272    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554276    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554279    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554282    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554285    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554287    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554290    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554292    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554295    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554297    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554300    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554302    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554305    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554308    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554310    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554313    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554316    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:34.009157 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554320    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554322    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554325    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554327    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554330    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554332    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554336    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554339    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554342    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554345    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554347    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554350    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554353    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554355    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554358    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554360    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554364    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554367    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554370    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:34.009747 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.554372    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.555119    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.562247    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.562262    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.562280    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.562286    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562354    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562358    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562362    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562365    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562368    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562371    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562373    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562376    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562379    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:34.010286 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562382    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562385    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562387    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562390    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562392    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562395    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562397    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562400    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562402    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562405    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562407    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562410    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562412    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562414    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562417    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562423    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562426    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562429    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562431    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562434    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:34.010720 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562436    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562439    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562441    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562444    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562448    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562452    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562456    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562458    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562460    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562463    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562466    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562469    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562472    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562474    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562477    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562479    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562482    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562484    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562487    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:34.011267 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562489    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562492    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562495    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562497    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562500    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562504    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562507    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562510    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562514    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562519    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562522    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562541    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562545    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562548    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562550    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562553    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562555    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562558    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562560    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:34.011798 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562563    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562565    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562568    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562571    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562573    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562584    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562587    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562589    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562592    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562595    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562597    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562600    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562602    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562605    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562607    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562610    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562612    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562615    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562617    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562620    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:34.012394 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562622    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562627    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562629    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562632    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562635    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562638    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562640    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562642    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562645    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562648    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562650    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562653    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.562657    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562778    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562782    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:22:34.013211 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562785    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562788    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562791    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562794    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562796    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562799    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562801    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562804    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562806    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562809    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562812    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562815    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562817    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562820    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562824    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562827    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562830    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562833    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562835    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562840    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:22:34.013726 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562842    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562846    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562850    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562853    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562855    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562857    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562860    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562863    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562865    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562867    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562871    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562874    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562876    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562879    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562882    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562884    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562887    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562889    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562892    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:22:34.134196 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562894    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562897    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562900    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562902    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562905    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562907    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562910    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562912    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562915    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562917    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562920    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562922    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562926    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562928    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562931    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562934    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562936    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562939    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562941    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562944    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:22:34.134844 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562946    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562949    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562953    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562957    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562960    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562962    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562965    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562967    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562970    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562972    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562975    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562977    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562980    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562982    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562985    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562987    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562990    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562993    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562995    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:22:34.135374 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.562997    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563000    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563002    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563005    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563007    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563011    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563013    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563016    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563018    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563021    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563024    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563027    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563029    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563032    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563034    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563037    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563041    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563043    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:22:34.135922 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:33.563046    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.563050    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.563139    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.565275    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.566737    2565 server.go:1019] "Starting client certificate rotation"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.566839    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.566870    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.569329    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.570386    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.578142    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.580184    2565 log.go:25] "Validated CRI v1 image API"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.581028    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 12:22:34.136406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.584012    2565 fs.go:135] Filesystem UUIDs: map[276b4405-432a-44d7-9f0f-3c5f0ac05695:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d40cab53-3460-489b-b6dc-57be38317f1e:/dev/nvme0n1p3]
Jul 06 12:22:34.136834 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.584026    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.589640    2565 manager.go:216] Machine: {Timestamp:2026-07-06 12:22:33.588470068 +0000 UTC m=+0.328661392 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094656 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f7b79c79a9b4e7da071f776e44e7 SystemUUID:ec24f7b7-9c79-a9b4-e7da-071f776e44e7 BootID:41424357-b03d-41b3-86c7-9299bec48907 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:00:15:06:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:00:15:06:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:1d:a7:16:39:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.589734    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.589803    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.593198    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.593228    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.594206    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.594221    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 12:22:34.136901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.594230    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.594965    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.596184    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599267    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599377    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599406    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599418    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599433    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599441    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599449    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599833    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.599848    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.600839    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.602195    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.604195    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.604222    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605358    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605374    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605384    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605392    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605405    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605410    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605419    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605424    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605440    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605448    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605461    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.605468    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.607023    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.607034    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.610451    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.610453    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.610453    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.610622    2565 server.go:1268] "Started kubelet"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.610703    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.610753    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.610814    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.612377    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.613923    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 12:22:34.137201 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.616756    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.618442    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.618445    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.618502    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.619020    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.619026    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.619043    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.619120    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.619127    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622193    2565 factory.go:153] Registering CRI-O factory
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622207    2565 factory.go:223] Registration of the crio container factory successfully
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622251    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622258    2565 factory.go:55] Registering systemd factory
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622263    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622282    2565 factory.go:103] Registering Raw factory
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622292    2565 manager.go:1196] Started watching for new ooms in manager
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.622761    2565 manager.go:349] Starting recovery of all containers
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.624118    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.624333    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.624091    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-192.ec2.internal.18bfb2c8f38216da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-192.ec2.internal,UID:ip-10-0-138-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-192.ec2.internal,},FirstTimestamp:2026-07-06 12:22:33.610598106 +0000 UTC m=+0.350789429,LastTimestamp:2026-07-06 12:22:33.610598106 +0000 UTC m=+0.350789429,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-192.ec2.internal,}"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.631646    2565 manager.go:354] Recovery completed
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.635215    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.637812    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.637840    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.637850    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.638330    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.638340    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.638357    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.638381    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.639097    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.639126    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.639139    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.639634    2565 policy_none.go:49] "None policy: Start"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.639647    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 12:22:34.138205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.639656    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.640704    2565 policy_none.go:47] "Start"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.642493    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-192.ec2.internal.18bfb2c8f52190f2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-192.ec2.internal,UID:ip-10-0-138-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-192.ec2.internal,},FirstTimestamp:2026-07-06 12:22:33.637826802 +0000 UTC m=+0.378018126,LastTimestamp:2026-07-06 12:22:33.637826802 +0000 UTC m=+0.378018126,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-192.ec2.internal,}"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.652949    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-192.ec2.internal.18bfb2c8f521d88b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-192.ec2.internal,UID:ip-10-0-138-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-192.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-192.ec2.internal,},FirstTimestamp:2026-07-06 12:22:33.637845131 +0000 UTC m=+0.378036455,LastTimestamp:2026-07-06 12:22:33.637845131 +0000 UTC m=+0.378036455,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-192.ec2.internal,}"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.655865    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8jp2"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.664060    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8jp2"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.664289    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-192.ec2.internal.18bfb2c8f521f9a0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-192.ec2.internal,UID:ip-10-0-138-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-192.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-192.ec2.internal,},FirstTimestamp:2026-07-06 12:22:33.6378536 +0000 UTC m=+0.378044928,LastTimestamp:2026-07-06 12:22:33.6378536 +0000 UTC m=+0.378044928,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-192.ec2.internal,}"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.702095    2565 manager.go:337] "Starting Device Plugin manager"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.702246    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.702260    2565 server.go:87] "Starting device plugin registration server"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.702474    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.702485    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.702595    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.702663    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.702671    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.703136    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.703175    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.803106    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.803983    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:34.139135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.804015    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.804028    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.804054    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.815518    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.815547    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-192.ec2.internal\": node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.877107    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.878280    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.878311    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.878329    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.878360    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.880640    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.880970    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.978683    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"]
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.978748    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:33.981210    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.982150    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.982179    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.982190    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988330    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988483    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988952    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988958    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988974    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988980    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988983    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.988991    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.990262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.990281    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.990895    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.990917    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:33.990930    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:22:34.139672 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.021366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d0378ccf4b104d7ddf5f5dec179e7cef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"d0378ccf4b104d7ddf5f5dec179e7cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.021386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0378ccf4b104d7ddf5f5dec179e7cef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"d0378ccf4b104d7ddf5f5dec179e7cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.021402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/486559a7564074f1c285c00b4aee521d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-192.ec2.internal\" (UID: \"486559a7564074f1c285c00b4aee521d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.026177    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-192.ec2.internal\" not found" node="ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.030800    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-192.ec2.internal\" not found" node="ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.082188    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.122486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/486559a7564074f1c285c00b4aee521d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-192.ec2.internal\" (UID: \"486559a7564074f1c285c00b4aee521d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.122508    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/486559a7564074f1c285c00b4aee521d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-192.ec2.internal\" (UID: \"486559a7564074f1c285c00b4aee521d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.122544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d0378ccf4b104d7ddf5f5dec179e7cef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"d0378ccf4b104d7ddf5f5dec179e7cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.122563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0378ccf4b104d7ddf5f5dec179e7cef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"d0378ccf4b104d7ddf5f5dec179e7cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.122600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d0378ccf4b104d7ddf5f5dec179e7cef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"d0378ccf4b104d7ddf5f5dec179e7cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.140517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.122623    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0378ccf4b104d7ddf5f5dec179e7cef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"d0378ccf4b104d7ddf5f5dec179e7cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.327187 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.182594    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.327187 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.283100    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.461809 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.329549    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.461809 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.334013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.461809 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.384049    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.484481    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.537970    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.549994    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.565853    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.565946    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.565963    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.599768    2565 apiserver.go:52] "Watching apiserver"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.610594    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.610910    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c","openshift-cluster-node-tuning-operator/tuned-ggfk5","openshift-multus/multus-bznng","openshift-multus/network-metrics-daemon-5mkvm","openshift-network-diagnostics/network-check-target-vvst9","openshift-ovn-kubernetes/ovnkube-node-cn52s","kube-system/global-pull-secret-syncer-7tw8w","kube-system/konnectivity-agent-hpcwq","openshift-dns/node-resolver-vf7t7","openshift-image-registry/node-ca-smk6w","openshift-multus/multus-additional-cni-plugins-r2mcc","openshift-network-operator/iptables-alerter-zc8zr"]
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.612659    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.613930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.615076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.615132    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.615291    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.615331    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.615463    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.620813    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.620894    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.620979    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fzt9w\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.621549    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.621655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.621719    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.622438    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lxntt\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.622632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.623658    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 12:22:34.640926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625045    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-device-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-system-cni-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-etc-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-ovn\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-cnibin\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-os-release\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-conf-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-systemd-units\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-node-log\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-log-socket\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.625982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb6v5\" (UniqueName: \"kubernetes.io/projected/29f69ebe-13c4-45cd-aa9f-982601f1bbde-kube-api-access-nb6v5\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-socket-dir-parent\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-daemon-config\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqtjs\" (UniqueName: \"kubernetes.io/projected/ea2df020-79f7-4796-8b9e-abf3e56aad2c-kube-api-access-hqtjs\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-cni-bin\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-ovnkube-config\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-ovnkube-script-lib\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-cni-multus\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-multus-certs\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqq6z\" (UniqueName: \"kubernetes.io/projected/a2fcc5ce-786d-4f27-822c-f3c694ecae34-kube-api-access-cqq6z\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-kubelet\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-run-netns\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-cni-netd\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-socket-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.642513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-k8s-cni-cncf-io\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/808a53eb-380f-46b4-92ef-3937f7efc323-ovn-node-metrics-cert\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l9rm\" (UniqueName: \"kubernetes.io/projected/808a53eb-380f-46b4-92ef-3937f7efc323-kube-api-access-2l9rm\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626435    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-registration-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-etc-kubernetes\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-slash\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-env-overrides\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-etc-selinux\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-sys-fs\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-cni-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-netns\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-systemd\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.642949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626680    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dl5wz\""
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-run-ovn-kubernetes\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea2df020-79f7-4796-8b9e-abf3e56aad2c-cni-binary-copy\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-cni-bin\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-kubelet\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-hostroot\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-var-lib-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.626842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.627681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.629382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.630582    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.631311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.631483    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.632589    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.632837    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.633055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.633974    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634168    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.634242    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634358    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 12:22:34.643367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.634477    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634638    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634701    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634817    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634845    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634900    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.634964    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635069    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9wb5\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635080    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635134    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j2mm8\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635072    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z5q99\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635365    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635405    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635465    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jdd9q\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dx277\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.635990    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.636078    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.636880    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ssp9g\""
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.637484    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"]
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.638510    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:22:34.644029 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.638568    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.645881    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.652030    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.652307    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal"]
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.665990    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 12:17:34 +0000 UTC" deadline="2028-03-28 16:35:16.133137136 +0000 UTC"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.666016    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15148h12m41.46712308s"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.666932    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-shrkb"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.679307    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-shrkb"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.720008    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.727925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-tmp-dir\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.727950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.727973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-sys-fs\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.727990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-modprobe-d\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-host\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bde49520-4d90-4f17-b377-29fd0557e530-agent-certs\") pod \"konnectivity-agent-hpcwq\" (UID: \"bde49520-4d90-4f17-b377-29fd0557e530\") " pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzq7d\" (UniqueName: \"kubernetes.io/projected/4fcba561-914e-45db-8ec0-3e921eebdf3c-kube-api-access-gzq7d\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728086    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-sys-fs\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-cni-bin\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.806991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-hostroot\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-var-lib-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728180    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-cni-bin\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysctl-d\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728202    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-var-lib-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7401977b-e3e4-44d8-84af-e11d8c898b26-tmp\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728228    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-hostroot\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-device-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-etc-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-ovn\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fcba561-914e-45db-8ec0-3e921eebdf3c-iptables-alerter-script\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728316    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-device-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.811974 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-log-socket\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728345    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-etc-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728376    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-ovn\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728387    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysctl-conf\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728414    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-log-socket\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-systemd\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728439    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-cnibin\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb6v5\" (UniqueName: \"kubernetes.io/projected/29f69ebe-13c4-45cd-aa9f-982601f1bbde-kube-api-access-nb6v5\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-socket-dir-parent\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-daemon-config\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-cni-bin\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-ovnkube-config\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-hosts-file\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.812577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-cni-multus\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-multus-certs\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqq6z\" (UniqueName: \"kubernetes.io/projected/a2fcc5ce-786d-4f27-822c-f3c694ecae34-kube-api-access-cqq6z\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-kubelet\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-run-netns\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-socket-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/808a53eb-380f-46b4-92ef-3937f7efc323-ovn-node-metrics-cert\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l9rm\" (UniqueName: \"kubernetes.io/projected/808a53eb-380f-46b4-92ef-3937f7efc323-kube-api-access-2l9rm\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728772    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-socket-dir-parent\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728969    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-kubelet\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729008    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-run-netns\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729068    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-multus-certs\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729123    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-cni-bin\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729226    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.728775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/784247d6-8be2-490b-9c8b-8e14663c342a-serviceca\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jnk8\" (UniqueName: \"kubernetes.io/projected/0098f38e-3500-45b0-92bb-f8a437825d9f-kube-api-access-4jnk8\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-registration-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-env-overrides\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729664    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-cni-multus\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-kubernetes\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-etc-selinux\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-cni-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729729    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-registration-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-netns\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729767    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-netns\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.813854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-systemd\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729793    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-run-ovn-kubernetes\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-system-cni-dir\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea2df020-79f7-4796-8b9e-abf3e56aad2c-cni-binary-copy\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729851    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-etc-selinux\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-kubelet\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysconfig\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-tuned\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxbb5\" (UniqueName: \"kubernetes.io/projected/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-kube-api-access-vxbb5\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-os-release\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-system-cni-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729965    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-cni-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-sys\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.814370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.729994    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-systemd\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7d9d83-783d-437f-af6b-b106c737db98-kubelet-config\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730013    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29f69ebe-13c4-45cd-aa9f-982601f1bbde-socket-dir\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730021    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-run-ovn-kubernetes\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-run-openvswitch\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bde49520-4d90-4f17-b377-29fd0557e530-konnectivity-ca\") pod \"konnectivity-agent-hpcwq\" (UID: \"bde49520-4d90-4f17-b377-29fd0557e530\") " pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730097    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-var-lib-kubelet\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-cnibin\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730124    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-system-cni-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-os-release\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730171    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-cnibin\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-conf-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-systemd-units\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730211    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-conf-dir\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-node-log\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730267    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-os-release\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-ovnkube-script-lib\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730309    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-node-log\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqtjs\" (UniqueName: \"kubernetes.io/projected/ea2df020-79f7-4796-8b9e-abf3e56aad2c-kube-api-access-hqtjs\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730343    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-systemd-units\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730391    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7d9d83-783d-437f-af6b-b106c737db98-dbus\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/784247d6-8be2-490b-9c8b-8e14663c342a-host\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-cni-netd\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-var-lib-kubelet\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28qk\" (UniqueName: \"kubernetes.io/projected/7401977b-e3e4-44d8-84af-e11d8c898b26-kube-api-access-m28qk\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85lbj\" (UniqueName: \"kubernetes.io/projected/784247d6-8be2-490b-9c8b-8e14663c342a-kube-api-access-85lbj\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fcba561-914e-45db-8ec0-3e921eebdf3c-host-slash\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.815591 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.730737    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-k8s-cni-cncf-io\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-etc-kubernetes\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.730805    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:35.230785367 +0000 UTC m=+1.970976694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730823    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-etc-kubernetes\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-slash\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-run\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730868    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-cni-netd\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/808a53eb-380f-46b4-92ef-3937f7efc323-host-slash\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730951    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea2df020-79f7-4796-8b9e-abf3e56aad2c-host-run-k8s-cni-cncf-io\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-lib-modules\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.730992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.731175    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea2df020-79f7-4796-8b9e-abf3e56aad2c-multus-daemon-config\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.731252    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea2df020-79f7-4796-8b9e-abf3e56aad2c-cni-binary-copy\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.816186 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.731386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-env-overrides\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.731459    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-ovnkube-config\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.731609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/808a53eb-380f-46b4-92ef-3937f7efc323-ovnkube-script-lib\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.734063    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/808a53eb-380f-46b4-92ef-3937f7efc323-ovn-node-metrics-cert\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.742884    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb6v5\" (UniqueName: \"kubernetes.io/projected/29f69ebe-13c4-45cd-aa9f-982601f1bbde-kube-api-access-nb6v5\") pod \"aws-ebs-csi-driver-node-d2v6c\" (UID: \"29f69ebe-13c4-45cd-aa9f-982601f1bbde\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.745882    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqtjs\" (UniqueName: \"kubernetes.io/projected/ea2df020-79f7-4796-8b9e-abf3e56aad2c-kube-api-access-hqtjs\") pod \"multus-bznng\" (UID: \"ea2df020-79f7-4796-8b9e-abf3e56aad2c\") " pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.748253    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqq6z\" (UniqueName: \"kubernetes.io/projected/a2fcc5ce-786d-4f27-822c-f3c694ecae34-kube-api-access-cqq6z\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.750856    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l9rm\" (UniqueName: \"kubernetes.io/projected/808a53eb-380f-46b4-92ef-3937f7efc323-kube-api-access-2l9rm\") pod \"ovnkube-node-cn52s\" (UID: \"808a53eb-380f-46b4-92ef-3937f7efc323\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-var-lib-kubelet\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28qk\" (UniqueName: \"kubernetes.io/projected/7401977b-e3e4-44d8-84af-e11d8c898b26-kube-api-access-m28qk\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85lbj\" (UniqueName: \"kubernetes.io/projected/784247d6-8be2-490b-9c8b-8e14663c342a-kube-api-access-85lbj\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831673    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-var-lib-kubelet\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fcba561-914e-45db-8ec0-3e921eebdf3c-host-slash\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.915984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-run\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831716    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fcba561-914e-45db-8ec0-3e921eebdf3c-host-slash\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-lib-modules\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-tmp-dir\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-modprobe-d\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831780    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-run\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.831885    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-host\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831936    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-lib-modules\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831925    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-modprobe-d\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831964    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-host\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.831970    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret podName:8a7d9d83-783d-437f-af6b-b106c737db98 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:35.331939054 +0000 UTC m=+2.072130383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret") pod "global-pull-secret-syncer-7tw8w" (UID: "8a7d9d83-783d-437f-af6b-b106c737db98") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:34.917234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.831989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bde49520-4d90-4f17-b377-29fd0557e530-agent-certs\") pod \"konnectivity-agent-hpcwq\" (UID: \"bde49520-4d90-4f17-b377-29fd0557e530\") " pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq7d\" (UniqueName: \"kubernetes.io/projected/4fcba561-914e-45db-8ec0-3e921eebdf3c-kube-api-access-gzq7d\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysctl-d\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832082    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7401977b-e3e4-44d8-84af-e11d8c898b26-tmp\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832113    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-tmp-dir\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fcba561-914e-45db-8ec0-3e921eebdf3c-iptables-alerter-script\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832194    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysctl-d\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysctl-conf\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-systemd\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-cnibin\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832390    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-systemd\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.917944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-hosts-file\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832463    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-hosts-file\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-cnibin\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832412    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysctl-conf\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/784247d6-8be2-490b-9c8b-8e14663c342a-serviceca\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnk8\" (UniqueName: \"kubernetes.io/projected/0098f38e-3500-45b0-92bb-f8a437825d9f-kube-api-access-4jnk8\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-kubernetes\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-system-cni-dir\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832711    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysconfig\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832718    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fcba561-914e-45db-8ec0-3e921eebdf3c-iptables-alerter-script\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-tuned\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.918654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxbb5\" (UniqueName: \"kubernetes.io/projected/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-kube-api-access-vxbb5\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-os-release\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832817    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-sysconfig\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-sys\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7d9d83-783d-437f-af6b-b106c737db98-kubelet-config\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832868    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-system-cni-dir\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bde49520-4d90-4f17-b377-29fd0557e530-konnectivity-ca\") pod \"konnectivity-agent-hpcwq\" (UID: \"bde49520-4d90-4f17-b377-29fd0557e530\") " pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832919    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-kubernetes\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7d9d83-783d-437f-af6b-b106c737db98-dbus\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/784247d6-8be2-490b-9c8b-8e14663c342a-host\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832988    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0098f38e-3500-45b0-92bb-f8a437825d9f-os-release\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.832994    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7d9d83-783d-437f-af6b-b106c737db98-kubelet-config\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.833044    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/784247d6-8be2-490b-9c8b-8e14663c342a-host\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.833054    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7401977b-e3e4-44d8-84af-e11d8c898b26-sys\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.833088    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/784247d6-8be2-490b-9c8b-8e14663c342a-serviceca\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.919305 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.833108    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7d9d83-783d-437f-af6b-b106c737db98-dbus\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.833123    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0098f38e-3500-45b0-92bb-f8a437825d9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.833581    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bde49520-4d90-4f17-b377-29fd0557e530-konnectivity-ca\") pod \"konnectivity-agent-hpcwq\" (UID: \"bde49520-4d90-4f17-b377-29fd0557e530\") " pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.834384    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bde49520-4d90-4f17-b377-29fd0557e530-agent-certs\") pod \"konnectivity-agent-hpcwq\" (UID: \"bde49520-4d90-4f17-b377-29fd0557e530\") " pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.834632    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7401977b-e3e4-44d8-84af-e11d8c898b26-tmp\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.841337    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7401977b-e3e4-44d8-84af-e11d8c898b26-etc-tuned\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.843510    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28qk\" (UniqueName: \"kubernetes.io/projected/7401977b-e3e4-44d8-84af-e11d8c898b26-kube-api-access-m28qk\") pod \"tuned-ggfk5\" (UID: \"7401977b-e3e4-44d8-84af-e11d8c898b26\") " pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.846831    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85lbj\" (UniqueName: \"kubernetes.io/projected/784247d6-8be2-490b-9c8b-8e14663c342a-kube-api-access-85lbj\") pod \"node-ca-smk6w\" (UID: \"784247d6-8be2-490b-9c8b-8e14663c342a\") " pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.848236    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.848253    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.848264    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tgp75 for pod openshift-network-diagnostics/network-check-target-vvst9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:34.848310    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75 podName:41bef114-d4a7-4bf7-89c4-e5ae630ef08a nodeName:}" failed. No retries permitted until 2026-07-06 12:22:35.34829546 +0000 UTC m=+2.088486777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tgp75" (UniqueName: "kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75") pod "network-check-target-vvst9" (UID: "41bef114-d4a7-4bf7-89c4-e5ae630ef08a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.848895    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxbb5\" (UniqueName: \"kubernetes.io/projected/d2f4be8f-111b-4ed0-84f0-cab27cc699dc-kube-api-access-vxbb5\") pod \"node-resolver-vf7t7\" (UID: \"d2f4be8f-111b-4ed0-84f0-cab27cc699dc\") " pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.848953    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jnk8\" (UniqueName: \"kubernetes.io/projected/0098f38e-3500-45b0-92bb-f8a437825d9f-kube-api-access-4jnk8\") pod \"multus-additional-cni-plugins-r2mcc\" (UID: \"0098f38e-3500-45b0-92bb-f8a437825d9f\") " pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:34.920026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.848984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzq7d\" (UniqueName: \"kubernetes.io/projected/4fcba561-914e-45db-8ec0-3e921eebdf3c-kube-api-access-gzq7d\") pod \"iptables-alerter-zc8zr\" (UID: \"4fcba561-914e-45db-8ec0-3e921eebdf3c\") " pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:34.994867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.956747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c"
Jul 06 12:22:34.994867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.975978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bznng"
Jul 06 12:22:34.994867 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:34.979917    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f69ebe_13c4_45cd_aa9f_982601f1bbde.slice/crio-1063d889cfb02ea8aa69d0c81dac16d7e25f1516766054d4ec41732b2c7daa40 WatchSource:0}: Error finding container 1063d889cfb02ea8aa69d0c81dac16d7e25f1516766054d4ec41732b2c7daa40: Status 404 returned error can't find the container with id 1063d889cfb02ea8aa69d0c81dac16d7e25f1516766054d4ec41732b2c7daa40
Jul 06 12:22:34.994867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.984437    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:22:34.994867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:34.989224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.004217    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2df020_79f7_4796_8b9e_abf3e56aad2c.slice/crio-fefcb0d7311c56ce851edfb65572a14bc64688c2584a554b0ab059bf37ddbafa WatchSource:0}: Error finding container fefcb0d7311c56ce851edfb65572a14bc64688c2584a554b0ab059bf37ddbafa: Status 404 returned error can't find the container with id fefcb0d7311c56ce851edfb65572a14bc64688c2584a554b0ab059bf37ddbafa
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.004721    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0378ccf4b104d7ddf5f5dec179e7cef.slice/crio-1eacf35430e598f7a0c7ec1b82a97c5767562a276fe0e5fb7943fdb94993a3ae WatchSource:0}: Error finding container 1eacf35430e598f7a0c7ec1b82a97c5767562a276fe0e5fb7943fdb94993a3ae: Status 404 returned error can't find the container with id 1eacf35430e598f7a0c7ec1b82a97c5767562a276fe0e5fb7943fdb94993a3ae
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.018000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.018804    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808a53eb_380f_46b4_92ef_3937f7efc323.slice/crio-83abc20431371fc8ecc31ec3addab04820dd9a25848fa4c1ca7ec66ccb669f27 WatchSource:0}: Error finding container 83abc20431371fc8ecc31ec3addab04820dd9a25848fa4c1ca7ec66ccb669f27: Status 404 returned error can't find the container with id 83abc20431371fc8ecc31ec3addab04820dd9a25848fa4c1ca7ec66ccb669f27
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.036520    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde49520_4d90_4f17_b377_29fd0557e530.slice/crio-0b57308b46e1fc6d62e5dae6432db02ad3edee9164e44175e5ed3475843abf1c WatchSource:0}: Error finding container 0b57308b46e1fc6d62e5dae6432db02ad3edee9164e44175e5ed3475843abf1c: Status 404 returned error can't find the container with id 0b57308b46e1fc6d62e5dae6432db02ad3edee9164e44175e5ed3475843abf1c
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.040928    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vf7t7"
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.054497    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486559a7564074f1c285c00b4aee521d.slice/crio-432a789e161b89680fa1b176e98f3f5efd85edc04b1829d4bd078080c4ef2031 WatchSource:0}: Error finding container 432a789e161b89680fa1b176e98f3f5efd85edc04b1829d4bd078080c4ef2031: Status 404 returned error can't find the container with id 432a789e161b89680fa1b176e98f3f5efd85edc04b1829d4bd078080c4ef2031
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.057501    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f4be8f_111b_4ed0_84f0_cab27cc699dc.slice/crio-51ec2a8f20ecd0933cfab31270fd10381ec3895b31eb09468cc028564e5b7776 WatchSource:0}: Error finding container 51ec2a8f20ecd0933cfab31270fd10381ec3895b31eb09468cc028564e5b7776: Status 404 returned error can't find the container with id 51ec2a8f20ecd0933cfab31270fd10381ec3895b31eb09468cc028564e5b7776
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.077669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smk6w"
Jul 06 12:22:35.103857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.103620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2mcc"
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.110320    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0098f38e_3500_45b0_92bb_f8a437825d9f.slice/crio-b84f3b9971399bcbdc8c19ce473ef7e787f45f624fb51233bb688ba5aa90d658 WatchSource:0}: Error finding container b84f3b9971399bcbdc8c19ce473ef7e787f45f624fb51233bb688ba5aa90d658: Status 404 returned error can't find the container with id b84f3b9971399bcbdc8c19ce473ef7e787f45f624fb51233bb688ba5aa90d658
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.120455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zc8zr"
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.127592    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcba561_914e_45db_8ec0_3e921eebdf3c.slice/crio-7fb4e2aafc424bc6e2f8de86d42c07a13b4c4b01e2f860a4452ff0ab4d9985d0 WatchSource:0}: Error finding container 7fb4e2aafc424bc6e2f8de86d42c07a13b4c4b01e2f860a4452ff0ab4d9985d0: Status 404 returned error can't find the container with id 7fb4e2aafc424bc6e2f8de86d42c07a13b4c4b01e2f860a4452ff0ab4d9985d0
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.127658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggfk5"
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:22:35.134402    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7401977b_e3e4_44d8_84af_e11d8c898b26.slice/crio-c743f3eea01037d8d9c02c82651a3292d2ff1a3e5a679664cbcd7781ca126c5e WatchSource:0}: Error finding container c743f3eea01037d8d9c02c82651a3292d2ff1a3e5a679664cbcd7781ca126c5e: Status 404 returned error can't find the container with id c743f3eea01037d8d9c02c82651a3292d2ff1a3e5a679664cbcd7781ca126c5e
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.135828    2565 kuberuntime_manager.go:1459] "Unhandled Error" err="container tuned start failed in pod tuned-ggfk5_openshift-cluster-node-tuning-operator(7401977b-e3e4-44d8-84af-e11d8c898b26): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.135859    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-ggfk5" podUID="7401977b-e3e4-44d8-84af-e11d8c898b26"
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.203720    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.235510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.235622    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:35.270912 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.235665    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:36.235652521 +0000 UTC m=+2.975843833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:35.413315 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.336702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:35.413315 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.336827    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:35.413315 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.336877    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret podName:8a7d9d83-783d-437f-af6b-b106c737db98 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:36.336863282 +0000 UTC m=+3.077054599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret") pod "global-pull-secret-syncer-7tw8w" (UID: "8a7d9d83-783d-437f-af6b-b106c737db98") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:35.488217 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.437760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:35.488217 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.437930    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:35.488217 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.437952    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:35.488217 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.437966    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tgp75 for pod openshift-network-diagnostics/network-check-target-vvst9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:35.488217 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.438014    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75 podName:41bef114-d4a7-4bf7-89c4-e5ae630ef08a nodeName:}" failed. No retries permitted until 2026-07-06 12:22:36.437999208 +0000 UTC m=+3.178190557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgp75" (UniqueName: "kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75") pod "network-check-target-vvst9" (UID: "41bef114-d4a7-4bf7-89c4-e5ae630ef08a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:35.682039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.681250    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 12:17:35 +0000 UTC" deadline="2027-12-21 03:48:59.089807462 +0000 UTC"
Jul 06 12:22:35.682039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.681309    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12783h26m23.40850218s"
Jul 06 12:22:35.917101 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.881589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:35.917101 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:35.881733    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:35.982552 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:35.982027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smk6w" event={"ID":"784247d6-8be2-490b-9c8b-8e14663c342a","Type":"ContainerStarted","Data":"d09586a4298b86eb33d9fa25e5bc378c2f805ee94861112c63a9b0dda1f9e590"}
Jul 06 12:22:36.008499 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.008364    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:36.021805 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.021772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vf7t7" event={"ID":"d2f4be8f-111b-4ed0-84f0-cab27cc699dc","Type":"ContainerStarted","Data":"51ec2a8f20ecd0933cfab31270fd10381ec3895b31eb09468cc028564e5b7776"}
Jul 06 12:22:36.042947 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.042794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hpcwq" event={"ID":"bde49520-4d90-4f17-b377-29fd0557e530","Type":"ContainerStarted","Data":"0b57308b46e1fc6d62e5dae6432db02ad3edee9164e44175e5ed3475843abf1c"}
Jul 06 12:22:36.062984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.062955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"83abc20431371fc8ecc31ec3addab04820dd9a25848fa4c1ca7ec66ccb669f27"}
Jul 06 12:22:36.066075 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.066047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggfk5" event={"ID":"7401977b-e3e4-44d8-84af-e11d8c898b26","Type":"ContainerStarted","Data":"c743f3eea01037d8d9c02c82651a3292d2ff1a3e5a679664cbcd7781ca126c5e"}
Jul 06 12:22:36.068309 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.068279    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5be8cdcf34f35a89a70b6bfa49e66897641871237570b3e09766f83a0a473e6a\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-ggfk5" podUID="7401977b-e3e4-44d8-84af-e11d8c898b26"
Jul 06 12:22:36.092926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.092833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zc8zr" event={"ID":"4fcba561-914e-45db-8ec0-3e921eebdf3c","Type":"ContainerStarted","Data":"7fb4e2aafc424bc6e2f8de86d42c07a13b4c4b01e2f860a4452ff0ab4d9985d0"}
Jul 06 12:22:36.104626 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.104582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerStarted","Data":"b84f3b9971399bcbdc8c19ce473ef7e787f45f624fb51233bb688ba5aa90d658"}
Jul 06 12:22:36.133795 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.133690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" event={"ID":"486559a7564074f1c285c00b4aee521d","Type":"ContainerStarted","Data":"432a789e161b89680fa1b176e98f3f5efd85edc04b1829d4bd078080c4ef2031"}
Jul 06 12:22:36.142966 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.142929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bznng" event={"ID":"ea2df020-79f7-4796-8b9e-abf3e56aad2c","Type":"ContainerStarted","Data":"fefcb0d7311c56ce851edfb65572a14bc64688c2584a554b0ab059bf37ddbafa"}
Jul 06 12:22:36.147179 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.147154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c" event={"ID":"29f69ebe-13c4-45cd-aa9f-982601f1bbde","Type":"ContainerStarted","Data":"1063d889cfb02ea8aa69d0c81dac16d7e25f1516766054d4ec41732b2c7daa40"}
Jul 06 12:22:36.168693 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.168665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" event={"ID":"d0378ccf4b104d7ddf5f5dec179e7cef","Type":"ContainerStarted","Data":"1eacf35430e598f7a0c7ec1b82a97c5767562a276fe0e5fb7943fdb94993a3ae"}
Jul 06 12:22:36.244280 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.243819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:36.244280 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.243988    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:36.244280 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.244048    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:38.244029056 +0000 UTC m=+4.984220386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:36.345101 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.345020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:36.345252 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.345215    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:36.345315 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.345289    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret podName:8a7d9d83-783d-437f-af6b-b106c737db98 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:38.345269169 +0000 UTC m=+5.085460483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret") pod "global-pull-secret-syncer-7tw8w" (UID: "8a7d9d83-783d-437f-af6b-b106c737db98") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:36.446127 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.446079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:36.446313 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.446271    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:36.446313 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.446290    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:36.446313 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.446305    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tgp75 for pod openshift-network-diagnostics/network-check-target-vvst9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:36.446489 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.446366    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75 podName:41bef114-d4a7-4bf7-89c4-e5ae630ef08a nodeName:}" failed. No retries permitted until 2026-07-06 12:22:38.446347183 +0000 UTC m=+5.186538502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgp75" (UniqueName: "kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75") pod "network-check-target-vvst9" (UID: "41bef114-d4a7-4bf7-89c4-e5ae630ef08a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:36.681673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.681554    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 12:17:35 +0000 UTC" deadline="2028-02-03 19:58:14.232250401 +0000 UTC"
Jul 06 12:22:36.681673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.681623    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13855h35m37.550633327s"
Jul 06 12:22:36.879735 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.879695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:36.880216 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.879839    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:36.880281 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:36.880218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:36.880388 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:36.880327    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:37.537337 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:37.537020    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:22:37.881147 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:37.881069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:37.881577 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:37.881203    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:38.262493 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:38.262411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:38.262743 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.262546    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:38.262743 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.262628    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:42.262607127 +0000 UTC m=+9.002798461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:38.363381 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:38.363342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:38.363542 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.363497    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:38.363599 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.363580    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret podName:8a7d9d83-783d-437f-af6b-b106c737db98 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:42.363545388 +0000 UTC m=+9.103736756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret") pod "global-pull-secret-syncer-7tw8w" (UID: "8a7d9d83-783d-437f-af6b-b106c737db98") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:38.465036 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:38.464365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:38.465036 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.464595    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:38.465036 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.464620    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:38.465036 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.464633    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tgp75 for pod openshift-network-diagnostics/network-check-target-vvst9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:38.465036 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.464688    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75 podName:41bef114-d4a7-4bf7-89c4-e5ae630ef08a nodeName:}" failed. No retries permitted until 2026-07-06 12:22:42.464668743 +0000 UTC m=+9.204860056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgp75" (UniqueName: "kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75") pod "network-check-target-vvst9" (UID: "41bef114-d4a7-4bf7-89c4-e5ae630ef08a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:38.879547 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:38.879505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:38.879724 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.879693    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:38.879790 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:38.879754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:38.879866 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:38.879839    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:39.879077 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:39.879043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:39.879573 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:39.879183    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:40.879202 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:40.878666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:40.879202 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:40.878812    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:40.879202 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:40.879022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:40.879202 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:40.879141    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:41.879432 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:41.879370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:41.879928 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:41.879512    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:42.297632 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:42.297602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:42.297855 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.297833    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:42.297982 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.297909    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:50.29788739 +0000 UTC m=+17.038078706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:42.399204 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:42.399118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:42.399376 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.399266    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:42.399376 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.399330    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret podName:8a7d9d83-783d-437f-af6b-b106c737db98 nodeName:}" failed. No retries permitted until 2026-07-06 12:22:50.3993142 +0000 UTC m=+17.139505513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret") pod "global-pull-secret-syncer-7tw8w" (UID: "8a7d9d83-783d-437f-af6b-b106c737db98") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:42.500079 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:42.500035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:42.500280 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.500254    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:42.500357 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.500294    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:42.500357 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.500311    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tgp75 for pod openshift-network-diagnostics/network-check-target-vvst9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:42.500433 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.500385    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75 podName:41bef114-d4a7-4bf7-89c4-e5ae630ef08a nodeName:}" failed. No retries permitted until 2026-07-06 12:22:50.500363173 +0000 UTC m=+17.240554509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgp75" (UniqueName: "kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75") pod "network-check-target-vvst9" (UID: "41bef114-d4a7-4bf7-89c4-e5ae630ef08a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:42.879150 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:42.878999    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:42.879150 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:42.879039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:42.879403 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.879158    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:42.879403 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:42.879247    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:43.880607 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:43.880564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:43.881082 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:43.880708    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:44.878867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:44.878704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:44.878989 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:44.878960    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:44.878989 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:44.878719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:44.879131 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:44.879104    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:45.199907 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:45.199636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" event={"ID":"486559a7564074f1c285c00b4aee521d","Type":"ContainerStarted","Data":"d50a4aa70593bf49fd7de9584e8bc3ff5f14e5a4b75a6a6434caad73155d2709"}
Jul 06 12:22:45.879148 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:45.879116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:45.879282 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:45.879246    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:46.205890 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.205853    2565 generic.go:356] "Generic (PLEG): container finished" podID="0098f38e-3500-45b0-92bb-f8a437825d9f" containerID="d26e8c95f8b834052a4ba39f9885335f1d0bfcff619cd5f4fde3dc32f08d7fe7" exitCode=0
Jul 06 12:22:46.206416 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.205952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerDied","Data":"d26e8c95f8b834052a4ba39f9885335f1d0bfcff619cd5f4fde3dc32f08d7fe7"}
Jul 06 12:22:46.207656 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.207629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c" event={"ID":"29f69ebe-13c4-45cd-aa9f-982601f1bbde","Type":"ContainerStarted","Data":"9c8d89f129f8748a18f3985292ea9a71b4c7c74205c6df2b6853d0d640b68220"}
Jul 06 12:22:46.209308 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.209274    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0378ccf4b104d7ddf5f5dec179e7cef" containerID="b025eba27f28ac285dda1b866ce4c7206e432fb8957c637384119f4fbff76817" exitCode=0
Jul 06 12:22:46.209429 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.209373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" event={"ID":"d0378ccf4b104d7ddf5f5dec179e7cef","Type":"ContainerDied","Data":"b025eba27f28ac285dda1b866ce4c7206e432fb8957c637384119f4fbff76817"}
Jul 06 12:22:46.211025 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.211001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smk6w" event={"ID":"784247d6-8be2-490b-9c8b-8e14663c342a","Type":"ContainerStarted","Data":"b72b1b8cd14ae407e58b5dd03011c054b54c3da8b34a5b5d01ae731eb40067e8"}
Jul 06 12:22:46.212669 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.212648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vf7t7" event={"ID":"d2f4be8f-111b-4ed0-84f0-cab27cc699dc","Type":"ContainerStarted","Data":"2b8e26b6b628bf25c473685de023ec12dca1c6a8efe0c4a7e06d758283926a64"}
Jul 06 12:22:46.214133 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.214094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hpcwq" event={"ID":"bde49520-4d90-4f17-b377-29fd0557e530","Type":"ContainerStarted","Data":"f1329184dc818f5d7f6ba3e7f5975ab45971186b4d7e4ba264b39afc0f296d0f"}
Jul 06 12:22:46.234176 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.234137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" podStartSLOduration=11.234125761 podStartE2EDuration="11.234125761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:45.21918039 +0000 UTC m=+11.959371736" watchObservedRunningTime="2026-07-06 12:22:46.234125761 +0000 UTC m=+12.974317094"
Jul 06 12:22:46.271069 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.271025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hpcwq" podStartSLOduration=2.501386133 podStartE2EDuration="12.271011137s" totalImagesPullingTime="9.769625004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:46.27068635 +0000 UTC m=+13.010877684" watchObservedRunningTime="2026-07-06 12:22:46.271011137 +0000 UTC m=+13.011202470"
Jul 06 12:22:46.287142 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.287097    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vf7t7" podStartSLOduration=2.536363095 podStartE2EDuration="12.287080116s" totalImagesPullingTime="9.750717021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:46.286782594 +0000 UTC m=+13.026973930" watchObservedRunningTime="2026-07-06 12:22:46.287080116 +0000 UTC m=+13.027271450"
Jul 06 12:22:46.305906 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.305854    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-smk6w" podStartSLOduration=2.581586102 podStartE2EDuration="12.305841877s" totalImagesPullingTime="9.724255775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:46.305572561 +0000 UTC m=+13.045763895" watchObservedRunningTime="2026-07-06 12:22:46.305841877 +0000 UTC m=+13.046033210"
Jul 06 12:22:46.879079 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.879043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:46.879240 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:46.879043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:46.879240 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:46.879168    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:46.879240 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:46.879228    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:47.217735 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:47.217587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zc8zr" event={"ID":"4fcba561-914e-45db-8ec0-3e921eebdf3c","Type":"ContainerStarted","Data":"2325ed97f29fcda155dfe8271f92aacf245261378ee14797d4924aca7670137e"}
Jul 06 12:22:47.242132 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:47.242086    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zc8zr" podStartSLOduration=3.552454544 podStartE2EDuration="13.24206931s" totalImagesPullingTime="9.689614766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:47.24201268 +0000 UTC m=+13.982204013" watchObservedRunningTime="2026-07-06 12:22:47.24206931 +0000 UTC m=+13.982260642"
Jul 06 12:22:47.441921 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:47.441889    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:47.442490 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:47.442464    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:47.879254 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:47.879220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:47.879403 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:47.879359    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:48.878594 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:48.878561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:48.878954 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:48.878677    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:48.878954 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:48.878740    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:48.878954 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:48.878858    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:49.221352 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:49.221161    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 12:22:49.646490 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:49.646451    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:49.647263 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:49.647213    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hpcwq"
Jul 06 12:22:49.878786 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:49.878736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:49.879227 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:49.878933    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:50.356472 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:50.356175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:50.356472 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.356338    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:50.356472 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.356405    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:06.356385969 +0000 UTC m=+33.096577285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:22:50.457585 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:50.457545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:50.457742 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.457672    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:50.457742 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.457737    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret podName:8a7d9d83-783d-437f-af6b-b106c737db98 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:06.457714979 +0000 UTC m=+33.197906295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret") pod "global-pull-secret-syncer-7tw8w" (UID: "8a7d9d83-783d-437f-af6b-b106c737db98") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:22:50.558303 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:50.558250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:50.558501 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.558429    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:22:50.558501 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.558453    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:22:50.558501 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.558468    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tgp75 for pod openshift-network-diagnostics/network-check-target-vvst9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:50.558643 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.558539    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75 podName:41bef114-d4a7-4bf7-89c4-e5ae630ef08a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:06.558506643 +0000 UTC m=+33.298697973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgp75" (UniqueName: "kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75") pod "network-check-target-vvst9" (UID: "41bef114-d4a7-4bf7-89c4-e5ae630ef08a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:22:50.878889 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:50.878860    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:50.879290 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:50.878860    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:50.879290 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.878984    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:50.879290 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:50.879053    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:51.879138 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:51.879092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:51.879705 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:51.879217    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:52.879437 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:52.879397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:52.879894 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:52.879397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:52.879894 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:52.879554    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:52.879894 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:52.879689    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:53.880095 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:53.880059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:53.880723 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:53.880146    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:54.879470 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:54.879438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:54.879659 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:54.879436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:54.879659 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:54.879588    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:54.879756 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:54.879651    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:55.879023 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:55.878792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:55.879023 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:55.879007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:55.914639 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:55.914138    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 12:22:56.239405 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.239374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"6c8fdc438f56baa58a8e248aeec7c0ad9ab3997070b968e90c21bf378674b40f"}
Jul 06 12:22:56.239498 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.239465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"022b70c12b853984434d1ec886e6bbe2e5b4a554c468f8d1cc137df341798254"}
Jul 06 12:22:56.239623 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.239517    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"33d3e186ab6efca95c2a5a578ca53418928f2c1b560a367b90b2763cc5bf3f67"}
Jul 06 12:22:56.239623 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.239581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"7741b8faa3e866fdb7e064b6765688d0c41d93a9fd7dc41284859269a742c8b9"}
Jul 06 12:22:56.241751 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.241718    2565 generic.go:356] "Generic (PLEG): container finished" podID="0098f38e-3500-45b0-92bb-f8a437825d9f" containerID="3710825556d9c7a5a5198e85288f8c99015655026ca852d7beb80264d4b26db4" exitCode=0
Jul 06 12:22:56.241849 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.241790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerDied","Data":"3710825556d9c7a5a5198e85288f8c99015655026ca852d7beb80264d4b26db4"}
Jul 06 12:22:56.243479 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.243453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bznng" event={"ID":"ea2df020-79f7-4796-8b9e-abf3e56aad2c","Type":"ContainerStarted","Data":"e5b7061db4d239d716a19ed5dcfc342684df940332d7d642d3890301741647a0"}
Jul 06 12:22:56.245520 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.245458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c" event={"ID":"29f69ebe-13c4-45cd-aa9f-982601f1bbde","Type":"ContainerStarted","Data":"9f296036369bf63be07f9ab857c2c6ab129f7fd4c6115d163282e2cac067f7b8"}
Jul 06 12:22:56.247650 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.247626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" event={"ID":"d0378ccf4b104d7ddf5f5dec179e7cef","Type":"ContainerStarted","Data":"4fe04982b154fe5040e78a7ddb8f9d87538789cf8dfb6a7b12602e8d9077be4a"}
Jul 06 12:22:56.309400 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.309359    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bznng" podStartSLOduration=1.6039223950000001 podStartE2EDuration="22.309344563s" totalImagesPullingTime="20.705422168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:56.309036854 +0000 UTC m=+23.049228192" watchObservedRunningTime="2026-07-06 12:22:56.309344563 +0000 UTC m=+23.049535895"
Jul 06 12:22:56.309703 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.309674    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" podStartSLOduration=21.309665486 podStartE2EDuration="21.309665486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:22:56.286802847 +0000 UTC m=+23.026994180" watchObservedRunningTime="2026-07-06 12:22:56.309665486 +0000 UTC m=+23.049856819"
Jul 06 12:22:56.715655 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.715554    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T12:22:55.914157926Z","UUID":"4c0d27f0-be40-4413-86c2-4a9ac6568048","Handler":null,"Name":"","Endpoint":""}
Jul 06 12:22:56.717307 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.717144    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 12:22:56.717446 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.717325    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 12:22:56.879318 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.879287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:56.879318 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:56.879325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:56.879841 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:56.879433    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:56.879841 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:56.879610    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:57.253175 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:57.253133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"2f6089d79caa95cb5b0b2ade71fb94ca477ee6dd0eed9777019a5b1e95a20ff6"}
Jul 06 12:22:57.879324 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:57.879292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:57.879914 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:57.879423    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:22:58.878938 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:58.878910    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:22:58.879082 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:58.879007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:22:58.879082 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:58.879058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:22:58.879159 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:58.879141    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:22:59.881730 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:22:59.881707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:22:59.882191 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:22:59.881797    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:00.265214 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.265146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggfk5" event={"ID":"7401977b-e3e4-44d8-84af-e11d8c898b26","Type":"ContainerStarted","Data":"d65f37250b9d68954df305af2f9555d89d815476aa9a7ecdbd439b87fd57e755"}
Jul 06 12:23:00.267210 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.267183    2565 generic.go:356] "Generic (PLEG): container finished" podID="0098f38e-3500-45b0-92bb-f8a437825d9f" containerID="747ccedd0063b4b93f6ee823ddaaf4d3ec04ca9368b381d7b0b2361ef775dc94" exitCode=0
Jul 06 12:23:00.267317 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.267259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerDied","Data":"747ccedd0063b4b93f6ee823ddaaf4d3ec04ca9368b381d7b0b2361ef775dc94"}
Jul 06 12:23:00.269593 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.269565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c" event={"ID":"29f69ebe-13c4-45cd-aa9f-982601f1bbde","Type":"ContainerStarted","Data":"17a58605f50fd5d188f43886eafba44d2ef317595d6a3c98f5506e4b889d9054"}
Jul 06 12:23:00.272521 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.272499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"ed81a9ee3cdd90096c21594f49a2a0d3a921983e02bbe64771caea45cd330ecb"}
Jul 06 12:23:00.286319 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.286281    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ggfk5" podStartSLOduration=1.212545933 podStartE2EDuration="25.286269506s" totalImagesPullingTime="24.073723573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 12:23:00.285816893 +0000 UTC m=+27.026008227" watchObservedRunningTime="2026-07-06 12:23:00.286269506 +0000 UTC m=+27.026460888"
Jul 06 12:23:00.343180 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.343143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d2v6c" podStartSLOduration=2.729201775 podStartE2EDuration="26.343130334s" totalImagesPullingTime="23.613928559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:00.307872499 +0000 UTC m=+27.048063831" watchObservedRunningTime="2026-07-06 12:23:00.343130334 +0000 UTC m=+27.083321667"
Jul 06 12:23:00.879481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.879450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:00.879481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:00.879476    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:00.879683 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:00.879558    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:00.879683 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:00.879669    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:01.878603 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:01.878576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:01.879121 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:01.878668    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:02.277971 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:02.277943    2565 generic.go:356] "Generic (PLEG): container finished" podID="0098f38e-3500-45b0-92bb-f8a437825d9f" containerID="95eb9617876d9c4fc5c62c821283fe037b504ceba60fba7903683ee332d0fd16" exitCode=0
Jul 06 12:23:02.278095 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:02.278029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerDied","Data":"95eb9617876d9c4fc5c62c821283fe037b504ceba60fba7903683ee332d0fd16"}
Jul 06 12:23:02.281376 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:02.281356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"ddb236c504eb0e20a8b17e031ade611b1d212388d84bb6cb20e3597643f3f896"}
Jul 06 12:23:02.878611 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:02.878577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:02.879010 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:02.878710    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:02.879010 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:02.878718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:02.879010 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:02.878810    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:03.879825 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:03.879622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:03.880401 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:03.879883    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:04.289224 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:04.289150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" event={"ID":"808a53eb-380f-46b4-92ef-3937f7efc323","Type":"ContainerStarted","Data":"4bfd8859a8067ba91bf0e6a7d43fe3d1181271ec250b8855b74820362087afb6"}
Jul 06 12:23:04.289421 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:04.289396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:23:04.289568 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:04.289447    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:23:04.305329 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:04.305308    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:23:04.318622 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:04.318573    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s" podStartSLOduration=9.625480302 podStartE2EDuration="30.318555578s" totalImagesPullingTime="20.693075276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:04.318287645 +0000 UTC m=+31.058479012" watchObservedRunningTime="2026-07-06 12:23:04.318555578 +0000 UTC m=+31.058746909"
Jul 06 12:23:04.878726 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:04.878625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:04.878910 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:04.878625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:04.878910 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:04.878764    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:04.879032 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:04.878938    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:05.292582 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.292485    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:23:05.308944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.308919    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:23:05.834158 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.834124    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7tw8w"]
Jul 06 12:23:05.834363 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.834239    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:05.834363 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:05.834344    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:05.837900 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.837877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvst9"]
Jul 06 12:23:05.838014 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.837973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:05.838090 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:05.838068    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:05.862819 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.862794    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5mkvm"]
Jul 06 12:23:05.862939 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:05.862892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:05.863012 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:05.862989    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:06.381585 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:06.381546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:06.382093 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.381687    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:23:06.382093 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.381751    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:38.38173258 +0000 UTC m=+65.121923895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:23:06.482750 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:06.482716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:06.482956 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.482932    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:23:06.483027 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.483002    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret podName:8a7d9d83-783d-437f-af6b-b106c737db98 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:38.482983193 +0000 UTC m=+65.223174524 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret") pod "global-pull-secret-syncer-7tw8w" (UID: "8a7d9d83-783d-437f-af6b-b106c737db98") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:23:06.583115 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:06.583088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:06.583263 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.583244    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:23:06.583302 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.583269    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:23:06.583302 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.583278    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tgp75 for pod openshift-network-diagnostics/network-check-target-vvst9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:23:06.583363 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.583324    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75 podName:41bef114-d4a7-4bf7-89c4-e5ae630ef08a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:38.583310399 +0000 UTC m=+65.323501710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgp75" (UniqueName: "kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75") pod "network-check-target-vvst9" (UID: "41bef114-d4a7-4bf7-89c4-e5ae630ef08a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:23:06.879471 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:06.879442    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:06.879672 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:06.879574    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:07.301504 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:07.301421    2565 generic.go:356] "Generic (PLEG): container finished" podID="0098f38e-3500-45b0-92bb-f8a437825d9f" containerID="ba7ff95bc3bb05a3c0a7ad9d3e882c86876d3f0dd3ba3711ca38b68636fb5032" exitCode=0
Jul 06 12:23:07.301667 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:07.301502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerDied","Data":"ba7ff95bc3bb05a3c0a7ad9d3e882c86876d3f0dd3ba3711ca38b68636fb5032"}
Jul 06 12:23:07.878521 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:07.878491    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:07.878967 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:07.878613    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:07.878967 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:07.878666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:07.878967 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:07.878756    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:08.306233 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:08.306144    2565 generic.go:356] "Generic (PLEG): container finished" podID="0098f38e-3500-45b0-92bb-f8a437825d9f" containerID="5533df35d2b3978c133555fa4e7b38dfc14d6576fe9ab701ec2ecbd0932d9606" exitCode=0
Jul 06 12:23:08.306233 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:08.306208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerDied","Data":"5533df35d2b3978c133555fa4e7b38dfc14d6576fe9ab701ec2ecbd0932d9606"}
Jul 06 12:23:08.878737 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:08.878706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:08.879074 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:08.878799    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:09.311134 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:09.311058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" event={"ID":"0098f38e-3500-45b0-92bb-f8a437825d9f","Type":"ContainerStarted","Data":"c74abc628eb1e6063ad10241093a9425bb76d964a984e97b9abe021d65667d5d"}
Jul 06 12:23:09.342865 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:09.342820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r2mcc" podStartSLOduration=7.720123246 podStartE2EDuration="35.342807861s" totalImagesPullingTime="27.622684615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:09.341751685 +0000 UTC m=+36.081943017" watchObservedRunningTime="2026-07-06 12:23:09.342807861 +0000 UTC m=+36.082999194"
Jul 06 12:23:09.878937 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:09.878901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:09.879276 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:09.879017    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:09.879276 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:09.879072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:09.879276 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:09.879156    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:10.879221 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:10.879194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:10.879651 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:10.879281    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:11.879363 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:11.879159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:11.879363 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:11.879177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:11.879808 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:11.879458    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:11.879808 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:11.879585    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:12.878680 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:12.878649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:12.878888 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:12.878759    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:13.879956 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:13.879925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:13.880457 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:13.880019    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tw8w" podUID="8a7d9d83-783d-437f-af6b-b106c737db98"
Jul 06 12:23:13.880457 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:13.880069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:13.880457 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:13.880201    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5mkvm" podUID="a2fcc5ce-786d-4f27-822c-f3c694ecae34"
Jul 06 12:23:14.878900 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:14.878872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:14.879042 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:14.878965    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvst9" podUID="41bef114-d4a7-4bf7-89c4-e5ae630ef08a"
Jul 06 12:23:15.500928 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.499491    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeReady"
Jul 06 12:23:15.500928 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.499639    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 12:23:15.549357 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.549332    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"]
Jul 06 12:23:15.575577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.575552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.576375 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.576355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"]
Jul 06 12:23:15.584583 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.584560    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 12:23:15.586011 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.585033    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 12:23:15.586011 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.585564    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4scf5"]
Jul 06 12:23:15.586011 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.585811    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 12:23:15.586328 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.586204    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mnq4l\""
Jul 06 12:23:15.592482 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.592462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 12:23:15.600049 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.600031    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jwv4g"]
Jul 06 12:23:15.600182 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.600157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.602703 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.602685    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 12:23:15.602905 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.602688    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 12:23:15.603058 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.602709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gt55k\""
Jul 06 12:23:15.610907 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.610889    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4scf5"]
Jul 06 12:23:15.610983 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.610920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwv4g"]
Jul 06 12:23:15.610983 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.610975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:15.613543 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.613515    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 12:23:15.613616 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.613606    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 12:23:15.614245 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.614231    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 12:23:15.614339 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.614326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ll78r\""
Jul 06 12:23:15.754908 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.754846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-trusted-ca\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.754908 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.754873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-bound-sa-token\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.754908 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.754890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptlz\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-kube-api-access-tptlz\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.754908 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.754908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgn2\" (UniqueName: \"kubernetes.io/projected/52264f9c-4bb1-48ee-86e5-13c5533cf69e-kube-api-access-5pgn2\") pod \"ingress-canary-jwv4g\" (UID: \"52264f9c-4bb1-48ee-86e5-13c5533cf69e\") " pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:15.755114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.754934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-config-volume\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.755114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.754998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-tmp-dir\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.755114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7169e464-346a-4e1a-91c8-2e4dfa70209a-ca-trust-extracted\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.755114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-certificates\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.755114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-installation-pull-secrets\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.755257 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-image-registry-private-configuration\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.755257 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb44l\" (UniqueName: \"kubernetes.io/projected/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-kube-api-access-cb44l\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.755257 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.755257 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52264f9c-4bb1-48ee-86e5-13c5533cf69e-cert\") pod \"ingress-canary-jwv4g\" (UID: \"52264f9c-4bb1-48ee-86e5-13c5533cf69e\") " pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:15.755257 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.755222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856103 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-config-volume\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.856228 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-tmp-dir\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.856228 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7169e464-346a-4e1a-91c8-2e4dfa70209a-ca-trust-extracted\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856228 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-certificates\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856228 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-installation-pull-secrets\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856385 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-image-registry-private-configuration\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856385 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb44l\" (UniqueName: \"kubernetes.io/projected/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-kube-api-access-cb44l\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.856385 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.856385 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52264f9c-4bb1-48ee-86e5-13c5533cf69e-cert\") pod \"ingress-canary-jwv4g\" (UID: \"52264f9c-4bb1-48ee-86e5-13c5533cf69e\") " pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:15.856385 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-trusted-ca\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-bound-sa-token\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptlz\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-kube-api-access-tptlz\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgn2\" (UniqueName: \"kubernetes.io/projected/52264f9c-4bb1-48ee-86e5-13c5533cf69e-kube-api-access-5pgn2\") pod \"ingress-canary-jwv4g\" (UID: \"52264f9c-4bb1-48ee-86e5-13c5533cf69e\") " pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:15.856633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856521    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-tmp-dir\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.856633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7169e464-346a-4e1a-91c8-2e4dfa70209a-ca-trust-extracted\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856633 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:15.856625    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:15.856958 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:15.856680    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls podName:d4a8f589-6dd7-40eb-92dd-d6b3759304bb nodeName:}" failed. No retries permitted until 2026-07-06 12:23:16.35666402 +0000 UTC m=+43.096855331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls") pod "dns-default-4scf5" (UID: "d4a8f589-6dd7-40eb-92dd-d6b3759304bb") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:15.856958 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856801    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-certificates\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.856958 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.856842    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-config-volume\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.856958 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:15.856882    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:23:15.856958 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:15.856895    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d7c5b6b5-j7cvz: secret "image-registry-tls" not found
Jul 06 12:23:15.856958 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:15.856949    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls podName:7169e464-346a-4e1a-91c8-2e4dfa70209a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:16.356931637 +0000 UTC m=+43.097122962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls") pod "image-registry-77d7c5b6b5-j7cvz" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a") : secret "image-registry-tls" not found
Jul 06 12:23:15.857355 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.857336    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-trusted-ca\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.860486 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.860455    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-image-registry-private-configuration\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.860604 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.860550    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-installation-pull-secrets\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.860604 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.860569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52264f9c-4bb1-48ee-86e5-13c5533cf69e-cert\") pod \"ingress-canary-jwv4g\" (UID: \"52264f9c-4bb1-48ee-86e5-13c5533cf69e\") " pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:15.866956 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.866909    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgn2\" (UniqueName: \"kubernetes.io/projected/52264f9c-4bb1-48ee-86e5-13c5533cf69e-kube-api-access-5pgn2\") pod \"ingress-canary-jwv4g\" (UID: \"52264f9c-4bb1-48ee-86e5-13c5533cf69e\") " pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:15.867090 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.867046    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptlz\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-kube-api-access-tptlz\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.867705 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.867681    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-bound-sa-token\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:15.867842 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.867826    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb44l\" (UniqueName: \"kubernetes.io/projected/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-kube-api-access-cb44l\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:15.878775 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.878757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:15.878858 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.878760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:15.881622 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.881594    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:23:15.881622 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.881607    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l5tqd\""
Jul 06 12:23:15.881816 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.881647    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:23:15.918878 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:15.918857    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:16.360170 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:16.360141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:16.360337 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:16.360183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:16.360337 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:16.360294    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:16.360419 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:16.360344    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls podName:d4a8f589-6dd7-40eb-92dd-d6b3759304bb nodeName:}" failed. No retries permitted until 2026-07-06 12:23:17.360331002 +0000 UTC m=+44.100522319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls") pod "dns-default-4scf5" (UID: "d4a8f589-6dd7-40eb-92dd-d6b3759304bb") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:16.360419 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:16.360297    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:23:16.360419 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:16.360384    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d7c5b6b5-j7cvz: secret "image-registry-tls" not found
Jul 06 12:23:16.360545 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:16.360424    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls podName:7169e464-346a-4e1a-91c8-2e4dfa70209a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:17.360413723 +0000 UTC m=+44.100605051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls") pod "image-registry-77d7c5b6b5-j7cvz" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a") : secret "image-registry-tls" not found
Jul 06 12:23:16.878660 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:16.878634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:16.882097 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:16.882079    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:23:16.882298 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:16.882285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljjwj\""
Jul 06 12:23:16.882933 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:16.882918    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:23:17.366499 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:17.366471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:17.366666 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:17.366515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:17.366666 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:17.366656    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:17.366738 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:17.366714    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls podName:d4a8f589-6dd7-40eb-92dd-d6b3759304bb nodeName:}" failed. No retries permitted until 2026-07-06 12:23:19.366699912 +0000 UTC m=+46.106891226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls") pod "dns-default-4scf5" (UID: "d4a8f589-6dd7-40eb-92dd-d6b3759304bb") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:17.366779 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:17.366659    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:23:17.366779 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:17.366762    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d7c5b6b5-j7cvz: secret "image-registry-tls" not found
Jul 06 12:23:17.366842 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:17.366818    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls podName:7169e464-346a-4e1a-91c8-2e4dfa70209a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:19.366806092 +0000 UTC m=+46.106997425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls") pod "image-registry-77d7c5b6b5-j7cvz" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a") : secret "image-registry-tls" not found
Jul 06 12:23:17.544302 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:17.544269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:17.852079 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:17.852051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:18.527189    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962" Netns:"/var/run/netns/e3f1fd57-0534-4ae3-86e5-797ecfa5c45c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:18.527265    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962" Netns:"/var/run/netns/e3f1fd57-0534-4ae3-86e5-797ecfa5c45c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:18.527282 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:18.527863 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:18.527292    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:18.527863 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962" Netns:"/var/run/netns/e3f1fd57-0534-4ae3-86e5-797ecfa5c45c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:18.527863 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:18.527863 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:18.527863 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:18.527376    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"ingress-canary-jwv4g_openshift-ingress-canary(52264f9c-4bb1-48ee-86e5-13c5533cf69e)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"ingress-canary-jwv4g_openshift-ingress-canary(52264f9c-4bb1-48ee-86e5-13c5533cf69e)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962\\\" Netns:\\\"/var/run/netns/e3f1fd57-0534-4ae3-86e5-797ecfa5c45c\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=6fa9d533aad8453c5f678fb76996c5bd1e980ef030a6b440d43c0090d70fd962;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-ingress-canary/ingress-canary-jwv4g" podUID="52264f9c-4bb1-48ee-86e5-13c5533cf69e"
Jul 06 12:23:19.382972 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:19.382938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:19.383137 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:19.382980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:19.383137 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:19.383076    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:19.383137 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:19.383129    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls podName:d4a8f589-6dd7-40eb-92dd-d6b3759304bb nodeName:}" failed. No retries permitted until 2026-07-06 12:23:23.383112751 +0000 UTC m=+50.123304061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls") pod "dns-default-4scf5" (UID: "d4a8f589-6dd7-40eb-92dd-d6b3759304bb") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:19.383247 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:19.383079    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:23:19.383247 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:19.383166    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d7c5b6b5-j7cvz: secret "image-registry-tls" not found
Jul 06 12:23:19.383247 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:19.383205    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls podName:7169e464-346a-4e1a-91c8-2e4dfa70209a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:23.383193336 +0000 UTC m=+50.123384647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls") pod "image-registry-77d7c5b6b5-j7cvz" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a") : secret "image-registry-tls" not found
Jul 06 12:23:23.409676 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:23.409639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:23.410032 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:23.409684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:23.410032 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:23.409779    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:23:23.410032 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:23.409780    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:23.410032 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:23.409790    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d7c5b6b5-j7cvz: secret "image-registry-tls" not found
Jul 06 12:23:23.410032 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:23.409876    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls podName:d4a8f589-6dd7-40eb-92dd-d6b3759304bb nodeName:}" failed. No retries permitted until 2026-07-06 12:23:31.409860042 +0000 UTC m=+58.150051354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls") pod "dns-default-4scf5" (UID: "d4a8f589-6dd7-40eb-92dd-d6b3759304bb") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:23.410032 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:23.409913    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls podName:7169e464-346a-4e1a-91c8-2e4dfa70209a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:31.409901355 +0000 UTC m=+58.150092666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls") pod "image-registry-77d7c5b6b5-j7cvz" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a") : secret "image-registry-tls" not found
Jul 06 12:23:24.640643 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:24.640611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:24.709314 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:24.709282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:27.296634 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:27.296597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:27.400888 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:27.400855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:27.962364 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:27.962334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:28.031162 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:28.031112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log" limit=1024
Jul 06 12:23:31.459484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:31.459455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:31.459907 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:31.459525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:31.459907 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:31.459621    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:23:31.459907 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:31.459644    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d7c5b6b5-j7cvz: secret "image-registry-tls" not found
Jul 06 12:23:31.459907 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:31.459624    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:31.459907 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:31.459702    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls podName:d4a8f589-6dd7-40eb-92dd-d6b3759304bb nodeName:}" failed. No retries permitted until 2026-07-06 12:23:47.459689743 +0000 UTC m=+74.199881065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls") pod "dns-default-4scf5" (UID: "d4a8f589-6dd7-40eb-92dd-d6b3759304bb") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:31.459907 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:31.459716    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls podName:7169e464-346a-4e1a-91c8-2e4dfa70209a nodeName:}" failed. No retries permitted until 2026-07-06 12:23:47.45971101 +0000 UTC m=+74.199902334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls") pod "image-registry-77d7c5b6b5-j7cvz" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a") : secret "image-registry-tls" not found
Jul 06 12:23:31.878865 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:31.878832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:31.879104 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:31.879088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:34.501964    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47" Netns:"/var/run/netns/9b41ab0d-db78-4570-82bb-fff92f01dd59" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:34.502011    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47" Netns:"/var/run/netns/9b41ab0d-db78-4570-82bb-fff92f01dd59" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:34.502027    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:34.502296 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47" Netns:"/var/run/netns/9b41ab0d-db78-4570-82bb-fff92f01dd59" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:34.503338 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:34.503338 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:34.503338 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:34.502100    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"ingress-canary-jwv4g_openshift-ingress-canary(52264f9c-4bb1-48ee-86e5-13c5533cf69e)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"ingress-canary-jwv4g_openshift-ingress-canary(52264f9c-4bb1-48ee-86e5-13c5533cf69e)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47\\\" Netns:\\\"/var/run/netns/9b41ab0d-db78-4570-82bb-fff92f01dd59\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=271a8f503c1e5d6e99bc7a18785707173a9c6d78c4724462951a90cda0f8bf47;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-ingress-canary/ingress-canary-jwv4g" podUID="52264f9c-4bb1-48ee-86e5-13c5533cf69e"
Jul 06 12:23:37.312703 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:37.312678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn52s"
Jul 06 12:23:38.409735 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.409700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:23:38.412221 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.412202    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:23:38.420317 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:38.420302    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 12:23:38.420378 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:38.420369    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs podName:a2fcc5ce-786d-4f27-822c-f3c694ecae34 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:42.420352809 +0000 UTC m=+129.160544120 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs") pod "network-metrics-daemon-5mkvm" (UID: "a2fcc5ce-786d-4f27-822c-f3c694ecae34") : secret "metrics-daemon-secret" not found
Jul 06 12:23:38.509930 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.509908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:38.512607 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.512591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:23:38.522950 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.522919    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7d9d83-783d-437f-af6b-b106c737db98-original-pull-secret\") pod \"global-pull-secret-syncer-7tw8w\" (UID: \"8a7d9d83-783d-437f-af6b-b106c737db98\") " pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:38.611063 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.611035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:38.617854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.617838    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:23:38.623872 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.623856    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:23:38.634879 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.634858    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgp75\" (UniqueName: \"kubernetes.io/projected/41bef114-d4a7-4bf7-89c4-e5ae630ef08a-kube-api-access-tgp75\") pod \"network-check-target-vvst9\" (UID: \"41bef114-d4a7-4bf7-89c4-e5ae630ef08a\") " pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:38.693751 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.693698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tw8w"
Jul 06 12:23:38.789934 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.789911    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljjwj\""
Jul 06 12:23:38.798002 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:38.797983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:23:46.878867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:46.878830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:46.879292 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:46.879041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:47.470055 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:47.470017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:23:47.470226 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:47.470068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:23:47.470226 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:47.470157    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:23:47.470226 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:47.470159    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:23:47.470226 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:47.470217    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls podName:d4a8f589-6dd7-40eb-92dd-d6b3759304bb nodeName:}" failed. No retries permitted until 2026-07-06 12:24:19.470202577 +0000 UTC m=+106.210393917 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls") pod "dns-default-4scf5" (UID: "d4a8f589-6dd7-40eb-92dd-d6b3759304bb") : secret "dns-default-metrics-tls" not found
Jul 06 12:23:47.470363 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:47.470168    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77d7c5b6b5-j7cvz: secret "image-registry-tls" not found
Jul 06 12:23:47.470363 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:47.470289    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls podName:7169e464-346a-4e1a-91c8-2e4dfa70209a nodeName:}" failed. No retries permitted until 2026-07-06 12:24:19.470276582 +0000 UTC m=+106.210467892 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls") pod "image-registry-77d7c5b6b5-j7cvz" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a") : secret "image-registry-tls" not found
Jul 06 12:23:48.170445 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.170413    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-p8p64"]
Jul 06 12:23:48.172393 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.172376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.177660 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.177627    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-klnqv\""
Jul 06 12:23:48.177660 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.177640    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:23:48.177660 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.177635    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 12:23:48.177862 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.177693    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 12:23:48.178882 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.178854    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 12:23:48.183043 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.183025    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 12:23:48.187676 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.187653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-p8p64"]
Jul 06 12:23:48.275933 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.275907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92582abc-17fa-4f2e-aa1a-e92959fa532f-serving-cert\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.276047 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.275953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lqpm\" (UniqueName: \"kubernetes.io/projected/92582abc-17fa-4f2e-aa1a-e92959fa532f-kube-api-access-4lqpm\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.276047 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.275996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92582abc-17fa-4f2e-aa1a-e92959fa532f-config\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.276140 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.276078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92582abc-17fa-4f2e-aa1a-e92959fa532f-trusted-ca\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.376673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.376639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92582abc-17fa-4f2e-aa1a-e92959fa532f-trusted-ca\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.376787 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.376697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92582abc-17fa-4f2e-aa1a-e92959fa532f-serving-cert\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.376787 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.376728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lqpm\" (UniqueName: \"kubernetes.io/projected/92582abc-17fa-4f2e-aa1a-e92959fa532f-kube-api-access-4lqpm\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.376787 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.376773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92582abc-17fa-4f2e-aa1a-e92959fa532f-config\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.377480 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.377457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92582abc-17fa-4f2e-aa1a-e92959fa532f-config\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.377739 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.377721    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92582abc-17fa-4f2e-aa1a-e92959fa532f-trusted-ca\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.378962 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.378945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92582abc-17fa-4f2e-aa1a-e92959fa532f-serving-cert\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.382718 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.382697    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"]
Jul 06 12:23:48.384711 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.384696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:48.387318 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.387300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-glwh9\""
Jul 06 12:23:48.391479 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.391460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lqpm\" (UniqueName: \"kubernetes.io/projected/92582abc-17fa-4f2e-aa1a-e92959fa532f-kube-api-access-4lqpm\") pod \"console-operator-68b757fb67-p8p64\" (UID: \"92582abc-17fa-4f2e-aa1a-e92959fa532f\") " pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.393799 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.393781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"]
Jul 06 12:23:48.476629 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.476569    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"]
Jul 06 12:23:48.477098 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.477078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7rlm\" (UniqueName: \"kubernetes.io/projected/e1cfc79e-deb0-46db-9997-6fc56f125cb5-kube-api-access-v7rlm\") pod \"network-check-source-989f8b8dc-mqkx8\" (UID: \"e1cfc79e-deb0-46db-9997-6fc56f125cb5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:48.478328 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.478314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:48.481319 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.481304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:48.482544 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.482508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 12:23:48.482693 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.482661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2wf46\""
Jul 06 12:23:48.483296 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.483010    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 12:23:48.500430 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.500410    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"]
Jul 06 12:23:48.577962 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.577936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7rlm\" (UniqueName: \"kubernetes.io/projected/e1cfc79e-deb0-46db-9997-6fc56f125cb5-kube-api-access-v7rlm\") pod \"network-check-source-989f8b8dc-mqkx8\" (UID: \"e1cfc79e-deb0-46db-9997-6fc56f125cb5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:48.578081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.577978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/015b4ac3-23e7-48af-9f33-223162c4ad59-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:48.578081 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.578000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:48.589190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.589165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7rlm\" (UniqueName: \"kubernetes.io/projected/e1cfc79e-deb0-46db-9997-6fc56f125cb5-kube-api-access-v7rlm\") pod \"network-check-source-989f8b8dc-mqkx8\" (UID: \"e1cfc79e-deb0-46db-9997-6fc56f125cb5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:48.678542 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.678508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/015b4ac3-23e7-48af-9f33-223162c4ad59-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:48.678648 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.678554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:48.678648 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:48.678644    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 12:23:48.678721 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:48.678691    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert podName:015b4ac3-23e7-48af-9f33-223162c4ad59 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:49.178678443 +0000 UTC m=+75.918869754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-xnfpf" (UID: "015b4ac3-23e7-48af-9f33-223162c4ad59") : secret "networking-console-plugin-cert" not found
Jul 06 12:23:48.679066 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.679048    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/015b4ac3-23e7-48af-9f33-223162c4ad59-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:48.697859 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:48.697844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:49.182458 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:49.182425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:49.182836 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:49.182589    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 12:23:49.182836 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:49.182661    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert podName:015b4ac3-23e7-48af-9f33-223162c4ad59 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:50.182644067 +0000 UTC m=+76.922835387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-xnfpf" (UID: "015b4ac3-23e7-48af-9f33-223162c4ad59") : secret "networking-console-plugin-cert" not found
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:49.462330    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c" Netns:"/var/run/netns/6a4f4dcb-5bc6-4e79-b4ee-a366b6820b00" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:49.462374    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c" Netns:"/var/run/netns/6a4f4dcb-5bc6-4e79-b4ee-a366b6820b00" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:49.462389    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:49.462686 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c" Netns:"/var/run/netns/6a4f4dcb-5bc6-4e79-b4ee-a366b6820b00" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e" Path:"" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s": context deadline exceeded
Jul 06 12:23:49.463178 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:49.463178 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:23:49.463178 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:49.462452    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"ingress-canary-jwv4g_openshift-ingress-canary(52264f9c-4bb1-48ee-86e5-13c5533cf69e)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"ingress-canary-jwv4g_openshift-ingress-canary(52264f9c-4bb1-48ee-86e5-13c5533cf69e)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ingress-canary-jwv4g_openshift-ingress-canary_52264f9c-4bb1-48ee-86e5-13c5533cf69e_0(3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c): error adding pod openshift-ingress-canary_ingress-canary-jwv4g to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c\\\" Netns:\\\"/var/run/netns/6a4f4dcb-5bc6-4e79-b4ee-a366b6820b00\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress-canary;K8S_POD_NAME=ingress-canary-jwv4g;K8S_POD_INFRA_CONTAINER_ID=3d2cbdaa48eae52ebc94dcd772f053b5e9a7d4e58ed9666b24dd3cf05dd7043c;K8S_POD_UID=52264f9c-4bb1-48ee-86e5-13c5533cf69e\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-ingress-canary/ingress-canary-jwv4g] networking: Multus: [openshift-ingress-canary/ingress-canary-jwv4g/52264f9c-4bb1-48ee-86e5-13c5533cf69e]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress-canary/pods/ingress-canary-jwv4g?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-ingress-canary/ingress-canary-jwv4g" podUID="52264f9c-4bb1-48ee-86e5-13c5533cf69e"
Jul 06 12:23:50.189762 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:50.189730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:50.190105 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:50.189846    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 12:23:50.190105 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:50.189899    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert podName:015b4ac3-23e7-48af-9f33-223162c4ad59 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:52.189885634 +0000 UTC m=+78.930076945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-xnfpf" (UID: "015b4ac3-23e7-48af-9f33-223162c4ad59") : secret "networking-console-plugin-cert" not found
Jul 06 12:23:51.065496 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.065468    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:51.065496 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d" Netns:"/var/run/netns/79738ca9-fbb2-4f7a-be86-4baf94f671c4" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f" Path:"" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s": context deadline exceeded
Jul 06 12:23:51.065496 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:51.065496 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.065518    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d" Netns:"/var/run/netns/79738ca9-fbb2-4f7a-be86-4baf94f671c4" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f" Path:"" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s": context deadline exceeded
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.065590    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d" Netns:"/var/run/netns/79738ca9-fbb2-4f7a-be86-4baf94f671c4" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f" Path:"" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s": context deadline exceeded
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:51.065665 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:51.066080 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.065672    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"console-operator-68b757fb67-p8p64_openshift-console-operator(92582abc-17fa-4f2e-aa1a-e92959fa532f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"console-operator-68b757fb67-p8p64_openshift-console-operator(92582abc-17fa-4f2e-aa1a-e92959fa532f)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d\\\" Netns:\\\"/var/run/netns/79738ca9-fbb2-4f7a-be86-4baf94f671c4\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=b9d9d0ce0e2170ec4ae906068f39c5a845a5ab2a0417cfe1bea58d4e668f394d;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" podUID="92582abc-17fa-4f2e-aa1a-e92959fa532f"
Jul 06 12:23:51.280406 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.280372    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:51.280406 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc" Netns:"/var/run/netns/5a7311f1-9183-4015-a57a-30b16135f61e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s": context deadline exceeded
Jul 06 12:23:51.280406 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:51.280406 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.280430    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc" Netns:"/var/run/netns/5a7311f1-9183-4015-a57a-30b16135f61e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s": context deadline exceeded
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.280457    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc" Netns:"/var/run/netns/5a7311f1-9183-4015-a57a-30b16135f61e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s": context deadline exceeded
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:51.280931 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:51.281306 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:51.280583    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics(e1cfc79e-deb0-46db-9997-6fc56f125cb5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics(e1cfc79e-deb0-46db-9997-6fc56f125cb5)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc\\\" Netns:\\\"/var/run/netns/5a7311f1-9183-4015-a57a-30b16135f61e\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=3073b37b4e9ea5c147b3088af499938887622b47ec5798d324603faf20c413cc;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8" podUID="e1cfc79e-deb0-46db-9997-6fc56f125cb5"
Jul 06 12:23:51.404936 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:51.404912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:51.405048 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:51.404914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:51.405131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:51.405120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:51.405236 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:51.405225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:52.203174 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.203148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:52.203333 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:52.203276    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 12:23:52.203374 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:52.203334    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert podName:015b4ac3-23e7-48af-9f33-223162c4ad59 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.203321454 +0000 UTC m=+82.943512764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-xnfpf" (UID: "015b4ac3-23e7-48af-9f33-223162c4ad59") : secret "networking-console-plugin-cert" not found
Jul 06 12:23:52.445017 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.444988    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pj9dl"]
Jul 06 12:23:52.447491 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.447476    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.452775 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.452697    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 12:23:52.457739 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.457718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 12:23:52.458358 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.458335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zwn2\""
Jul 06 12:23:52.459575 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.459562    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 12:23:52.461948 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.461930    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 12:23:52.469949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.469929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pj9dl"]
Jul 06 12:23:52.504988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.504968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnv5f\" (UniqueName: \"kubernetes.io/projected/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-api-access-xnv5f\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.505097 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.505019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-crio-socket\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.505097 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.505060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.505097 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.505090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.505256 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.505175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-data-volume\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606204 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.606178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-data-volume\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606307 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.606238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnv5f\" (UniqueName: \"kubernetes.io/projected/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-api-access-xnv5f\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606406 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.606385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-crio-socket\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606470 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.606415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606470 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.606444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606605 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:52.606488    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:52.606605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.606508    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-crio-socket\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606605 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:52.606559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:53.106521897 +0000 UTC m=+79.846713209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:52.606605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.606580    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-data-volume\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:52.606605 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:52.606604    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:52.606769 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:52.606652    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:53.106638013 +0000 UTC m=+79.846829324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:52.615433 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:52.615410    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnv5f\" (UniqueName: \"kubernetes.io/projected/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-api-access-xnv5f\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:53.109969 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:53.109935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:53.109969 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:53.109968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:53.110154 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.110058    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:53.110154 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.110117    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:54.11010438 +0000 UTC m=+80.850295693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:53.110226 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.110161    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:53.110226 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.110215    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:54.110202532 +0000 UTC m=+80.850393843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:53.991838 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.991803    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:53.991838 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1" Netns:"/var/run/netns/a11d0616-0680-4834-8a8d-fd9eea9b3d35" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s": context deadline exceeded
Jul 06 12:23:53.991838 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:53.991838 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.991864    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1" Netns:"/var/run/netns/a11d0616-0680-4834-8a8d-fd9eea9b3d35" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s": context deadline exceeded
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.991872    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef" Netns:"/var/run/netns/24db4ba5-3054-4c50-9d06-4414b50e60a0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f" Path:"" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s": context deadline exceeded
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:53.992216 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.991888    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1" Netns:"/var/run/netns/a11d0616-0680-4834-8a8d-fd9eea9b3d35" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s": context deadline exceeded
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.991899    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef" Netns:"/var/run/netns/24db4ba5-3054-4c50-9d06-4414b50e60a0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f" Path:"" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s": context deadline exceeded
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:53.992486 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.991913    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:53.992726 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef" Netns:"/var/run/netns/24db4ba5-3054-4c50-9d06-4414b50e60a0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f" Path:"" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s": context deadline exceeded
Jul 06 12:23:53.992726 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:53.992726 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:23:53.992726 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.991990    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"console-operator-68b757fb67-p8p64_openshift-console-operator(92582abc-17fa-4f2e-aa1a-e92959fa532f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"console-operator-68b757fb67-p8p64_openshift-console-operator(92582abc-17fa-4f2e-aa1a-e92959fa532f)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_console-operator-68b757fb67-p8p64_openshift-console-operator_92582abc-17fa-4f2e-aa1a-e92959fa532f_0(3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef): error adding pod openshift-console-operator_console-operator-68b757fb67-p8p64 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef\\\" Netns:\\\"/var/run/netns/24db4ba5-3054-4c50-9d06-4414b50e60a0\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-console-operator;K8S_POD_NAME=console-operator-68b757fb67-p8p64;K8S_POD_INFRA_CONTAINER_ID=3f7f03e4d46f5bb6b133758f9ecebd99dc912d9796feecb99383e568ec21cbef;K8S_POD_UID=92582abc-17fa-4f2e-aa1a-e92959fa532f\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-console-operator/console-operator-68b757fb67-p8p64] networking: Multus: [openshift-console-operator/console-operator-68b757fb67-p8p64/92582abc-17fa-4f2e-aa1a-e92959fa532f]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-console-operator/pods/console-operator-68b757fb67-p8p64?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" podUID="92582abc-17fa-4f2e-aa1a-e92959fa532f"
Jul 06 12:23:53.992851 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:53.992061    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics(e1cfc79e-deb0-46db-9997-6fc56f125cb5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics(e1cfc79e-deb0-46db-9997-6fc56f125cb5)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-source-989f8b8dc-mqkx8_openshift-network-diagnostics_e1cfc79e-deb0-46db-9997-6fc56f125cb5_0(583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1): error adding pod openshift-network-diagnostics_network-check-source-989f8b8dc-mqkx8 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1\\\" Netns:\\\"/var/run/netns/a11d0616-0680-4834-8a8d-fd9eea9b3d35\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-source-989f8b8dc-mqkx8;K8S_POD_INFRA_CONTAINER_ID=583d977e21015122652d44647bf991b828dbdb3d05dcc0a6d4d7865642cb05c1;K8S_POD_UID=e1cfc79e-deb0-46db-9997-6fc56f125cb5\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8] networking: Multus: [openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8/e1cfc79e-deb0-46db-9997-6fc56f125cb5]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-network-diagnostics/pods/network-check-source-989f8b8dc-mqkx8?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8" podUID="e1cfc79e-deb0-46db-9997-6fc56f125cb5"
Jul 06 12:23:54.118734 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.118705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:54.118734 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.118736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:54.118876 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:54.118818    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:54.118913 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:54.118877    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.118861981 +0000 UTC m=+82.859053292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:54.118952 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:54.118911    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:54.118981 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:54.118971    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:23:56.118954369 +0000 UTC m=+82.859145682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:54.634917 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.634886    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vf7t7_d2f4be8f-111b-4ed0-84f0-cab27cc699dc/dns-node-resolver/0.log"
Jul 06 12:23:54.825501 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.825473    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-v8tx5"]
Jul 06 12:23:54.828304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.828289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:54.830449 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.830427    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 12:23:54.830639 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.830623    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 12:23:54.831344 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.831325    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 12:23:54.831424 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.831325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-spmbb\""
Jul 06 12:23:54.831424 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.831357    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 12:23:54.837955 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.837936    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-v8tx5"]
Jul 06 12:23:54.925047 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.924986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35a0482d-7e31-4b94-a1d7-6827089267b6-signing-cabundle\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:54.925047 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.925041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35a0482d-7e31-4b94-a1d7-6827089267b6-signing-key\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:54.925184 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:54.925141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpv2h\" (UniqueName: \"kubernetes.io/projected/35a0482d-7e31-4b94-a1d7-6827089267b6-kube-api-access-wpv2h\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.025700 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.025669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpv2h\" (UniqueName: \"kubernetes.io/projected/35a0482d-7e31-4b94-a1d7-6827089267b6-kube-api-access-wpv2h\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.025986 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.025722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35a0482d-7e31-4b94-a1d7-6827089267b6-signing-cabundle\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.025986 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.025807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35a0482d-7e31-4b94-a1d7-6827089267b6-signing-key\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.026355 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.026331    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35a0482d-7e31-4b94-a1d7-6827089267b6-signing-cabundle\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.028159 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.028141    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35a0482d-7e31-4b94-a1d7-6827089267b6-signing-key\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.035267 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.035246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpv2h\" (UniqueName: \"kubernetes.io/projected/35a0482d-7e31-4b94-a1d7-6827089267b6-kube-api-access-wpv2h\") pod \"service-ca-758f599c5-v8tx5\" (UID: \"35a0482d-7e31-4b94-a1d7-6827089267b6\") " pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.137254 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.137222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:55.633654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:55.633631    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smk6w_784247d6-8be2-490b-9c8b-8e14663c342a/node-ca/0.log"
Jul 06 12:23:56.134334 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:56.134230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:56.134334 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:56.134287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:23:56.134761 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:56.134349    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:23:56.134761 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:56.134369    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:56.134761 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:56.134399    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:00.134386038 +0000 UTC m=+86.874577349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : configmap "kube-rbac-proxy" not found
Jul 06 12:23:56.134761 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:56.134416    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:00.134404621 +0000 UTC m=+86.874595932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:23:56.234627 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:56.234600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:23:56.234771 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:56.234722    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 12:23:56.234771 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:56.234771    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert podName:015b4ac3-23e7-48af-9f33-223162c4ad59 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:04.234758562 +0000 UTC m=+90.974949872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-xnfpf" (UID: "015b4ac3-23e7-48af-9f33-223162c4ad59") : secret "networking-console-plugin-cert" not found
Jul 06 12:23:57.722630 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:57.722590    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 06 12:23:57.722630 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_service-ca-758f599c5-v8tx5_openshift-service-ca_35a0482d-7e31-4b94-a1d7-6827089267b6_0(0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44): error adding pod openshift-service-ca_service-ca-758f599c5-v8tx5 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44" Netns:"/var/run/netns/72b545ca-9359-41da-8d8e-704a772ada3f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-service-ca;K8S_POD_NAME=service-ca-758f599c5-v8tx5;K8S_POD_INFRA_CONTAINER_ID=0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44;K8S_POD_UID=35a0482d-7e31-4b94-a1d7-6827089267b6" Path:"" ERRORED: error configuring pod [openshift-service-ca/service-ca-758f599c5-v8tx5] networking: Multus: [openshift-service-ca/service-ca-758f599c5-v8tx5/35a0482d-7e31-4b94-a1d7-6827089267b6]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-service-ca/pods/service-ca-758f599c5-v8tx5?timeout=1m0s": context deadline exceeded
Jul 06 12:23:57.722630 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:57.722630 ip-10-0-138-192 kubenswrapper[2565]:  >
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:57.722655    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_service-ca-758f599c5-v8tx5_openshift-service-ca_35a0482d-7e31-4b94-a1d7-6827089267b6_0(0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44): error adding pod openshift-service-ca_service-ca-758f599c5-v8tx5 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44" Netns:"/var/run/netns/72b545ca-9359-41da-8d8e-704a772ada3f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-service-ca;K8S_POD_NAME=service-ca-758f599c5-v8tx5;K8S_POD_INFRA_CONTAINER_ID=0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44;K8S_POD_UID=35a0482d-7e31-4b94-a1d7-6827089267b6" Path:"" ERRORED: error configuring pod [openshift-service-ca/service-ca-758f599c5-v8tx5] networking: Multus: [openshift-service-ca/service-ca-758f599c5-v8tx5/35a0482d-7e31-4b94-a1d7-6827089267b6]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-service-ca/pods/service-ca-758f599c5-v8tx5?timeout=1m0s": context deadline exceeded
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:57.722680    2565 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_service-ca-758f599c5-v8tx5_openshift-service-ca_35a0482d-7e31-4b94-a1d7-6827089267b6_0(0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44): error adding pod openshift-service-ca_service-ca-758f599c5-v8tx5 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44" Netns:"/var/run/netns/72b545ca-9359-41da-8d8e-704a772ada3f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-service-ca;K8S_POD_NAME=service-ca-758f599c5-v8tx5;K8S_POD_INFRA_CONTAINER_ID=0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44;K8S_POD_UID=35a0482d-7e31-4b94-a1d7-6827089267b6" Path:"" ERRORED: error configuring pod [openshift-service-ca/service-ca-758f599c5-v8tx5] networking: Multus: [openshift-service-ca/service-ca-758f599c5-v8tx5/35a0482d-7e31-4b94-a1d7-6827089267b6]: error waiting for pod: Get "https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-service-ca/pods/service-ca-758f599c5-v8tx5?timeout=1m0s": context deadline exceeded
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 06 12:23:57.723044 ip-10-0-138-192 kubenswrapper[2565]:  > pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:57.723451 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:23:57.722766    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"service-ca-758f599c5-v8tx5_openshift-service-ca(35a0482d-7e31-4b94-a1d7-6827089267b6)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"service-ca-758f599c5-v8tx5_openshift-service-ca(35a0482d-7e31-4b94-a1d7-6827089267b6)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_service-ca-758f599c5-v8tx5_openshift-service-ca_35a0482d-7e31-4b94-a1d7-6827089267b6_0(0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44): error adding pod openshift-service-ca_service-ca-758f599c5-v8tx5 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44\\\" Netns:\\\"/var/run/netns/72b545ca-9359-41da-8d8e-704a772ada3f\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-service-ca;K8S_POD_NAME=service-ca-758f599c5-v8tx5;K8S_POD_INFRA_CONTAINER_ID=0843606672d80258e6268c6d03d3559cb7949648a93ddc9dcf5b7f0e54449d44;K8S_POD_UID=35a0482d-7e31-4b94-a1d7-6827089267b6\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-service-ca/service-ca-758f599c5-v8tx5] networking: Multus: [openshift-service-ca/service-ca-758f599c5-v8tx5/35a0482d-7e31-4b94-a1d7-6827089267b6]: error waiting for pod: Get \\\"https://a4d35e74d798c48d19e963c8896e1b14-4cafef94302539ab.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-service-ca/pods/service-ca-758f599c5-v8tx5?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-service-ca/service-ca-758f599c5-v8tx5" podUID="35a0482d-7e31-4b94-a1d7-6827089267b6"
Jul 06 12:23:58.421370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:58.421341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:23:58.421630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:23:58.421618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-v8tx5"
Jul 06 12:24:00.164202 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:00.164167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:00.164641 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:00.164224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:00.164641 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:00.164290    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:24:00.164641 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:00.164331    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:00.164641 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:00.164341    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:08.164329415 +0000 UTC m=+94.904520725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : configmap "kube-rbac-proxy" not found
Jul 06 12:24:00.164641 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:00.164405    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:08.164386895 +0000 UTC m=+94.904578208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:01.044927 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:01.044895    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a0482d_7e31_4b94_a1d7_6827089267b6.slice/crio-9f70b9a1cdbaf0ee1259b50660c52b399695d6a64bbec1934e41bbc27708bb43 WatchSource:0}: Error finding container 9f70b9a1cdbaf0ee1259b50660c52b399695d6a64bbec1934e41bbc27708bb43: Status 404 returned error can't find the container with id 9f70b9a1cdbaf0ee1259b50660c52b399695d6a64bbec1934e41bbc27708bb43
Jul 06 12:24:01.152387 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:01.152354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvst9"]
Jul 06 12:24:01.153744 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:01.153723    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7tw8w"]
Jul 06 12:24:01.155690 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:01.155666    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41bef114_d4a7_4bf7_89c4_e5ae630ef08a.slice/crio-a07c9fd5ce74d18beeb766d1403e162a6312353f9e57d9e967870530afec948e WatchSource:0}: Error finding container a07c9fd5ce74d18beeb766d1403e162a6312353f9e57d9e967870530afec948e: Status 404 returned error can't find the container with id a07c9fd5ce74d18beeb766d1403e162a6312353f9e57d9e967870530afec948e
Jul 06 12:24:01.156698 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:01.156672    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7d9d83_783d_437f_af6b_b106c737db98.slice/crio-b4ccefef1507b280a346e2483069266132f8de9d8e4d8a322f6a0fe886c00d60 WatchSource:0}: Error finding container b4ccefef1507b280a346e2483069266132f8de9d8e4d8a322f6a0fe886c00d60: Status 404 returned error can't find the container with id b4ccefef1507b280a346e2483069266132f8de9d8e4d8a322f6a0fe886c00d60
Jul 06 12:24:01.428422 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:01.428387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvst9" event={"ID":"41bef114-d4a7-4bf7-89c4-e5ae630ef08a","Type":"ContainerStarted","Data":"a07c9fd5ce74d18beeb766d1403e162a6312353f9e57d9e967870530afec948e"}
Jul 06 12:24:01.429389 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:01.429363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7tw8w" event={"ID":"8a7d9d83-783d-437f-af6b-b106c737db98","Type":"ContainerStarted","Data":"b4ccefef1507b280a346e2483069266132f8de9d8e4d8a322f6a0fe886c00d60"}
Jul 06 12:24:01.430313 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:01.430295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-v8tx5" event={"ID":"35a0482d-7e31-4b94-a1d7-6827089267b6","Type":"ContainerStarted","Data":"9f70b9a1cdbaf0ee1259b50660c52b399695d6a64bbec1934e41bbc27708bb43"}
Jul 06 12:24:02.879240 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:02.879206    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:24:02.879646 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:02.879501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwv4g"
Jul 06 12:24:03.042117 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:03.042087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwv4g"]
Jul 06 12:24:03.045292 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:03.045263    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52264f9c_4bb1_48ee_86e5_13c5533cf69e.slice/crio-f19b5a20c7bd6649771bb69330f8b324ce625c4cef40dd95d854403d78cd41ce WatchSource:0}: Error finding container f19b5a20c7bd6649771bb69330f8b324ce625c4cef40dd95d854403d78cd41ce: Status 404 returned error can't find the container with id f19b5a20c7bd6649771bb69330f8b324ce625c4cef40dd95d854403d78cd41ce
Jul 06 12:24:03.439435 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:03.439354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwv4g" event={"ID":"52264f9c-4bb1-48ee-86e5-13c5533cf69e","Type":"ContainerStarted","Data":"f19b5a20c7bd6649771bb69330f8b324ce625c4cef40dd95d854403d78cd41ce"}
Jul 06 12:24:04.299828 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:04.299796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:24:04.300187 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:04.299957    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 12:24:04.300187 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:04.300036    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert podName:015b4ac3-23e7-48af-9f33-223162c4ad59 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:20.300016998 +0000 UTC m=+107.040208310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-xnfpf" (UID: "015b4ac3-23e7-48af-9f33-223162c4ad59") : secret "networking-console-plugin-cert" not found
Jul 06 12:24:06.879300 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:06.879264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:24:06.879787 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:06.879570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:24:07.196050 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.195982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-p8p64"]
Jul 06 12:24:07.201269 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:07.201233    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92582abc_17fa_4f2e_aa1a_e92959fa532f.slice/crio-618db008d45c9bf2651126967507cd8ffb75b093268f675f7b2e88ff652e9a4d WatchSource:0}: Error finding container 618db008d45c9bf2651126967507cd8ffb75b093268f675f7b2e88ff652e9a4d: Status 404 returned error can't find the container with id 618db008d45c9bf2651126967507cd8ffb75b093268f675f7b2e88ff652e9a4d
Jul 06 12:24:07.451993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.451903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-v8tx5" event={"ID":"35a0482d-7e31-4b94-a1d7-6827089267b6","Type":"ContainerStarted","Data":"c8da3f7ababf615a5626ae869d7050f59bc99275e2ca094b97be98884856cef0"}
Jul 06 12:24:07.453344 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.453322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwv4g" event={"ID":"52264f9c-4bb1-48ee-86e5-13c5533cf69e","Type":"ContainerStarted","Data":"52838fede4d150549913a072d08d6b9cdf5f1d6ea6f04e37b7146a05b212a6ff"}
Jul 06 12:24:07.454768 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.454746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvst9" event={"ID":"41bef114-d4a7-4bf7-89c4-e5ae630ef08a","Type":"ContainerStarted","Data":"a8520b16edd1b544bddcc160319e1f4984d9a820015402417c12a97ec5a90a2f"}
Jul 06 12:24:07.454880 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.454800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:24:07.456173 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.456151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7tw8w" event={"ID":"8a7d9d83-783d-437f-af6b-b106c737db98","Type":"ContainerStarted","Data":"3ab22d8a31e600899917a60491d5b81d7c3cfaca4f5979b3dfde459001c7b0db"}
Jul 06 12:24:07.457252 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.457232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" event={"ID":"92582abc-17fa-4f2e-aa1a-e92959fa532f","Type":"ContainerStarted","Data":"618db008d45c9bf2651126967507cd8ffb75b093268f675f7b2e88ff652e9a4d"}
Jul 06 12:24:07.518855 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.518785    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-v8tx5" podStartSLOduration=7.520364468 podStartE2EDuration="13.518772083s" totalImagesPullingTime="5.998407615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:07.491055394 +0000 UTC m=+94.231246746" watchObservedRunningTime="2026-07-06 12:24:07.518772083 +0000 UTC m=+94.258963415"
Jul 06 12:24:07.544539 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.544487    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vvst9" podStartSLOduration=86.653950057 podStartE2EDuration="1m32.544477303s" totalImagesPullingTime="5.890527246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:07.544358886 +0000 UTC m=+94.284550221" watchObservedRunningTime="2026-07-06 12:24:07.544477303 +0000 UTC m=+94.284668629"
Jul 06 12:24:07.544666 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:07.544640    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7tw8w" podStartSLOduration=86.655224049 podStartE2EDuration="1m32.544631807s" totalImagesPullingTime="5.889407758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:07.519579716 +0000 UTC m=+94.259771051" watchObservedRunningTime="2026-07-06 12:24:07.544631807 +0000 UTC m=+94.284823141"
Jul 06 12:24:08.235788 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:08.235748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:08.236240 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:08.235857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:08.236240 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:08.236037    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:08.236240 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:08.236118    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls podName:9c56a172-8612-4ca8-9f5f-a13e8bfd3941 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:24.236097544 +0000 UTC m=+110.976288858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pj9dl" (UID: "9c56a172-8612-4ca8-9f5f-a13e8bfd3941") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:24:08.236401 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:08.236381    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:08.878950 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:08.878916    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:24:08.879180 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:08.879166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"
Jul 06 12:24:09.226871 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.226797    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jwv4g" podStartSLOduration=50.151594713 podStartE2EDuration="54.226778574s" totalImagesPullingTime="4.075183861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:07.573961427 +0000 UTC m=+94.314152759" watchObservedRunningTime="2026-07-06 12:24:09.226778574 +0000 UTC m=+95.966969911"
Jul 06 12:24:09.227619 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.227598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8"]
Jul 06 12:24:09.230179 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:09.230156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cfc79e_deb0_46db_9997_6fc56f125cb5.slice/crio-5b326d13aa62206915a9a35e294d567120178254476e1b72baa633f1e68ca7a7 WatchSource:0}: Error finding container 5b326d13aa62206915a9a35e294d567120178254476e1b72baa633f1e68ca7a7: Status 404 returned error can't find the container with id 5b326d13aa62206915a9a35e294d567120178254476e1b72baa633f1e68ca7a7
Jul 06 12:24:09.465417 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.465335    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/0.log"
Jul 06 12:24:09.465417 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.465380    2565 generic.go:356] "Generic (PLEG): container finished" podID="92582abc-17fa-4f2e-aa1a-e92959fa532f" containerID="cab7fb60c57a0bc10957d5dc2a08d4d7b95f55884f60184030414da5628de113" exitCode=255
Jul 06 12:24:09.465912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.465575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" event={"ID":"92582abc-17fa-4f2e-aa1a-e92959fa532f","Type":"ContainerDied","Data":"cab7fb60c57a0bc10957d5dc2a08d4d7b95f55884f60184030414da5628de113"}
Jul 06 12:24:09.467463 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.467439    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8" event={"ID":"e1cfc79e-deb0-46db-9997-6fc56f125cb5","Type":"ContainerStarted","Data":"5922325ba1d962415e13a19a1d8093dcb09171173ceef42758575729b4207abb"}
Jul 06 12:24:09.467602 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.467484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8" event={"ID":"e1cfc79e-deb0-46db-9997-6fc56f125cb5","Type":"ContainerStarted","Data":"5b326d13aa62206915a9a35e294d567120178254476e1b72baa633f1e68ca7a7"}
Jul 06 12:24:09.468149 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:09.468134    2565 scope.go:117] "RemoveContainer" containerID="cab7fb60c57a0bc10957d5dc2a08d4d7b95f55884f60184030414da5628de113"
Jul 06 12:24:10.474775 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:10.474703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:24:10.475214 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:10.475104    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/0.log"
Jul 06 12:24:10.475214 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:10.475136    2565 generic.go:356] "Generic (PLEG): container finished" podID="92582abc-17fa-4f2e-aa1a-e92959fa532f" containerID="3fb71d89368f5ebe8961a50cffce5aa8f6fb8c6d44109fc32f3a6b266572ca76" exitCode=255
Jul 06 12:24:10.475214 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:10.475171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" event={"ID":"92582abc-17fa-4f2e-aa1a-e92959fa532f","Type":"ContainerDied","Data":"3fb71d89368f5ebe8961a50cffce5aa8f6fb8c6d44109fc32f3a6b266572ca76"}
Jul 06 12:24:10.475324 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:10.475248    2565 scope.go:117] "RemoveContainer" containerID="cab7fb60c57a0bc10957d5dc2a08d4d7b95f55884f60184030414da5628de113"
Jul 06 12:24:10.475419 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:10.475402    2565 scope.go:117] "RemoveContainer" containerID="3fb71d89368f5ebe8961a50cffce5aa8f6fb8c6d44109fc32f3a6b266572ca76"
Jul 06 12:24:10.475621 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:10.475591    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-p8p64_openshift-console-operator(92582abc-17fa-4f2e-aa1a-e92959fa532f)\"" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" podUID="92582abc-17fa-4f2e-aa1a-e92959fa532f"
Jul 06 12:24:10.505923 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:10.505883    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mqkx8" podStartSLOduration=22.505870105 podStartE2EDuration="22.505870105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:09.543982129 +0000 UTC m=+96.284173463" watchObservedRunningTime="2026-07-06 12:24:10.505870105 +0000 UTC m=+97.246061437"
Jul 06 12:24:11.482370 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:11.482346    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:24:11.482817 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:11.482683    2565 scope.go:117] "RemoveContainer" containerID="3fb71d89368f5ebe8961a50cffce5aa8f6fb8c6d44109fc32f3a6b266572ca76"
Jul 06 12:24:11.482871 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:11.482834    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-p8p64_openshift-console-operator(92582abc-17fa-4f2e-aa1a-e92959fa532f)\"" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" podUID="92582abc-17fa-4f2e-aa1a-e92959fa532f"
Jul 06 12:24:16.780356 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.780321    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"]
Jul 06 12:24:16.784440 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.784423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:16.788685 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.788661    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 12:24:16.788807 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.788662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 12:24:16.788807 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.788732    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 12:24:16.789059 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.789043    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xcn6v\""
Jul 06 12:24:16.789795 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.789776    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 12:24:16.816613 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.816592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"]
Jul 06 12:24:16.900289 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.900263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5cf1326-e305-4428-a8a0-3aa0a73cf434-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68754d4886-rftzd\" (UID: \"b5cf1326-e305-4428-a8a0-3aa0a73cf434\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:16.900413 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:16.900298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtdz\" (UniqueName: \"kubernetes.io/projected/b5cf1326-e305-4428-a8a0-3aa0a73cf434-kube-api-access-kwtdz\") pod \"managed-serviceaccount-addon-agent-68754d4886-rftzd\" (UID: \"b5cf1326-e305-4428-a8a0-3aa0a73cf434\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:17.000803 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:17.000782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5cf1326-e305-4428-a8a0-3aa0a73cf434-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68754d4886-rftzd\" (UID: \"b5cf1326-e305-4428-a8a0-3aa0a73cf434\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:17.000904 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:17.000816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtdz\" (UniqueName: \"kubernetes.io/projected/b5cf1326-e305-4428-a8a0-3aa0a73cf434-kube-api-access-kwtdz\") pod \"managed-serviceaccount-addon-agent-68754d4886-rftzd\" (UID: \"b5cf1326-e305-4428-a8a0-3aa0a73cf434\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:17.003108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:17.003090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5cf1326-e305-4428-a8a0-3aa0a73cf434-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68754d4886-rftzd\" (UID: \"b5cf1326-e305-4428-a8a0-3aa0a73cf434\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:17.019628 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:17.019601    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtdz\" (UniqueName: \"kubernetes.io/projected/b5cf1326-e305-4428-a8a0-3aa0a73cf434-kube-api-access-kwtdz\") pod \"managed-serviceaccount-addon-agent-68754d4886-rftzd\" (UID: \"b5cf1326-e305-4428-a8a0-3aa0a73cf434\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:17.108414 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:17.108396    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"
Jul 06 12:24:17.254867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:17.254844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd"]
Jul 06 12:24:17.257272 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:17.257239    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5cf1326_e305_4428_a8a0_3aa0a73cf434.slice/crio-950a7a3d698d641f705c8d29d9d9f44b83b7e8bb7f3d7688ff437f63240f86b7 WatchSource:0}: Error finding container 950a7a3d698d641f705c8d29d9d9f44b83b7e8bb7f3d7688ff437f63240f86b7: Status 404 returned error can't find the container with id 950a7a3d698d641f705c8d29d9d9f44b83b7e8bb7f3d7688ff437f63240f86b7
Jul 06 12:24:17.501439 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:17.501369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd" event={"ID":"b5cf1326-e305-4428-a8a0-3aa0a73cf434","Type":"ContainerStarted","Data":"950a7a3d698d641f705c8d29d9d9f44b83b7e8bb7f3d7688ff437f63240f86b7"}
Jul 06 12:24:18.482517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:18.482311    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:24:18.482517 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:18.482370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:24:18.483018 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:18.482805    2565 scope.go:117] "RemoveContainer" containerID="3fb71d89368f5ebe8961a50cffce5aa8f6fb8c6d44109fc32f3a6b266572ca76"
Jul 06 12:24:18.483018 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:18.483003    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-p8p64_openshift-console-operator(92582abc-17fa-4f2e-aa1a-e92959fa532f)\"" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" podUID="92582abc-17fa-4f2e-aa1a-e92959fa532f"
Jul 06 12:24:19.523227 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.523192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:24:19.523685 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.523246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:24:19.525678 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.525658    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4a8f589-6dd7-40eb-92dd-d6b3759304bb-metrics-tls\") pod \"dns-default-4scf5\" (UID: \"d4a8f589-6dd7-40eb-92dd-d6b3759304bb\") " pod="openshift-dns/dns-default-4scf5"
Jul 06 12:24:19.525803 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.525730    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"image-registry-77d7c5b6b5-j7cvz\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") " pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:24:19.789814 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.789741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mnq4l\""
Jul 06 12:24:19.798067 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.798048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:24:19.812355 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.812324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gt55k\""
Jul 06 12:24:19.820619 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.820598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4scf5"
Jul 06 12:24:19.934277 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.934252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"]
Jul 06 12:24:19.936570 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:19.936544    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7169e464_346a_4e1a_91c8_2e4dfa70209a.slice/crio-c28a112d74323db87fef2e6fe35934ce586a7e5536fa51bbad0c8413f10e7d99 WatchSource:0}: Error finding container c28a112d74323db87fef2e6fe35934ce586a7e5536fa51bbad0c8413f10e7d99: Status 404 returned error can't find the container with id c28a112d74323db87fef2e6fe35934ce586a7e5536fa51bbad0c8413f10e7d99
Jul 06 12:24:19.993085 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:19.993060    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4scf5"]
Jul 06 12:24:19.996137 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:19.996109    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a8f589_6dd7_40eb_92dd_d6b3759304bb.slice/crio-417a3ee4da766cd045a57959c6216ea6ccb1675b159b146290b6813b7785b041 WatchSource:0}: Error finding container 417a3ee4da766cd045a57959c6216ea6ccb1675b159b146290b6813b7785b041: Status 404 returned error can't find the container with id 417a3ee4da766cd045a57959c6216ea6ccb1675b159b146290b6813b7785b041
Jul 06 12:24:20.329599 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.329564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:24:20.331762 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.331743    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/015b4ac3-23e7-48af-9f33-223162c4ad59-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-xnfpf\" (UID: \"015b4ac3-23e7-48af-9f33-223162c4ad59\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:24:20.513697 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.513657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd" event={"ID":"b5cf1326-e305-4428-a8a0-3aa0a73cf434","Type":"ContainerStarted","Data":"fc4d41fd4f83681f26d2dc68d3dec50af800808f386b66d78f27ae1707432ab3"}
Jul 06 12:24:20.514709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.514683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4scf5" event={"ID":"d4a8f589-6dd7-40eb-92dd-d6b3759304bb","Type":"ContainerStarted","Data":"417a3ee4da766cd045a57959c6216ea6ccb1675b159b146290b6813b7785b041"}
Jul 06 12:24:20.515992 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.515967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz" event={"ID":"7169e464-346a-4e1a-91c8-2e4dfa70209a","Type":"ContainerStarted","Data":"e0325fe2895cfc1e3d2a7d2e1cd322ac4679baa195c8d7a2247dd900e6059166"}
Jul 06 12:24:20.516087 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.516005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz" event={"ID":"7169e464-346a-4e1a-91c8-2e4dfa70209a","Type":"ContainerStarted","Data":"c28a112d74323db87fef2e6fe35934ce586a7e5536fa51bbad0c8413f10e7d99"}
Jul 06 12:24:20.516087 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.516037    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:24:20.530331 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.530291    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68754d4886-rftzd" podStartSLOduration=1.932833367 podStartE2EDuration="4.530276478s" totalImagesPullingTime="2.597443111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:20.53018185 +0000 UTC m=+107.270373183" watchObservedRunningTime="2026-07-06 12:24:20.530276478 +0000 UTC m=+107.270467813"
Jul 06 12:24:20.551338 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.551297    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz" podStartSLOduration=106.551284125 podStartE2EDuration="1m46.551284125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:20.550456935 +0000 UTC m=+107.290648267" watchObservedRunningTime="2026-07-06 12:24:20.551284125 +0000 UTC m=+107.291475461"
Jul 06 12:24:20.586771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.586716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"
Jul 06 12:24:20.719827 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:20.719793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf"]
Jul 06 12:24:20.724388 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:20.724364    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015b4ac3_23e7_48af_9f33_223162c4ad59.slice/crio-2c5f0d54a646033835c66ede282847b448cef67c5ca1f5867d7144738df687e8 WatchSource:0}: Error finding container 2c5f0d54a646033835c66ede282847b448cef67c5ca1f5867d7144738df687e8: Status 404 returned error can't find the container with id 2c5f0d54a646033835c66ede282847b448cef67c5ca1f5867d7144738df687e8
Jul 06 12:24:21.521079 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:21.521039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf" event={"ID":"015b4ac3-23e7-48af-9f33-223162c4ad59","Type":"ContainerStarted","Data":"2c5f0d54a646033835c66ede282847b448cef67c5ca1f5867d7144738df687e8"}
Jul 06 12:24:22.525919 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:22.525886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf" event={"ID":"015b4ac3-23e7-48af-9f33-223162c4ad59","Type":"ContainerStarted","Data":"10932e76da98f0fffee34f8a862ee795aed186129c2186b6e48fc9676218a0d6"}
Jul 06 12:24:22.527547 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:22.527513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4scf5" event={"ID":"d4a8f589-6dd7-40eb-92dd-d6b3759304bb","Type":"ContainerStarted","Data":"5af1a08adec8b04f3c38251b82976e6577e5ea74b815e2f31c7cd3d2652f560b"}
Jul 06 12:24:22.554967 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:22.554922    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-xnfpf" podStartSLOduration=32.919542787 podStartE2EDuration="34.554907042s" totalImagesPullingTime="1.635364255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:22.554583534 +0000 UTC m=+109.294774868" watchObservedRunningTime="2026-07-06 12:24:22.554907042 +0000 UTC m=+109.295098374"
Jul 06 12:24:22.993622 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:22.993593    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"]
Jul 06 12:24:22.996591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:22.996575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:22.999080 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:22.999059    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 12:24:22.999203 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:22.999064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jbcrd\""
Jul 06 12:24:23.021922 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.021900    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"]
Jul 06 12:24:23.155859 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.155834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55b0a3f7-24c3-4711-9f67-36b662425421-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-45jwq\" (UID: \"55b0a3f7-24c3-4711-9f67-36b662425421\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:23.257014 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.256960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55b0a3f7-24c3-4711-9f67-36b662425421-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-45jwq\" (UID: \"55b0a3f7-24c3-4711-9f67-36b662425421\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:23.257108 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:23.257058    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 12:24:23.257145 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:23.257110    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55b0a3f7-24c3-4711-9f67-36b662425421-tls-certificates podName:55b0a3f7-24c3-4711-9f67-36b662425421 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:23.757093902 +0000 UTC m=+110.497285232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/55b0a3f7-24c3-4711-9f67-36b662425421-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-45jwq" (UID: "55b0a3f7-24c3-4711-9f67-36b662425421") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 12:24:23.532809 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.532724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4scf5" event={"ID":"d4a8f589-6dd7-40eb-92dd-d6b3759304bb","Type":"ContainerStarted","Data":"5b12b2f574f12394dc3d371b0b554e426e8bd40f6b0695fab0c8d140c40219fb"}
Jul 06 12:24:23.557768 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.557719    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4scf5" podStartSLOduration=66.193220867 podStartE2EDuration="1m8.557701085s" totalImagesPullingTime="2.364480218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:23.556822431 +0000 UTC m=+110.297013765" watchObservedRunningTime="2026-07-06 12:24:23.557701085 +0000 UTC m=+110.297892419"
Jul 06 12:24:23.760038 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.760012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55b0a3f7-24c3-4711-9f67-36b662425421-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-45jwq\" (UID: \"55b0a3f7-24c3-4711-9f67-36b662425421\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:23.762289 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.762269    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55b0a3f7-24c3-4711-9f67-36b662425421-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-45jwq\" (UID: \"55b0a3f7-24c3-4711-9f67-36b662425421\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:23.904638 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:23.904617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:24.047506 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:24.047478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"]
Jul 06 12:24:24.050209 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:24.050182    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b0a3f7_24c3_4711_9f67_36b662425421.slice/crio-ea2e31f14c0964c6850082bc480cc18c121f218ad12bcd1a7961c346a4842d94 WatchSource:0}: Error finding container ea2e31f14c0964c6850082bc480cc18c121f218ad12bcd1a7961c346a4842d94: Status 404 returned error can't find the container with id ea2e31f14c0964c6850082bc480cc18c121f218ad12bcd1a7961c346a4842d94
Jul 06 12:24:24.263172 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:24.263079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:24.265422 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:24.265400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c56a172-8612-4ca8-9f5f-a13e8bfd3941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pj9dl\" (UID: \"9c56a172-8612-4ca8-9f5f-a13e8bfd3941\") " pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:24.537668 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:24.537567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq" event={"ID":"55b0a3f7-24c3-4711-9f67-36b662425421","Type":"ContainerStarted","Data":"ea2e31f14c0964c6850082bc480cc18c121f218ad12bcd1a7961c346a4842d94"}
Jul 06 12:24:24.538067 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:24.537726    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4scf5"
Jul 06 12:24:24.556034 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:24.556011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pj9dl"
Jul 06 12:24:24.688424 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:24.688230    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pj9dl"]
Jul 06 12:24:24.691268 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:24.691244    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c56a172_8612_4ca8_9f5f_a13e8bfd3941.slice/crio-d84ed17d875e559751938f8fe5e62a6727e070e5d2e7fdd486e26a2b3c3596d7 WatchSource:0}: Error finding container d84ed17d875e559751938f8fe5e62a6727e070e5d2e7fdd486e26a2b3c3596d7: Status 404 returned error can't find the container with id d84ed17d875e559751938f8fe5e62a6727e070e5d2e7fdd486e26a2b3c3596d7
Jul 06 12:24:25.547673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:25.547594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq" event={"ID":"55b0a3f7-24c3-4711-9f67-36b662425421","Type":"ContainerStarted","Data":"408a9d5d1ebd592b39629f8457eaa655cbc7a097cfbb563f5a956b5a81c372b6"}
Jul 06 12:24:25.548472 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:25.548444    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:25.551236 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:25.551209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pj9dl" event={"ID":"9c56a172-8612-4ca8-9f5f-a13e8bfd3941","Type":"ContainerStarted","Data":"d84ed17d875e559751938f8fe5e62a6727e070e5d2e7fdd486e26a2b3c3596d7"}
Jul 06 12:24:25.556025 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:25.555378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq"
Jul 06 12:24:25.615548 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:25.615481    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-45jwq" podStartSLOduration=2.630538322 podStartE2EDuration="3.615466661s" totalImagesPullingTime="984.928339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:25.581975897 +0000 UTC m=+112.322167232" watchObservedRunningTime="2026-07-06 12:24:25.615466661 +0000 UTC m=+112.355657994"
Jul 06 12:24:26.178600 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.178564    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"]
Jul 06 12:24:26.182316 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.182290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.189314 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.189293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 12:24:26.189707 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.189690    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lk72j\""
Jul 06 12:24:26.190267 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.190246    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 12:24:26.190918 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.190693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 12:24:26.190918 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.190786    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 12:24:26.191058 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.190972    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 12:24:26.210153 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.210129    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"]
Jul 06 12:24:26.279736 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.279693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.279877 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.279824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dc49ed8-92a9-4107-ae45-3275f303c9fe-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.279877 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.279861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhcv\" (UniqueName: \"kubernetes.io/projected/1dc49ed8-92a9-4107-ae45-3275f303c9fe-kube-api-access-nlhcv\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.279995 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.279938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.381220 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.381183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dc49ed8-92a9-4107-ae45-3275f303c9fe-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.381396 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.381230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhcv\" (UniqueName: \"kubernetes.io/projected/1dc49ed8-92a9-4107-ae45-3275f303c9fe-kube-api-access-nlhcv\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.381396 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.381281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.381396 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.381327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.381608 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:26.381483    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 12:24:26.381608 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:26.381575    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-tls podName:1dc49ed8-92a9-4107-ae45-3275f303c9fe nodeName:}" failed. No retries permitted until 2026-07-06 12:24:26.88155637 +0000 UTC m=+113.621747686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-vlmwd" (UID: "1dc49ed8-92a9-4107-ae45-3275f303c9fe") : secret "prometheus-operator-tls" not found
Jul 06 12:24:26.381963 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.381942    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dc49ed8-92a9-4107-ae45-3275f303c9fe-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.384099 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.384075    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.394389 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.394353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhcv\" (UniqueName: \"kubernetes.io/projected/1dc49ed8-92a9-4107-ae45-3275f303c9fe-kube-api-access-nlhcv\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.885294 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.885253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:26.888061 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:26.888030    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dc49ed8-92a9-4107-ae45-3275f303c9fe-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vlmwd\" (UID: \"1dc49ed8-92a9-4107-ae45-3275f303c9fe\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:27.092411 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:27.092379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"
Jul 06 12:24:28.457459 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:28.457429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd"]
Jul 06 12:24:28.461866 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:28.461828    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc49ed8_92a9_4107_ae45_3275f303c9fe.slice/crio-5a7f87815bef1c2156e9fd10d4b5e7b3955ae4773db605408cd321e6369fa82b WatchSource:0}: Error finding container 5a7f87815bef1c2156e9fd10d4b5e7b3955ae4773db605408cd321e6369fa82b: Status 404 returned error can't find the container with id 5a7f87815bef1c2156e9fd10d4b5e7b3955ae4773db605408cd321e6369fa82b
Jul 06 12:24:28.562425 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:28.562385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd" event={"ID":"1dc49ed8-92a9-4107-ae45-3275f303c9fe","Type":"ContainerStarted","Data":"5a7f87815bef1c2156e9fd10d4b5e7b3955ae4773db605408cd321e6369fa82b"}
Jul 06 12:24:28.563722 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:28.563698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pj9dl" event={"ID":"9c56a172-8612-4ca8-9f5f-a13e8bfd3941","Type":"ContainerStarted","Data":"cb5f53d3897cadd74311b1557fa9eeee165b32cf7d4042bc611440e21f25a6f4"}
Jul 06 12:24:29.570250 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:29.570202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pj9dl" event={"ID":"9c56a172-8612-4ca8-9f5f-a13e8bfd3941","Type":"ContainerStarted","Data":"d5ef171091a5d5452818173e3f6aaf360ace62bf3656e42f167e97ca6e3d965f"}
Jul 06 12:24:30.576157 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:30.576118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd" event={"ID":"1dc49ed8-92a9-4107-ae45-3275f303c9fe","Type":"ContainerStarted","Data":"b1fc91b4fe1d996225b0df4192f2cf654f26b225bb187e7bc2f0a72e9b6004b4"}
Jul 06 12:24:30.576618 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:30.576185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd" event={"ID":"1dc49ed8-92a9-4107-ae45-3275f303c9fe","Type":"ContainerStarted","Data":"809aa37cf3cd66ad740c4434fbfe34db4852f9601cb9732162495a78e1ffc525"}
Jul 06 12:24:30.596211 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:30.596157    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vlmwd" podStartSLOduration=3.369782279 podStartE2EDuration="4.596137297s" totalImagesPullingTime="1.226355018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:30.595224974 +0000 UTC m=+117.335416305" watchObservedRunningTime="2026-07-06 12:24:30.596137297 +0000 UTC m=+117.336328616"
Jul 06 12:24:30.879095 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:30.879014    2565 scope.go:117] "RemoveContainer" containerID="3fb71d89368f5ebe8961a50cffce5aa8f6fb8c6d44109fc32f3a6b266572ca76"
Jul 06 12:24:32.576512 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.576483    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fxv5k"]
Jul 06 12:24:32.586108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.586083    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:24:32.613697 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.613647    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pj9dl" podStartSLOduration=33.660009743 podStartE2EDuration="40.613630208s" totalImagesPullingTime="6.953620465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:23:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:32.613108982 +0000 UTC m=+119.353300327" watchObservedRunningTime="2026-07-06 12:24:32.613630208 +0000 UTC m=+119.353821542"
Jul 06 12:24:32.647921 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.647892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" event={"ID":"92582abc-17fa-4f2e-aa1a-e92959fa532f","Type":"ContainerStarted","Data":"5d0f52d1a2d9b5b41acc52dc96a409ff18165f9844bec3e17c3dba1f9be48882"}
Jul 06 12:24:32.648078 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.647935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pj9dl" event={"ID":"9c56a172-8612-4ca8-9f5f-a13e8bfd3941","Type":"ContainerStarted","Data":"c143bf37ce3f03fa5b81dd382cf6eea00dda414f1f2857f3ea52327267623ec0"}
Jul 06 12:24:32.648078 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.648047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.650498 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.650473    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 12:24:32.650664 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.650472    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9jcmc\""
Jul 06 12:24:32.650729 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.650654    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 12:24:32.650842 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.650828    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 12:24:32.832360 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-root\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832360 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832360 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-tls\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-textfile\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbpmj\" (UniqueName: \"kubernetes.io/projected/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-kube-api-access-cbpmj\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-wtmp\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-sys\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.832630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.832615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-metrics-client-ca\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.933708 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-sys\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.933860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-metrics-client-ca\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.933860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-root\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.933860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.933860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933802    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-sys\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.933860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-tls\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.934126 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-textfile\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.934126 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.934126 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbpmj\" (UniqueName: \"kubernetes.io/projected/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-kube-api-access-cbpmj\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.934126 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-wtmp\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.934126 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.934102    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-wtmp\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.934415 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.933875    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-root\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.934990 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.934592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.935102 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:32.934610    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 12:24:32.935102 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:32.935095    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-tls podName:dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:33.435074796 +0000 UTC m=+120.175266113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-tls") pod "node-exporter-fxv5k" (UID: "dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7") : secret "node-exporter-tls" not found
Jul 06 12:24:32.935102 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.934918    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-metrics-client-ca\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.935283 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.934735    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-textfile\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.937391 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.937338    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:32.954077 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:32.954047    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbpmj\" (UniqueName: \"kubernetes.io/projected/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-kube-api-access-cbpmj\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:33.231356 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.231259    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-p8p64" podStartSLOduration=43.278255228 podStartE2EDuration="45.231239913s" totalImagesPullingTime="1.952984685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:32.693138305 +0000 UTC m=+119.433329639" watchObservedRunningTime="2026-07-06 12:24:33.231239913 +0000 UTC m=+119.971431272"
Jul 06 12:24:33.232039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.232021    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-l96pm"]
Jul 06 12:24:33.261684 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.261658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-l96pm"]
Jul 06 12:24:33.261789 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.261771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-l96pm"
Jul 06 12:24:33.264445 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.264425    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 12:24:33.264747 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.264726    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 12:24:33.265021 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.265005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dtkdr\""
Jul 06 12:24:33.438813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.438787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-tls\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:33.438928 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.438821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-452hr\" (UniqueName: \"kubernetes.io/projected/a8942a48-0a6c-4804-9d3d-e34f114cb4db-kube-api-access-452hr\") pod \"downloads-685bfb5f64-l96pm\" (UID: \"a8942a48-0a6c-4804-9d3d-e34f114cb4db\") " pod="openshift-console/downloads-685bfb5f64-l96pm"
Jul 06 12:24:33.441080 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.441049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7-node-exporter-tls\") pod \"node-exporter-fxv5k\" (UID: \"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7\") " pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:33.539991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.539927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-452hr\" (UniqueName: \"kubernetes.io/projected/a8942a48-0a6c-4804-9d3d-e34f114cb4db-kube-api-access-452hr\") pod \"downloads-685bfb5f64-l96pm\" (UID: \"a8942a48-0a6c-4804-9d3d-e34f114cb4db\") " pod="openshift-console/downloads-685bfb5f64-l96pm"
Jul 06 12:24:33.552373 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.552349    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-452hr\" (UniqueName: \"kubernetes.io/projected/a8942a48-0a6c-4804-9d3d-e34f114cb4db-kube-api-access-452hr\") pod \"downloads-685bfb5f64-l96pm\" (UID: \"a8942a48-0a6c-4804-9d3d-e34f114cb4db\") " pod="openshift-console/downloads-685bfb5f64-l96pm"
Jul 06 12:24:33.558060 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.558041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fxv5k"
Jul 06 12:24:33.572341 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.572322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-l96pm"
Jul 06 12:24:33.586703 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:33.586678    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd3c9c7_cc4a_4575_90b9_3c65efa36ff7.slice/crio-4c8caf12a198a1583b69edad12a0a92e4143af78aea8400e08647fac63abb146 WatchSource:0}: Error finding container 4c8caf12a198a1583b69edad12a0a92e4143af78aea8400e08647fac63abb146: Status 404 returned error can't find the container with id 4c8caf12a198a1583b69edad12a0a92e4143af78aea8400e08647fac63abb146
Jul 06 12:24:33.592757 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.592729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxv5k" event={"ID":"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7","Type":"ContainerStarted","Data":"4c8caf12a198a1583b69edad12a0a92e4143af78aea8400e08647fac63abb146"}
Jul 06 12:24:33.755824 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:33.755796    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-l96pm"]
Jul 06 12:24:33.760507 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:33.760482    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8942a48_0a6c_4804_9d3d_e34f114cb4db.slice/crio-96cad9a4fae75ec4d246196981cc00d2e669b17e695dd5941acdf08b9b8b3695 WatchSource:0}: Error finding container 96cad9a4fae75ec4d246196981cc00d2e669b17e695dd5941acdf08b9b8b3695: Status 404 returned error can't find the container with id 96cad9a4fae75ec4d246196981cc00d2e669b17e695dd5941acdf08b9b8b3695
Jul 06 12:24:34.553807 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:34.553775    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4scf5"
Jul 06 12:24:34.599124 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:34.599085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-l96pm" event={"ID":"a8942a48-0a6c-4804-9d3d-e34f114cb4db","Type":"ContainerStarted","Data":"96cad9a4fae75ec4d246196981cc00d2e669b17e695dd5941acdf08b9b8b3695"}
Jul 06 12:24:35.605605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.605508    2565 generic.go:356] "Generic (PLEG): container finished" podID="dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7" containerID="ae1c4eb542a9b63dff9ef4efb4942014f5d3864922905248c550c366f6af7dd7" exitCode=0
Jul 06 12:24:35.605605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.605564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxv5k" event={"ID":"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7","Type":"ContainerDied","Data":"ae1c4eb542a9b63dff9ef4efb4942014f5d3864922905248c550c366f6af7dd7"}
Jul 06 12:24:35.611949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.611924    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"]
Jul 06 12:24:35.623877 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.621924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.632247 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.631442    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 12:24:35.632247 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.631706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-esjd8qc800ker\""
Jul 06 12:24:35.632247 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.631925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 12:24:35.632247 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.632050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mqgzp\""
Jul 06 12:24:35.632247 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.632133    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 12:24:35.637760 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.637708    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 12:24:35.642164 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.642143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 12:24:35.647818 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.647738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"]
Jul 06 12:24:35.758712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.758684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-grpc-tls\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.758822 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.758787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.758882 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.758835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.758882 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.758869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.758988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.758922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.759044 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.758984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-tls\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.759044 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.759013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9qr\" (UniqueName: \"kubernetes.io/projected/59287d82-f04f-4516-85e8-36c8a53ed3bd-kube-api-access-lt9qr\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.759136 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.759077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59287d82-f04f-4516-85e8-36c8a53ed3bd-metrics-client-ca\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.859815 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.859575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59287d82-f04f-4516-85e8-36c8a53ed3bd-metrics-client-ca\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.859815 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.859629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-grpc-tls\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.859815 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.859679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.859815 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.859719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.860392 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.860132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.860392 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.860181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.860392 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.860231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-tls\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.860392 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.860262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9qr\" (UniqueName: \"kubernetes.io/projected/59287d82-f04f-4516-85e8-36c8a53ed3bd-kube-api-access-lt9qr\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.861286 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.861253    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59287d82-f04f-4516-85e8-36c8a53ed3bd-metrics-client-ca\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.864904 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.864860    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.865845 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.865761    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-grpc-tls\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.866366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.865960    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-tls\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.866366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.866330    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.866512 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.866418    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.866512 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.866446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59287d82-f04f-4516-85e8-36c8a53ed3bd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.878764 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.878744    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9qr\" (UniqueName: \"kubernetes.io/projected/59287d82-f04f-4516-85e8-36c8a53ed3bd-kube-api-access-lt9qr\") pod \"thanos-querier-5d5bd9f4df-kh4lq\" (UID: \"59287d82-f04f-4516-85e8-36c8a53ed3bd\") " pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:35.935485 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:35.935451    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:36.114826 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:36.114753    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"]
Jul 06 12:24:36.118017 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:36.117987    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59287d82_f04f_4516_85e8_36c8a53ed3bd.slice/crio-035ca09dad04d312f645e4a1f7cd745b7f021e9ce31ff64480f61cbb32af90e2 WatchSource:0}: Error finding container 035ca09dad04d312f645e4a1f7cd745b7f021e9ce31ff64480f61cbb32af90e2: Status 404 returned error can't find the container with id 035ca09dad04d312f645e4a1f7cd745b7f021e9ce31ff64480f61cbb32af90e2
Jul 06 12:24:36.614487 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:36.614455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxv5k" event={"ID":"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7","Type":"ContainerStarted","Data":"d7f8b6b813db79fa4221a4fc587d05a72859e812472e75fc6e152fd77d3a7dd6"}
Jul 06 12:24:36.614992 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:36.614583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxv5k" event={"ID":"dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7","Type":"ContainerStarted","Data":"fe5eebb547442a3ebe5080b69f99898dd37f663354b20ca21b17728b73379676"}
Jul 06 12:24:36.615957 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:36.615930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" event={"ID":"59287d82-f04f-4516-85e8-36c8a53ed3bd","Type":"ContainerStarted","Data":"035ca09dad04d312f645e4a1f7cd745b7f021e9ce31ff64480f61cbb32af90e2"}
Jul 06 12:24:36.638050 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:36.637994    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fxv5k" podStartSLOduration=3.175246398 podStartE2EDuration="4.637976406s" totalImagesPullingTime="1.348130391s" totalInitContainerRuntime="114.599617ms" isStatefulPod=true podCreationTimestamp="2026-07-06 12:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:36.637088841 +0000 UTC m=+123.377280174" watchObservedRunningTime="2026-07-06 12:24:36.637976406 +0000 UTC m=+123.378167999"
Jul 06 12:24:37.312619 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.312576    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"]
Jul 06 12:24:37.328851 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.328822    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"]
Jul 06 12:24:37.329346 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.329323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:37.331952 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.331927    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 12:24:37.332301 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.332259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d2ln4\""
Jul 06 12:24:37.371749 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.371723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvsmw\" (UniqueName: \"kubernetes.io/projected/c7febc4c-0e29-447e-ae90-c755a88fbfe9-kube-api-access-lvsmw\") pod \"monitoring-plugin-d5dcff7cf-jgz92\" (UID: \"c7febc4c-0e29-447e-ae90-c755a88fbfe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:37.371870 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.371787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7febc4c-0e29-447e-ae90-c755a88fbfe9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jgz92\" (UID: \"c7febc4c-0e29-447e-ae90-c755a88fbfe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:37.472220 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.472187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvsmw\" (UniqueName: \"kubernetes.io/projected/c7febc4c-0e29-447e-ae90-c755a88fbfe9-kube-api-access-lvsmw\") pod \"monitoring-plugin-d5dcff7cf-jgz92\" (UID: \"c7febc4c-0e29-447e-ae90-c755a88fbfe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:37.472350 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.472244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7febc4c-0e29-447e-ae90-c755a88fbfe9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jgz92\" (UID: \"c7febc4c-0e29-447e-ae90-c755a88fbfe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:37.472436 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:37.472412    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 12:24:37.472633 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:24:37.472480    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7febc4c-0e29-447e-ae90-c755a88fbfe9-monitoring-plugin-cert podName:c7febc4c-0e29-447e-ae90-c755a88fbfe9 nodeName:}" failed. No retries permitted until 2026-07-06 12:24:37.972463892 +0000 UTC m=+124.712655209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c7febc4c-0e29-447e-ae90-c755a88fbfe9-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-jgz92" (UID: "c7febc4c-0e29-447e-ae90-c755a88fbfe9") : secret "monitoring-plugin-cert" not found
Jul 06 12:24:37.485962 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.485916    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvsmw\" (UniqueName: \"kubernetes.io/projected/c7febc4c-0e29-447e-ae90-c755a88fbfe9-kube-api-access-lvsmw\") pod \"monitoring-plugin-d5dcff7cf-jgz92\" (UID: \"c7febc4c-0e29-447e-ae90-c755a88fbfe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:37.977549 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.977497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7febc4c-0e29-447e-ae90-c755a88fbfe9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jgz92\" (UID: \"c7febc4c-0e29-447e-ae90-c755a88fbfe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:37.979997 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:37.979952    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7febc4c-0e29-447e-ae90-c755a88fbfe9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jgz92\" (UID: \"c7febc4c-0e29-447e-ae90-c755a88fbfe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:38.240991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:38.240904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:38.462103 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:38.461988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vvst9"
Jul 06 12:24:38.738644 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:38.738608    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"]
Jul 06 12:24:38.742253 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:38.742221    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7febc4c_0e29_447e_ae90_c755a88fbfe9.slice/crio-dbfa39eb07ccd415a33ecdbd3bf5f71bb3b6276189e6d16d72ae0f0b7ba5fb48 WatchSource:0}: Error finding container dbfa39eb07ccd415a33ecdbd3bf5f71bb3b6276189e6d16d72ae0f0b7ba5fb48: Status 404 returned error can't find the container with id dbfa39eb07ccd415a33ecdbd3bf5f71bb3b6276189e6d16d72ae0f0b7ba5fb48
Jul 06 12:24:39.334671 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:39.334274    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"]
Jul 06 12:24:39.340968 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:39.340939    2565 patch_prober.go:28] interesting pod/image-registry-77d7c5b6b5-j7cvz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 12:24:39.341084 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:39.340991    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz" podUID="7169e464-346a-4e1a-91c8-2e4dfa70209a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:24:39.632754 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:39.632716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92" event={"ID":"c7febc4c-0e29-447e-ae90-c755a88fbfe9","Type":"ContainerStarted","Data":"dbfa39eb07ccd415a33ecdbd3bf5f71bb3b6276189e6d16d72ae0f0b7ba5fb48"}
Jul 06 12:24:39.635067 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:39.635033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" event={"ID":"59287d82-f04f-4516-85e8-36c8a53ed3bd","Type":"ContainerStarted","Data":"be1cab527a46ad6ce9960b1ad243f83ff1401afe0aa3f278d6257df75363cae1"}
Jul 06 12:24:39.635202 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:39.635112    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" event={"ID":"59287d82-f04f-4516-85e8-36c8a53ed3bd","Type":"ContainerStarted","Data":"2b5b77f2f292b873a76eba6d58edf066454497f3541c112495aa0f3d37056e0d"}
Jul 06 12:24:39.635202 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:39.635153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" event={"ID":"59287d82-f04f-4516-85e8-36c8a53ed3bd","Type":"ContainerStarted","Data":"f8f78bb70101b4075327fcde1c8a1597d5187fd292d5cad28c30df63235829ef"}
Jul 06 12:24:41.649234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.649197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92" event={"ID":"c7febc4c-0e29-447e-ae90-c755a88fbfe9","Type":"ContainerStarted","Data":"a483bd63d49c1c8d223ed8578b7d29cfa8397b8015801eaa0155c90dc9368abd"}
Jul 06 12:24:41.649714 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.649303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:41.653254 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.653205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" event={"ID":"59287d82-f04f-4516-85e8-36c8a53ed3bd","Type":"ContainerStarted","Data":"006987ecc7544d3783459287d784c947aabe668da66df488ec7691ee75c7bd0a"}
Jul 06 12:24:41.653414 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.653287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" event={"ID":"59287d82-f04f-4516-85e8-36c8a53ed3bd","Type":"ContainerStarted","Data":"33a05d943c088ea871e8f3ca3d7823ff44119f0ed463e547bb02806715b81535"}
Jul 06 12:24:41.653414 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.653327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" event={"ID":"59287d82-f04f-4516-85e8-36c8a53ed3bd","Type":"ContainerStarted","Data":"e23b6958b62a594570a226c56d7dc73531de6de53d9a9dcac4b8133596f8cf47"}
Jul 06 12:24:41.653414 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.653378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:41.655580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.655550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92"
Jul 06 12:24:41.717388 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.717347    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jgz92" podStartSLOduration=2.644161495 podStartE2EDuration="4.717332874s" totalImagesPullingTime="2.073171379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:41.674931648 +0000 UTC m=+128.415122981" watchObservedRunningTime="2026-07-06 12:24:41.717332874 +0000 UTC m=+128.457524208"
Jul 06 12:24:41.717621 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:41.717597    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq" podStartSLOduration=2.239036777 podStartE2EDuration="6.717589697s" totalImagesPullingTime="4.47855292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:41.715514935 +0000 UTC m=+128.455706286" watchObservedRunningTime="2026-07-06 12:24:41.717589697 +0000 UTC m=+128.457781030"
Jul 06 12:24:42.519892 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:42.519856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:24:42.522569 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:42.522517    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2fcc5ce-786d-4f27-822c-f3c694ecae34-metrics-certs\") pod \"network-metrics-daemon-5mkvm\" (UID: \"a2fcc5ce-786d-4f27-822c-f3c694ecae34\") " pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:24:42.591798 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:42.591771    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l5tqd\""
Jul 06 12:24:42.599277 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:42.599251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5mkvm"
Jul 06 12:24:42.648860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:42.648831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:24:42.654423 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:42.654136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-p8p64"
Jul 06 12:24:42.750262 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:42.750185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5mkvm"]
Jul 06 12:24:42.753009 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:24:42.752981    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2fcc5ce_786d_4f27_822c_f3c694ecae34.slice/crio-6962ae0548e13872f9eda30c8983fe83508a23a773625fad682ece9340cb76c4 WatchSource:0}: Error finding container 6962ae0548e13872f9eda30c8983fe83508a23a773625fad682ece9340cb76c4: Status 404 returned error can't find the container with id 6962ae0548e13872f9eda30c8983fe83508a23a773625fad682ece9340cb76c4
Jul 06 12:24:43.666900 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:43.666858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5mkvm" event={"ID":"a2fcc5ce-786d-4f27-822c-f3c694ecae34","Type":"ContainerStarted","Data":"6962ae0548e13872f9eda30c8983fe83508a23a773625fad682ece9340cb76c4"}
Jul 06 12:24:44.673467 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:44.673426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5mkvm" event={"ID":"a2fcc5ce-786d-4f27-822c-f3c694ecae34","Type":"ContainerStarted","Data":"4e69cdcb96403d1619e3d91c97731764d0ad86382f370967c90eb93c6f3d05da"}
Jul 06 12:24:44.673931 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:44.673549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5mkvm" event={"ID":"a2fcc5ce-786d-4f27-822c-f3c694ecae34","Type":"ContainerStarted","Data":"8cd7f2e56a79d4d4cf238c1e1cd70f6638a6cc822e50bb9e813c574bd1b90291"}
Jul 06 12:24:44.697742 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:44.697696    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5mkvm" podStartSLOduration=129.652301632 podStartE2EDuration="2m10.697680948s" totalImagesPullingTime="1.045379316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:44.694760921 +0000 UTC m=+131.434952307" watchObservedRunningTime="2026-07-06 12:24:44.697680948 +0000 UTC m=+131.437872280"
Jul 06 12:24:47.666964 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:47.666932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d5bd9f4df-kh4lq"
Jul 06 12:24:49.340651 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:49.340621    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:24:52.713894 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:52.713854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-l96pm" event={"ID":"a8942a48-0a6c-4804-9d3d-e34f114cb4db","Type":"ContainerStarted","Data":"78228a096a6bec1745f39f781169cb10892c37cf4a1d79ead8ceb4c7b1cbd7fe"}
Jul 06 12:24:52.714490 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:52.714159    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-l96pm"
Jul 06 12:24:52.730693 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:52.730665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-l96pm"
Jul 06 12:24:52.756915 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:24:52.756855    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-l96pm" podStartSLOduration=1.81925999 podStartE2EDuration="19.756837717s" totalImagesPullingTime="17.937577727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:24:52.755770283 +0000 UTC m=+139.495961616" watchObservedRunningTime="2026-07-06 12:24:52.756837717 +0000 UTC m=+139.497029075"
Jul 06 12:25:04.360627 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:04.360566    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz" podUID="7169e464-346a-4e1a-91c8-2e4dfa70209a" containerName="registry" containerID="cri-o://e0325fe2895cfc1e3d2a7d2e1cd322ac4679baa195c8d7a2247dd900e6059166" gracePeriod=30
Jul 06 12:25:04.770075 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:04.770002    2565 generic.go:356] "Generic (PLEG): container finished" podID="7169e464-346a-4e1a-91c8-2e4dfa70209a" containerID="e0325fe2895cfc1e3d2a7d2e1cd322ac4679baa195c8d7a2247dd900e6059166" exitCode=0
Jul 06 12:25:04.770075 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:04.770052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz" event={"ID":"7169e464-346a-4e1a-91c8-2e4dfa70209a","Type":"ContainerDied","Data":"e0325fe2895cfc1e3d2a7d2e1cd322ac4679baa195c8d7a2247dd900e6059166"}
Jul 06 12:25:05.145251 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.145219    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:25:05.319115 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319253 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319144    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-trusted-ca\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319253 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-certificates\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319253 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319185    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-installation-pull-secrets\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319253 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-image-registry-private-configuration\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319253 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7169e464-346a-4e1a-91c8-2e4dfa70209a-ca-trust-extracted\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319501 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319271    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tptlz\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-kube-api-access-tptlz\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319501 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319309    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-bound-sa-token\") pod \"7169e464-346a-4e1a-91c8-2e4dfa70209a\" (UID: \"7169e464-346a-4e1a-91c8-2e4dfa70209a\") "
Jul 06 12:25:05.319643 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319615    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:25:05.319711 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.319653    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:25:05.321867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.321835    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-kube-api-access-tptlz" (OuterVolumeSpecName: "kube-api-access-tptlz") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "kube-api-access-tptlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:25:05.321867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.321840    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:25:05.322055 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.321839    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:25:05.322055 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.321912    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:25:05.322055 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.321948    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:25:05.328046 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.328021    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7169e464-346a-4e1a-91c8-2e4dfa70209a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7169e464-346a-4e1a-91c8-2e4dfa70209a" (UID: "7169e464-346a-4e1a-91c8-2e4dfa70209a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:25:05.420307 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420284    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tptlz\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-kube-api-access-tptlz\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.420307 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420306    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-bound-sa-token\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.420658 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420315    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.420658 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420323    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-trusted-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.420658 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420337    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7169e464-346a-4e1a-91c8-2e4dfa70209a-registry-certificates\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.420658 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420354    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-installation-pull-secrets\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.420658 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420365    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7169e464-346a-4e1a-91c8-2e4dfa70209a-image-registry-private-configuration\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.420658 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.420374    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7169e464-346a-4e1a-91c8-2e4dfa70209a-ca-trust-extracted\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:25:05.774710 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.774631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz" event={"ID":"7169e464-346a-4e1a-91c8-2e4dfa70209a","Type":"ContainerDied","Data":"c28a112d74323db87fef2e6fe35934ce586a7e5536fa51bbad0c8413f10e7d99"}
Jul 06 12:25:05.774710 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.774659    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"
Jul 06 12:25:05.774710 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.774701    2565 scope.go:117] "RemoveContainer" containerID="e0325fe2895cfc1e3d2a7d2e1cd322ac4679baa195c8d7a2247dd900e6059166"
Jul 06 12:25:05.807037 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.807014    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"]
Jul 06 12:25:05.821471 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.821448    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77d7c5b6b5-j7cvz"]
Jul 06 12:25:05.883687 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:05.883663    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7169e464-346a-4e1a-91c8-2e4dfa70209a" path="/var/lib/kubelet/pods/7169e464-346a-4e1a-91c8-2e4dfa70209a/volumes"
Jul 06 12:25:54.754760 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.754727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 12:25:54.755200 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.755010    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7169e464-346a-4e1a-91c8-2e4dfa70209a" containerName="registry"
Jul 06 12:25:54.755200 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.755021    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7169e464-346a-4e1a-91c8-2e4dfa70209a" containerName="registry"
Jul 06 12:25:54.755200 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.755076    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7169e464-346a-4e1a-91c8-2e4dfa70209a" containerName="registry"
Jul 06 12:25:54.759647 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.759624    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.762073 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 12:25:54.762073 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rg7qn\""
Jul 06 12:25:54.762239 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 12:25:54.762239 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762084    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 12:25:54.762239 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 12:25:54.762500 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762485    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 12:25:54.762596 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762505    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 12:25:54.762596 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 12:25:54.762808 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.762796    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 12:25:54.767703 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.767682    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 12:25:54.771127 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.771106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 12:25:54.862097 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862210 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862210 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862210 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862378 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6cq9\" (UniqueName: \"kubernetes.io/projected/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-kube-api-access-q6cq9\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862378 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862378 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862378 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862515 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862515 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862515 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-config-out\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862515 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-web-config\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.862515 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.862479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963346 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963460 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963460 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-config-out\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963460 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-web-config\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963460 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cq9\" (UniqueName: \"kubernetes.io/projected/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-kube-api-access-q6cq9\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963941 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963941 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963941 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.963941 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.963903    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.964666 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.964602    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.964861 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.964838    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.966522 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.966493    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.966673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.966585    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-web-config\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.966673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.966585    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.967237 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.967189    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.967430 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.967404    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-config-out\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.967504 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.967402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.967504 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.967461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.967650 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.967572    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.968538 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.968506    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:54.972260 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:54.972239    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6cq9\" (UniqueName: \"kubernetes.io/projected/2d2518c5-4a9a-49d4-a0d4-610fa76781ff-kube-api-access-q6cq9\") pod \"alertmanager-main-0\" (UID: \"2d2518c5-4a9a-49d4-a0d4-610fa76781ff\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:55.069993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:55.069973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 12:25:55.201789 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:55.201745    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 12:25:55.204098 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:25:55.204059    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2518c5_4a9a_49d4_a0d4_610fa76781ff.slice/crio-08c75d62234f3977cd17ea50b6d63f612a024363e8e3e0bfd99c34ff1c8e6210 WatchSource:0}: Error finding container 08c75d62234f3977cd17ea50b6d63f612a024363e8e3e0bfd99c34ff1c8e6210: Status 404 returned error can't find the container with id 08c75d62234f3977cd17ea50b6d63f612a024363e8e3e0bfd99c34ff1c8e6210
Jul 06 12:25:55.953355 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:55.953313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerStarted","Data":"08c75d62234f3977cd17ea50b6d63f612a024363e8e3e0bfd99c34ff1c8e6210"}
Jul 06 12:25:56.958502 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:56.958469    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d2518c5-4a9a-49d4-a0d4-610fa76781ff" containerID="8ebd274fe73984db2790fbcf8b5463c0925690c8d692e05be339f89c13f7363f" exitCode=0
Jul 06 12:25:56.958889 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:56.958558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerDied","Data":"8ebd274fe73984db2790fbcf8b5463c0925690c8d692e05be339f89c13f7363f"}
Jul 06 12:25:58.970977 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:58.970891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerStarted","Data":"1fc2a048cb81b26aa87565ea859ccfd402172429faac7af84918089fa1706f7f"}
Jul 06 12:25:58.971320 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:58.971009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerStarted","Data":"9776479f66ffcf001571886c0b3d19fdd7bd986cb538469c307f0c887e3cf828"}
Jul 06 12:25:58.971320 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:58.971051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerStarted","Data":"77297d0803ace3c162489bcf3074bc0ff23da1404cdf844a33be6ea8f9d31775"}
Jul 06 12:25:58.971320 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:58.971092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerStarted","Data":"b45d1da57a4ba321d3c429ee6ee494f2aab1c516035b0a32f56b105b3a51856b"}
Jul 06 12:25:58.971320 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:58.971126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerStarted","Data":"846cca01673cf59ab08b80166a78a1d0e695c038d536acfcc3ba82238cd26afb"}
Jul 06 12:25:58.971320 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:58.971162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d2518c5-4a9a-49d4-a0d4-610fa76781ff","Type":"ContainerStarted","Data":"312b22e32e2aca6f5c4d55250ce414f14d0ba38b8e8d588be61b79c55b85f4eb"}
Jul 06 12:25:59.003272 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:25:59.003223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.177515709 podStartE2EDuration="5.003207129s" totalImagesPullingTime="2.809788144s" totalInitContainerRuntime="15.903276ms" isStatefulPod=false podCreationTimestamp="2026-07-06 12:25:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:25:59.000760382 +0000 UTC m=+205.740951750" watchObservedRunningTime="2026-07-06 12:25:59.003207129 +0000 UTC m=+205.743398463"
Jul 06 12:26:45.511990 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.511960    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"]
Jul 06 12:26:45.516381 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.516359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.518773 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.518741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtwf5\""
Jul 06 12:26:45.518900 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.518825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 12:26:45.518900 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.518858    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 12:26:45.523816 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.523793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"]
Jul 06 12:26:45.528003 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.527981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znvkl\" (UniqueName: \"kubernetes.io/projected/b611adc3-6519-45b3-9b80-7fbe2b591b34-kube-api-access-znvkl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.528107 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.528024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.528107 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.528055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.628566 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.628520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znvkl\" (UniqueName: \"kubernetes.io/projected/b611adc3-6519-45b3-9b80-7fbe2b591b34-kube-api-access-znvkl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.628712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.628591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.628712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.628636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.628929 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.628911    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.628988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.628945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.637906 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.637881    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znvkl\" (UniqueName: \"kubernetes.io/projected/b611adc3-6519-45b3-9b80-7fbe2b591b34-kube-api-access-znvkl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.826026 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.826007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:26:45.956680 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:45.956654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"]
Jul 06 12:26:45.958282 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:26:45.958256    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb611adc3_6519_45b3_9b80_7fbe2b591b34.slice/crio-36d3e9ea542c5cd709bb1ef5156b46badd230c01ffb569ae6f29e0661aa59f86 WatchSource:0}: Error finding container 36d3e9ea542c5cd709bb1ef5156b46badd230c01ffb569ae6f29e0661aa59f86: Status 404 returned error can't find the container with id 36d3e9ea542c5cd709bb1ef5156b46badd230c01ffb569ae6f29e0661aa59f86
Jul 06 12:26:46.158881 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:46.158808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6" event={"ID":"b611adc3-6519-45b3-9b80-7fbe2b591b34","Type":"ContainerStarted","Data":"36d3e9ea542c5cd709bb1ef5156b46badd230c01ffb569ae6f29e0661aa59f86"}
Jul 06 12:26:54.196328 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:54.196292    2565 generic.go:356] "Generic (PLEG): container finished" podID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerID="1b0eacd2ebf7716c5b1fab1724af271b942d0d0efec1e8c37035582d88a34c70" exitCode=0
Jul 06 12:26:54.196843 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:54.196392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6" event={"ID":"b611adc3-6519-45b3-9b80-7fbe2b591b34","Type":"ContainerDied","Data":"1b0eacd2ebf7716c5b1fab1724af271b942d0d0efec1e8c37035582d88a34c70"}
Jul 06 12:26:56.206615 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:56.206577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6" event={"ID":"b611adc3-6519-45b3-9b80-7fbe2b591b34","Type":"ContainerStarted","Data":"309d68b676bf5efb5e9101fd5ecf27cb9a132118a986163a01137f44225bf6e0"}
Jul 06 12:26:57.212548 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:57.212502    2565 generic.go:356] "Generic (PLEG): container finished" podID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerID="309d68b676bf5efb5e9101fd5ecf27cb9a132118a986163a01137f44225bf6e0" exitCode=0
Jul 06 12:26:57.213006 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:26:57.212600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6" event={"ID":"b611adc3-6519-45b3-9b80-7fbe2b591b34","Type":"ContainerDied","Data":"309d68b676bf5efb5e9101fd5ecf27cb9a132118a986163a01137f44225bf6e0"}
Jul 06 12:27:05.247501 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:05.247461    2565 generic.go:356] "Generic (PLEG): container finished" podID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerID="824c7ede2cf95c61bca448e42a27533e26518b34b1e1fa1ba30fb94ee83e4c74" exitCode=0
Jul 06 12:27:05.247929 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:05.247559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6" event={"ID":"b611adc3-6519-45b3-9b80-7fbe2b591b34","Type":"ContainerDied","Data":"824c7ede2cf95c61bca448e42a27533e26518b34b1e1fa1ba30fb94ee83e4c74"}
Jul 06 12:27:06.383790 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.383766    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:27:06.494901 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.494871    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-bundle\") pod \"b611adc3-6519-45b3-9b80-7fbe2b591b34\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") "
Jul 06 12:27:06.495086 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.494912    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znvkl\" (UniqueName: \"kubernetes.io/projected/b611adc3-6519-45b3-9b80-7fbe2b591b34-kube-api-access-znvkl\") pod \"b611adc3-6519-45b3-9b80-7fbe2b591b34\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") "
Jul 06 12:27:06.495086 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.494962    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-util\") pod \"b611adc3-6519-45b3-9b80-7fbe2b591b34\" (UID: \"b611adc3-6519-45b3-9b80-7fbe2b591b34\") "
Jul 06 12:27:06.495621 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.495593    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-bundle" (OuterVolumeSpecName: "bundle") pod "b611adc3-6519-45b3-9b80-7fbe2b591b34" (UID: "b611adc3-6519-45b3-9b80-7fbe2b591b34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:27:06.497146 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.497126    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b611adc3-6519-45b3-9b80-7fbe2b591b34-kube-api-access-znvkl" (OuterVolumeSpecName: "kube-api-access-znvkl") pod "b611adc3-6519-45b3-9b80-7fbe2b591b34" (UID: "b611adc3-6519-45b3-9b80-7fbe2b591b34"). InnerVolumeSpecName "kube-api-access-znvkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:27:06.499283 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.499259    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-util" (OuterVolumeSpecName: "util") pod "b611adc3-6519-45b3-9b80-7fbe2b591b34" (UID: "b611adc3-6519-45b3-9b80-7fbe2b591b34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:27:06.595886 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.595858    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-util\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:06.595886 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.595887    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b611adc3-6519-45b3-9b80-7fbe2b591b34-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:06.596060 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:06.595896    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znvkl\" (UniqueName: \"kubernetes.io/projected/b611adc3-6519-45b3-9b80-7fbe2b591b34-kube-api-access-znvkl\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:07.257593 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:07.257553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6" event={"ID":"b611adc3-6519-45b3-9b80-7fbe2b591b34","Type":"ContainerDied","Data":"36d3e9ea542c5cd709bb1ef5156b46badd230c01ffb569ae6f29e0661aa59f86"}
Jul 06 12:27:07.257732 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:07.257602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fwld6"
Jul 06 12:27:07.257732 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:07.257613    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36d3e9ea542c5cd709bb1ef5156b46badd230c01ffb569ae6f29e0661aa59f86"
Jul 06 12:27:14.062020 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.061984    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"]
Jul 06 12:27:14.062484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.062287    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerName="extract"
Jul 06 12:27:14.062484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.062298    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerName="extract"
Jul 06 12:27:14.062484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.062316    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerName="util"
Jul 06 12:27:14.062484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.062322    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerName="util"
Jul 06 12:27:14.062484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.062337    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerName="pull"
Jul 06 12:27:14.062484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.062343    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerName="pull"
Jul 06 12:27:14.062484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.062387    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b611adc3-6519-45b3-9b80-7fbe2b591b34" containerName="extract"
Jul 06 12:27:14.065890 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.065873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.068580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.068548    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 12:27:14.068580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.068561    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:27:14.068758 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.068616    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hk9pb\""
Jul 06 12:27:14.082014 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.081994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"]
Jul 06 12:27:14.157970 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.157938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4q8t\" (UniqueName: \"kubernetes.io/projected/568c715c-eaee-4dc1-afac-67f4cdc3cd74-kube-api-access-f4q8t\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z2rq\" (UID: \"568c715c-eaee-4dc1-afac-67f4cdc3cd74\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.158113 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.157978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/568c715c-eaee-4dc1-afac-67f4cdc3cd74-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z2rq\" (UID: \"568c715c-eaee-4dc1-afac-67f4cdc3cd74\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.259013 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.258978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4q8t\" (UniqueName: \"kubernetes.io/projected/568c715c-eaee-4dc1-afac-67f4cdc3cd74-kube-api-access-f4q8t\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z2rq\" (UID: \"568c715c-eaee-4dc1-afac-67f4cdc3cd74\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.259013 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.259016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/568c715c-eaee-4dc1-afac-67f4cdc3cd74-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z2rq\" (UID: \"568c715c-eaee-4dc1-afac-67f4cdc3cd74\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.259375 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.259355    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/568c715c-eaee-4dc1-afac-67f4cdc3cd74-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z2rq\" (UID: \"568c715c-eaee-4dc1-afac-67f4cdc3cd74\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.274621 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.274598    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4q8t\" (UniqueName: \"kubernetes.io/projected/568c715c-eaee-4dc1-afac-67f4cdc3cd74-kube-api-access-f4q8t\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z2rq\" (UID: \"568c715c-eaee-4dc1-afac-67f4cdc3cd74\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.375077 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.375050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"
Jul 06 12:27:14.513909 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:14.513877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq"]
Jul 06 12:27:14.514989 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:27:14.514954    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568c715c_eaee_4dc1_afac_67f4cdc3cd74.slice/crio-339ed86e0dfbf5e2a94ccb81805c25330587025fd3dfa1270b5eb140cf812e0f WatchSource:0}: Error finding container 339ed86e0dfbf5e2a94ccb81805c25330587025fd3dfa1270b5eb140cf812e0f: Status 404 returned error can't find the container with id 339ed86e0dfbf5e2a94ccb81805c25330587025fd3dfa1270b5eb140cf812e0f
Jul 06 12:27:15.292218 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:15.292178    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq" event={"ID":"568c715c-eaee-4dc1-afac-67f4cdc3cd74","Type":"ContainerStarted","Data":"339ed86e0dfbf5e2a94ccb81805c25330587025fd3dfa1270b5eb140cf812e0f"}
Jul 06 12:27:16.298371 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:16.298288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq" event={"ID":"568c715c-eaee-4dc1-afac-67f4cdc3cd74","Type":"ContainerStarted","Data":"3dc436a949613593868262e1b77f56f570fb9534047de3d2a6e5bd10b8fa8a92"}
Jul 06 12:27:16.329328 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:16.329278    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z2rq" podStartSLOduration=0.897193734 podStartE2EDuration="2.329262627s" totalImagesPullingTime="1.432068893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:27:16.32698795 +0000 UTC m=+283.067179301" watchObservedRunningTime="2026-07-06 12:27:16.329262627 +0000 UTC m=+283.069453959"
Jul 06 12:27:17.702978 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.702941    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"]
Jul 06 12:27:17.705444 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.705427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.712128 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.711892    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 12:27:17.712128 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.711968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 12:27:17.712708 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.712683    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtwf5\""
Jul 06 12:27:17.730858 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.730824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"]
Jul 06 12:27:17.789491 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.789454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.789684 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.789500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtt99\" (UniqueName: \"kubernetes.io/projected/67d01097-9bc7-4905-b95e-ecb009c89fcc-kube-api-access-vtt99\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.789684 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.789553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.890367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.890333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.890572 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.890385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.890572 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.890422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtt99\" (UniqueName: \"kubernetes.io/projected/67d01097-9bc7-4905-b95e-ecb009c89fcc-kube-api-access-vtt99\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.890795 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.890774    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.890853 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.890798    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:17.907093 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:17.907059    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtt99\" (UniqueName: \"kubernetes.io/projected/67d01097-9bc7-4905-b95e-ecb009c89fcc-kube-api-access-vtt99\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:18.015097 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.015015    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:18.169783 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.169745    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"]
Jul 06 12:27:18.193843 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:27:18.193816    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d01097_9bc7_4905_b95e_ecb009c89fcc.slice/crio-ceddd8cabcce2e35c8ddf1322e6771a78852411ab5aadd14cfde966c07f96088 WatchSource:0}: Error finding container ceddd8cabcce2e35c8ddf1322e6771a78852411ab5aadd14cfde966c07f96088: Status 404 returned error can't find the container with id ceddd8cabcce2e35c8ddf1322e6771a78852411ab5aadd14cfde966c07f96088
Jul 06 12:27:18.308959 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.308935    2565 generic.go:356] "Generic (PLEG): container finished" podID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerID="7f25ce78f9dfa12373cae8281236f60f8618441c4087bf4304c041825e0ae544" exitCode=0
Jul 06 12:27:18.309068 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.308968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t" event={"ID":"67d01097-9bc7-4905-b95e-ecb009c89fcc","Type":"ContainerDied","Data":"7f25ce78f9dfa12373cae8281236f60f8618441c4087bf4304c041825e0ae544"}
Jul 06 12:27:18.309068 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.309005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t" event={"ID":"67d01097-9bc7-4905-b95e-ecb009c89fcc","Type":"ContainerStarted","Data":"ceddd8cabcce2e35c8ddf1322e6771a78852411ab5aadd14cfde966c07f96088"}
Jul 06 12:27:18.772205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.772169    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bdtx5"]
Jul 06 12:27:18.774546 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.774505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:18.778559 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.778539    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tfzrv\""
Jul 06 12:27:18.778967 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.778950    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 12:27:18.779030 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.778986    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 12:27:18.789447 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.789426    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bdtx5"]
Jul 06 12:27:18.898007 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.897976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea52f11e-5c05-406b-a420-2646a50ee5df-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bdtx5\" (UID: \"ea52f11e-5c05-406b-a420-2646a50ee5df\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:18.898170 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.898105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4svj8\" (UniqueName: \"kubernetes.io/projected/ea52f11e-5c05-406b-a420-2646a50ee5df-kube-api-access-4svj8\") pod \"cert-manager-webhook-6486ffd997-bdtx5\" (UID: \"ea52f11e-5c05-406b-a420-2646a50ee5df\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:18.998995 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.998958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4svj8\" (UniqueName: \"kubernetes.io/projected/ea52f11e-5c05-406b-a420-2646a50ee5df-kube-api-access-4svj8\") pod \"cert-manager-webhook-6486ffd997-bdtx5\" (UID: \"ea52f11e-5c05-406b-a420-2646a50ee5df\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:18.999131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:18.999020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea52f11e-5c05-406b-a420-2646a50ee5df-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bdtx5\" (UID: \"ea52f11e-5c05-406b-a420-2646a50ee5df\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:19.013993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:19.013959    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea52f11e-5c05-406b-a420-2646a50ee5df-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bdtx5\" (UID: \"ea52f11e-5c05-406b-a420-2646a50ee5df\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:19.016168 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:19.016142    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4svj8\" (UniqueName: \"kubernetes.io/projected/ea52f11e-5c05-406b-a420-2646a50ee5df-kube-api-access-4svj8\") pod \"cert-manager-webhook-6486ffd997-bdtx5\" (UID: \"ea52f11e-5c05-406b-a420-2646a50ee5df\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:19.083044 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:19.083019    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:19.267368 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:19.267336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bdtx5"]
Jul 06 12:27:19.270345 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:27:19.270319    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea52f11e_5c05_406b_a420_2646a50ee5df.slice/crio-f0aa2fb2d16577bf0a0027b511da3fc130a867cb9396e5c64f6a5813401df3b8 WatchSource:0}: Error finding container f0aa2fb2d16577bf0a0027b511da3fc130a867cb9396e5c64f6a5813401df3b8: Status 404 returned error can't find the container with id f0aa2fb2d16577bf0a0027b511da3fc130a867cb9396e5c64f6a5813401df3b8
Jul 06 12:27:19.314929 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:19.314902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5" event={"ID":"ea52f11e-5c05-406b-a420-2646a50ee5df","Type":"ContainerStarted","Data":"f0aa2fb2d16577bf0a0027b511da3fc130a867cb9396e5c64f6a5813401df3b8"}
Jul 06 12:27:20.327254 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:20.327197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t" event={"ID":"67d01097-9bc7-4905-b95e-ecb009c89fcc","Type":"ContainerStarted","Data":"eb3416e3fe17a76e263c5ed9c9390140edca15d63654d7c2faa328067600166b"}
Jul 06 12:27:21.335761 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:21.335724    2565 generic.go:356] "Generic (PLEG): container finished" podID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerID="eb3416e3fe17a76e263c5ed9c9390140edca15d63654d7c2faa328067600166b" exitCode=0
Jul 06 12:27:21.336162 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:21.335785    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t" event={"ID":"67d01097-9bc7-4905-b95e-ecb009c89fcc","Type":"ContainerDied","Data":"eb3416e3fe17a76e263c5ed9c9390140edca15d63654d7c2faa328067600166b"}
Jul 06 12:27:22.342587 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:22.342554    2565 generic.go:356] "Generic (PLEG): container finished" podID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerID="9bb686ae3c44d9c83f2e818371e278fc6a36f45efe2824583e541639a1566653" exitCode=0
Jul 06 12:27:22.342940 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:22.342640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t" event={"ID":"67d01097-9bc7-4905-b95e-ecb009c89fcc","Type":"ContainerDied","Data":"9bb686ae3c44d9c83f2e818371e278fc6a36f45efe2824583e541639a1566653"}
Jul 06 12:27:22.344293 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:22.344271    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5" event={"ID":"ea52f11e-5c05-406b-a420-2646a50ee5df","Type":"ContainerStarted","Data":"a2d79b3134e01ebdee45dc32635bfcc0f897d9ee4ea4040cdc009468b545eb29"}
Jul 06 12:27:22.344419 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:22.344328    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:22.378599 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:22.378542    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5" podStartSLOduration=1.425021514 podStartE2EDuration="4.378516243s" totalImagesPullingTime="2.953494729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:27:22.378450993 +0000 UTC m=+289.118642327" watchObservedRunningTime="2026-07-06 12:27:22.378516243 +0000 UTC m=+289.118707588"
Jul 06 12:27:23.477023 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.477001    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:23.539299 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.539264    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-bundle\") pod \"67d01097-9bc7-4905-b95e-ecb009c89fcc\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") "
Jul 06 12:27:23.539478 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.539309    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtt99\" (UniqueName: \"kubernetes.io/projected/67d01097-9bc7-4905-b95e-ecb009c89fcc-kube-api-access-vtt99\") pod \"67d01097-9bc7-4905-b95e-ecb009c89fcc\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") "
Jul 06 12:27:23.539478 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.539337    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-util\") pod \"67d01097-9bc7-4905-b95e-ecb009c89fcc\" (UID: \"67d01097-9bc7-4905-b95e-ecb009c89fcc\") "
Jul 06 12:27:23.539780 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.539758    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-bundle" (OuterVolumeSpecName: "bundle") pod "67d01097-9bc7-4905-b95e-ecb009c89fcc" (UID: "67d01097-9bc7-4905-b95e-ecb009c89fcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:27:23.541386 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.541359    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d01097-9bc7-4905-b95e-ecb009c89fcc-kube-api-access-vtt99" (OuterVolumeSpecName: "kube-api-access-vtt99") pod "67d01097-9bc7-4905-b95e-ecb009c89fcc" (UID: "67d01097-9bc7-4905-b95e-ecb009c89fcc"). InnerVolumeSpecName "kube-api-access-vtt99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:27:23.547019 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.546995    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-util" (OuterVolumeSpecName: "util") pod "67d01097-9bc7-4905-b95e-ecb009c89fcc" (UID: "67d01097-9bc7-4905-b95e-ecb009c89fcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:27:23.640569 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.640455    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:23.640569 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.640480    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtt99\" (UniqueName: \"kubernetes.io/projected/67d01097-9bc7-4905-b95e-ecb009c89fcc-kube-api-access-vtt99\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:23.640569 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:23.640490    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d01097-9bc7-4905-b95e-ecb009c89fcc-util\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:24.354970 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:24.354945    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t"
Jul 06 12:27:24.355132 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:24.354965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbdm6t" event={"ID":"67d01097-9bc7-4905-b95e-ecb009c89fcc","Type":"ContainerDied","Data":"ceddd8cabcce2e35c8ddf1322e6771a78852411ab5aadd14cfde966c07f96088"}
Jul 06 12:27:24.355132 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:24.355017    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ceddd8cabcce2e35c8ddf1322e6771a78852411ab5aadd14cfde966c07f96088"
Jul 06 12:27:25.712911 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.712879    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"]
Jul 06 12:27:25.713278 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.713162    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerName="extract"
Jul 06 12:27:25.713278 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.713173    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerName="extract"
Jul 06 12:27:25.713278 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.713184    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerName="pull"
Jul 06 12:27:25.713278 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.713190    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerName="pull"
Jul 06 12:27:25.713278 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.713205    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerName="util"
Jul 06 12:27:25.713278 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.713211    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerName="util"
Jul 06 12:27:25.713278 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.713266    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d01097-9bc7-4905-b95e-ecb009c89fcc" containerName="extract"
Jul 06 12:27:25.716681 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.716662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:25.719789 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.719766    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-n6fmx\""
Jul 06 12:27:25.728143 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.728114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"]
Jul 06 12:27:25.858207 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.858178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dedb771-4ad8-4d27-814e-711fa4c6a021-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8btnk\" (UID: \"5dedb771-4ad8-4d27-814e-711fa4c6a021\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:25.858207 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.858211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flx2g\" (UniqueName: \"kubernetes.io/projected/5dedb771-4ad8-4d27-814e-711fa4c6a021-kube-api-access-flx2g\") pod \"cert-manager-cainjector-559cdd8c87-8btnk\" (UID: \"5dedb771-4ad8-4d27-814e-711fa4c6a021\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:25.958711 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.958676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dedb771-4ad8-4d27-814e-711fa4c6a021-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8btnk\" (UID: \"5dedb771-4ad8-4d27-814e-711fa4c6a021\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:25.958895 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.958716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flx2g\" (UniqueName: \"kubernetes.io/projected/5dedb771-4ad8-4d27-814e-711fa4c6a021-kube-api-access-flx2g\") pod \"cert-manager-cainjector-559cdd8c87-8btnk\" (UID: \"5dedb771-4ad8-4d27-814e-711fa4c6a021\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:25.967440 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.967369    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flx2g\" (UniqueName: \"kubernetes.io/projected/5dedb771-4ad8-4d27-814e-711fa4c6a021-kube-api-access-flx2g\") pod \"cert-manager-cainjector-559cdd8c87-8btnk\" (UID: \"5dedb771-4ad8-4d27-814e-711fa4c6a021\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:25.967615 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:25.967594    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dedb771-4ad8-4d27-814e-711fa4c6a021-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8btnk\" (UID: \"5dedb771-4ad8-4d27-814e-711fa4c6a021\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:26.031600 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:26.031565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"
Jul 06 12:27:26.161579 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:26.161558    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8btnk"]
Jul 06 12:27:26.163684 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:27:26.163649    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dedb771_4ad8_4d27_814e_711fa4c6a021.slice/crio-eabac531bd25d067c296a77813dfebe3a10adc46e6caa74166a3eb13f44d5086 WatchSource:0}: Error finding container eabac531bd25d067c296a77813dfebe3a10adc46e6caa74166a3eb13f44d5086: Status 404 returned error can't find the container with id eabac531bd25d067c296a77813dfebe3a10adc46e6caa74166a3eb13f44d5086
Jul 06 12:27:26.369057 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:26.369017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk" event={"ID":"5dedb771-4ad8-4d27-814e-711fa4c6a021","Type":"ContainerStarted","Data":"0c903e9055c3fb52be3e592948d9ffe968166fd44d32ee679339eba7ae8323ae"}
Jul 06 12:27:26.369217 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:26.369066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk" event={"ID":"5dedb771-4ad8-4d27-814e-711fa4c6a021","Type":"ContainerStarted","Data":"eabac531bd25d067c296a77813dfebe3a10adc46e6caa74166a3eb13f44d5086"}
Jul 06 12:27:26.390166 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:26.390119    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8btnk" podStartSLOduration=1.390103246 podStartE2EDuration="1.390103246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:27:26.388831113 +0000 UTC m=+293.129022471" watchObservedRunningTime="2026-07-06 12:27:26.390103246 +0000 UTC m=+293.130294582"
Jul 06 12:27:28.350978 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:28.350950    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bdtx5"
Jul 06 12:27:30.369452 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.369420    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"]
Jul 06 12:27:30.372564 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.372547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.375954 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.375927    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-crctm\""
Jul 06 12:27:30.375954 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.375935    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 12:27:30.376104 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.375942    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:27:30.385201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.385181    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"]
Jul 06 12:27:30.498269 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.498235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/790ede7d-840f-4833-a109-6630c58a51b1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xhn55\" (UID: \"790ede7d-840f-4833-a109-6630c58a51b1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.498436 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.498297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6khw\" (UniqueName: \"kubernetes.io/projected/790ede7d-840f-4833-a109-6630c58a51b1-kube-api-access-n6khw\") pod \"openshift-lws-operator-fd8ccff4c-xhn55\" (UID: \"790ede7d-840f-4833-a109-6630c58a51b1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.599140 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.599104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/790ede7d-840f-4833-a109-6630c58a51b1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xhn55\" (UID: \"790ede7d-840f-4833-a109-6630c58a51b1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.599307 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.599149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6khw\" (UniqueName: \"kubernetes.io/projected/790ede7d-840f-4833-a109-6630c58a51b1-kube-api-access-n6khw\") pod \"openshift-lws-operator-fd8ccff4c-xhn55\" (UID: \"790ede7d-840f-4833-a109-6630c58a51b1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.599481 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.599460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/790ede7d-840f-4833-a109-6630c58a51b1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xhn55\" (UID: \"790ede7d-840f-4833-a109-6630c58a51b1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.614498 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.614475    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6khw\" (UniqueName: \"kubernetes.io/projected/790ede7d-840f-4833-a109-6630c58a51b1-kube-api-access-n6khw\") pod \"openshift-lws-operator-fd8ccff4c-xhn55\" (UID: \"790ede7d-840f-4833-a109-6630c58a51b1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.682495 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.682436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"
Jul 06 12:27:30.825957 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:30.825924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55"]
Jul 06 12:27:30.842893 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:27:30.842867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod790ede7d_840f_4833_a109_6630c58a51b1.slice/crio-ecb777f03c39406539555f97fe5b053ac1d3ad519ab26cdd9fb20f82a5d34915 WatchSource:0}: Error finding container ecb777f03c39406539555f97fe5b053ac1d3ad519ab26cdd9fb20f82a5d34915: Status 404 returned error can't find the container with id ecb777f03c39406539555f97fe5b053ac1d3ad519ab26cdd9fb20f82a5d34915
Jul 06 12:27:31.394888 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:31.394851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55" event={"ID":"790ede7d-840f-4833-a109-6630c58a51b1","Type":"ContainerStarted","Data":"ecb777f03c39406539555f97fe5b053ac1d3ad519ab26cdd9fb20f82a5d34915"}
Jul 06 12:27:33.405369 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:33.405333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55" event={"ID":"790ede7d-840f-4833-a109-6630c58a51b1","Type":"ContainerStarted","Data":"db4a9d859e18a4b37bd5322341ec53421b8ecbb5ff1a7889aa388b8f9961aa7d"}
Jul 06 12:27:33.424828 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:33.424773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xhn55" podStartSLOduration=1.893422056 podStartE2EDuration="3.424759091s" totalImagesPullingTime="1.531337035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:27:33.42334165 +0000 UTC m=+300.163532984" watchObservedRunningTime="2026-07-06 12:27:33.424759091 +0000 UTC m=+300.164950423"
Jul 06 12:27:33.638816 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:33.638782    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:27:33.640768 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:33.640738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:27:33.649878 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:33.649857    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 12:27:36.239128 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.239095    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"]
Jul 06 12:27:36.243450 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.243435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.246102 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.246080    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 12:27:36.246842 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.246826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 12:27:36.246936 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.246861    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rtwf5\""
Jul 06 12:27:36.252365 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.252328    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"]
Jul 06 12:27:36.346166 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.346137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.346343 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.346194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkq7f\" (UniqueName: \"kubernetes.io/projected/e813824a-901c-47f1-a87e-73b4024a60e5-kube-api-access-hkq7f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.346343 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.346238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.446626 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.446590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkq7f\" (UniqueName: \"kubernetes.io/projected/e813824a-901c-47f1-a87e-73b4024a60e5-kube-api-access-hkq7f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.447096 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.446637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.447096 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.446681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.447096 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.447034    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.447096 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.447060    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.457879 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.457856    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkq7f\" (UniqueName: \"kubernetes.io/projected/e813824a-901c-47f1-a87e-73b4024a60e5-kube-api-access-hkq7f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.553580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.553510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:36.711426 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:36.711398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"]
Jul 06 12:27:36.717007 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:27:36.716979    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode813824a_901c_47f1_a87e_73b4024a60e5.slice/crio-e8c7f61d7fcbeb4b81b6ae124474933856136c23261a0b1c908f5149a0792d8f WatchSource:0}: Error finding container e8c7f61d7fcbeb4b81b6ae124474933856136c23261a0b1c908f5149a0792d8f: Status 404 returned error can't find the container with id e8c7f61d7fcbeb4b81b6ae124474933856136c23261a0b1c908f5149a0792d8f
Jul 06 12:27:37.424547 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:37.424506    2565 generic.go:356] "Generic (PLEG): container finished" podID="e813824a-901c-47f1-a87e-73b4024a60e5" containerID="b2e94d89845d6ad5ebfab671bbdfc9b4201931e4639ad71eb131de5e54cffd1b" exitCode=0
Jul 06 12:27:37.425002 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:37.424577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s" event={"ID":"e813824a-901c-47f1-a87e-73b4024a60e5","Type":"ContainerDied","Data":"b2e94d89845d6ad5ebfab671bbdfc9b4201931e4639ad71eb131de5e54cffd1b"}
Jul 06 12:27:37.425002 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:37.424614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s" event={"ID":"e813824a-901c-47f1-a87e-73b4024a60e5","Type":"ContainerStarted","Data":"e8c7f61d7fcbeb4b81b6ae124474933856136c23261a0b1c908f5149a0792d8f"}
Jul 06 12:27:37.425194 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:37.425174    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:27:39.434636 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:39.434602    2565 generic.go:356] "Generic (PLEG): container finished" podID="e813824a-901c-47f1-a87e-73b4024a60e5" containerID="ecbfc12caa272816d2c4c43aed448d1f07dab07d2bc51b55c885a48460612317" exitCode=0
Jul 06 12:27:39.435100 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:39.434703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s" event={"ID":"e813824a-901c-47f1-a87e-73b4024a60e5","Type":"ContainerDied","Data":"ecbfc12caa272816d2c4c43aed448d1f07dab07d2bc51b55c885a48460612317"}
Jul 06 12:27:40.441108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:40.441074    2565 generic.go:356] "Generic (PLEG): container finished" podID="e813824a-901c-47f1-a87e-73b4024a60e5" containerID="75af06f1fb95a44c2ef12771d919ebb2b84ad211214d4201abc1623e002f7f95" exitCode=0
Jul 06 12:27:40.441458 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:40.441132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s" event={"ID":"e813824a-901c-47f1-a87e-73b4024a60e5","Type":"ContainerDied","Data":"75af06f1fb95a44c2ef12771d919ebb2b84ad211214d4201abc1623e002f7f95"}
Jul 06 12:27:41.568822 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.568795    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:41.683173 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.683146    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-util\") pod \"e813824a-901c-47f1-a87e-73b4024a60e5\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") "
Jul 06 12:27:41.683319 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.683201    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-bundle\") pod \"e813824a-901c-47f1-a87e-73b4024a60e5\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") "
Jul 06 12:27:41.683319 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.683249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkq7f\" (UniqueName: \"kubernetes.io/projected/e813824a-901c-47f1-a87e-73b4024a60e5-kube-api-access-hkq7f\") pod \"e813824a-901c-47f1-a87e-73b4024a60e5\" (UID: \"e813824a-901c-47f1-a87e-73b4024a60e5\") "
Jul 06 12:27:41.684062 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.684035    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-bundle" (OuterVolumeSpecName: "bundle") pod "e813824a-901c-47f1-a87e-73b4024a60e5" (UID: "e813824a-901c-47f1-a87e-73b4024a60e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:27:41.685371 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.685350    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e813824a-901c-47f1-a87e-73b4024a60e5-kube-api-access-hkq7f" (OuterVolumeSpecName: "kube-api-access-hkq7f") pod "e813824a-901c-47f1-a87e-73b4024a60e5" (UID: "e813824a-901c-47f1-a87e-73b4024a60e5"). InnerVolumeSpecName "kube-api-access-hkq7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:27:41.688735 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.688701    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-util" (OuterVolumeSpecName: "util") pod "e813824a-901c-47f1-a87e-73b4024a60e5" (UID: "e813824a-901c-47f1-a87e-73b4024a60e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:27:41.783949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.783874    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkq7f\" (UniqueName: \"kubernetes.io/projected/e813824a-901c-47f1-a87e-73b4024a60e5-kube-api-access-hkq7f\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:41.783949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.783910    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-util\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:41.783949 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:41.783921    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e813824a-901c-47f1-a87e-73b4024a60e5-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:27:42.453202 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:42.453172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s" event={"ID":"e813824a-901c-47f1-a87e-73b4024a60e5","Type":"ContainerDied","Data":"e8c7f61d7fcbeb4b81b6ae124474933856136c23261a0b1c908f5149a0792d8f"}
Jul 06 12:27:42.453363 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:42.453216    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8c7f61d7fcbeb4b81b6ae124474933856136c23261a0b1c908f5149a0792d8f"
Jul 06 12:27:42.453363 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:42.453220    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmpr7s"
Jul 06 12:27:52.503332 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503296    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"]
Jul 06 12:27:52.503796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503642    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e813824a-901c-47f1-a87e-73b4024a60e5" containerName="util"
Jul 06 12:27:52.503796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e813824a-901c-47f1-a87e-73b4024a60e5" containerName="util"
Jul 06 12:27:52.503796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503664    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e813824a-901c-47f1-a87e-73b4024a60e5" containerName="extract"
Jul 06 12:27:52.503796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503669    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e813824a-901c-47f1-a87e-73b4024a60e5" containerName="extract"
Jul 06 12:27:52.503796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503681    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e813824a-901c-47f1-a87e-73b4024a60e5" containerName="pull"
Jul 06 12:27:52.503796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503687    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e813824a-901c-47f1-a87e-73b4024a60e5" containerName="pull"
Jul 06 12:27:52.503796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.503747    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e813824a-901c-47f1-a87e-73b4024a60e5" containerName="extract"
Jul 06 12:27:52.510464 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.510442    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.513585 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.513565    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 12:27:52.513862 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.513847    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 12:27:52.514048 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.514033    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kssh9\""
Jul 06 12:27:52.514178 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.514152    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 12:27:52.514284 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.514177    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 12:27:52.521623 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.521599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"]
Jul 06 12:27:52.670299 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.670264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae2bf7e-583d-4406-9424-927f9b94047f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.670461 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.670309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae2bf7e-583d-4406-9424-927f9b94047f-webhook-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.670461 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.670342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae2bf7e-583d-4406-9424-927f9b94047f-tmp\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.670461 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.670375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae2bf7e-583d-4406-9424-927f9b94047f-manifests\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.670461 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.670426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg5x7\" (UniqueName: \"kubernetes.io/projected/5ae2bf7e-583d-4406-9424-927f9b94047f-kube-api-access-dg5x7\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.770856 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.770777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae2bf7e-583d-4406-9424-927f9b94047f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.770856 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.770814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae2bf7e-583d-4406-9424-927f9b94047f-webhook-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.770856 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.770832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae2bf7e-583d-4406-9424-927f9b94047f-tmp\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.770856 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.770858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae2bf7e-583d-4406-9424-927f9b94047f-manifests\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.771177 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.770881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg5x7\" (UniqueName: \"kubernetes.io/projected/5ae2bf7e-583d-4406-9424-927f9b94047f-kube-api-access-dg5x7\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.771311 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.771288    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae2bf7e-583d-4406-9424-927f9b94047f-manifests\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.773214 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.773192    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae2bf7e-583d-4406-9424-927f9b94047f-tmp\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.773302 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.773278    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae2bf7e-583d-4406-9424-927f9b94047f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.773354 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.773335    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae2bf7e-583d-4406-9424-927f9b94047f-webhook-cert\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.782885 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.782856    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg5x7\" (UniqueName: \"kubernetes.io/projected/5ae2bf7e-583d-4406-9424-927f9b94047f-kube-api-access-dg5x7\") pod \"opendatahub-operator-controller-manager-67cf9968b4-zmrgq\" (UID: \"5ae2bf7e-583d-4406-9424-927f9b94047f\") " pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.820801 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.820782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:52.979434 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:52.979339    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"]
Jul 06 12:27:52.981694 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:27:52.981669    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae2bf7e_583d_4406_9424_927f9b94047f.slice/crio-0521864abe7587c9bc2703c57c1b5ce324fe85e4558039cfe01ba27ddc30aff5 WatchSource:0}: Error finding container 0521864abe7587c9bc2703c57c1b5ce324fe85e4558039cfe01ba27ddc30aff5: Status 404 returned error can't find the container with id 0521864abe7587c9bc2703c57c1b5ce324fe85e4558039cfe01ba27ddc30aff5
Jul 06 12:27:53.507003 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:53.506966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq" event={"ID":"5ae2bf7e-583d-4406-9424-927f9b94047f","Type":"ContainerStarted","Data":"0521864abe7587c9bc2703c57c1b5ce324fe85e4558039cfe01ba27ddc30aff5"}
Jul 06 12:27:56.524752 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:56.524718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq" event={"ID":"5ae2bf7e-583d-4406-9424-927f9b94047f","Type":"ContainerStarted","Data":"d3f05b261b8527795674b7081862603d307365b3500349a5c0c726a4d69ba163"}
Jul 06 12:27:57.531417 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:57.531331    2565 generic.go:356] "Generic (PLEG): container finished" podID="5ae2bf7e-583d-4406-9424-927f9b94047f" containerID="d3f05b261b8527795674b7081862603d307365b3500349a5c0c726a4d69ba163" exitCode=0
Jul 06 12:27:57.531417 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:57.531383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq" event={"ID":"5ae2bf7e-583d-4406-9424-927f9b94047f","Type":"ContainerDied","Data":"d3f05b261b8527795674b7081862603d307365b3500349a5c0c726a4d69ba163"}
Jul 06 12:27:58.538970 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:58.538938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq" event={"ID":"5ae2bf7e-583d-4406-9424-927f9b94047f","Type":"ContainerStarted","Data":"50858ada1b4974873d5ba0019bd74f0115625685d103c95fcc80291f0a16b87f"}
Jul 06 12:27:58.539447 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:58.539067    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:27:58.573796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:27:58.573746    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq" podStartSLOduration=2.122731934 podStartE2EDuration="6.573730026s" totalImagesPullingTime="3.440240867s" totalInitContainerRuntime="1.010757225s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:27:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:27:58.570701791 +0000 UTC m=+325.310893135" watchObservedRunningTime="2026-07-06 12:27:58.573730026 +0000 UTC m=+325.313921439"
Jul 06 12:28:09.545743 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:09.545710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67cf9968b4-zmrgq"
Jul 06 12:28:23.391995 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.391962    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"]
Jul 06 12:28:23.400989 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.400959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.406065 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.405866    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 12:28:23.406335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.406313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 12:28:23.406666 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.406410    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 12:28:23.406820 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.406800    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 12:28:23.431513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.431483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"]
Jul 06 12:28:23.516663 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.516631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tmp\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.516663 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.516669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tls-certs\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.516874 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.516694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvrl\" (UniqueName: \"kubernetes.io/projected/7a136c3b-4c40-45ff-ba99-fa366c332ac6-kube-api-access-rnvrl\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.617918 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.617886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tmp\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.617918 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.617923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tls-certs\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.618114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.617951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvrl\" (UniqueName: \"kubernetes.io/projected/7a136c3b-4c40-45ff-ba99-fa366c332ac6-kube-api-access-rnvrl\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.618114 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:28:23.618040    2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 12:28:23.618114 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:28:23.618113    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tls-certs podName:7a136c3b-4c40-45ff-ba99-fa366c332ac6 nodeName:}" failed. No retries permitted until 2026-07-06 12:28:24.118091763 +0000 UTC m=+350.858283091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tls-certs") pod "kube-auth-proxy-7d7ff6d984-7lgkt" (UID: "7a136c3b-4c40-45ff-ba99-fa366c332ac6") : secret "kube-auth-proxy-tls" not found
Jul 06 12:28:23.620112 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.620096    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tmp\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:23.633767 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:23.633742    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvrl\" (UniqueName: \"kubernetes.io/projected/7a136c3b-4c40-45ff-ba99-fa366c332ac6-kube-api-access-rnvrl\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:24.122121 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.122082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tls-certs\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:24.124590 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.124559    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a136c3b-4c40-45ff-ba99-fa366c332ac6-tls-certs\") pod \"kube-auth-proxy-7d7ff6d984-7lgkt\" (UID: \"7a136c3b-4c40-45ff-ba99-fa366c332ac6\") " pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:24.314662 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.314633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"
Jul 06 12:28:24.485542 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.472653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt"]
Jul 06 12:28:24.660747 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.660662    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"]
Jul 06 12:28:24.665562 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.665518    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt" event={"ID":"7a136c3b-4c40-45ff-ba99-fa366c332ac6","Type":"ContainerStarted","Data":"bc6b2bf932bc93611cc12ccd8d01e32ac31ff0e49f553c9672655ac9aeab4dd4"}
Jul 06 12:28:24.665678 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.665651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:24.668514 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.668484    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 12:28:24.669033 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.669013    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gkr6r\""
Jul 06 12:28:24.691190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.691165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"]
Jul 06 12:28:24.693485 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.693463    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"]
Jul 06 12:28:24.696618 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.696601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:24.698899 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.698882    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9swdx\""
Jul 06 12:28:24.699855 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.699834    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 12:28:24.706712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.706664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"]
Jul 06 12:28:24.726684 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.726660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rwvm\" (UniqueName: \"kubernetes.io/projected/18ff3487-07b6-4450-b0bd-4b20b134a39a-kube-api-access-5rwvm\") pod \"kserve-controller-manager-d6f4b65b8-klpq9\" (UID: \"18ff3487-07b6-4450-b0bd-4b20b134a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:24.726770 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.726703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18ff3487-07b6-4450-b0bd-4b20b134a39a-cert\") pod \"kserve-controller-manager-d6f4b65b8-klpq9\" (UID: \"18ff3487-07b6-4450-b0bd-4b20b134a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:24.827346 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.827316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18ff3487-07b6-4450-b0bd-4b20b134a39a-cert\") pod \"kserve-controller-manager-d6f4b65b8-klpq9\" (UID: \"18ff3487-07b6-4450-b0bd-4b20b134a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:24.827487 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.827380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rwvm\" (UniqueName: \"kubernetes.io/projected/18ff3487-07b6-4450-b0bd-4b20b134a39a-kube-api-access-5rwvm\") pod \"kserve-controller-manager-d6f4b65b8-klpq9\" (UID: \"18ff3487-07b6-4450-b0bd-4b20b134a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:24.827487 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.827405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znvvg\" (UniqueName: \"kubernetes.io/projected/6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef-kube-api-access-znvvg\") pod \"llmisvc-controller-manager-777c6bd7d5-dpm7f\" (UID: \"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:24.827487 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.827429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dpm7f\" (UID: \"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:24.829689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.829665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18ff3487-07b6-4450-b0bd-4b20b134a39a-cert\") pod \"kserve-controller-manager-d6f4b65b8-klpq9\" (UID: \"18ff3487-07b6-4450-b0bd-4b20b134a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:24.850377 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.850352    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rwvm\" (UniqueName: \"kubernetes.io/projected/18ff3487-07b6-4450-b0bd-4b20b134a39a-kube-api-access-5rwvm\") pod \"kserve-controller-manager-d6f4b65b8-klpq9\" (UID: \"18ff3487-07b6-4450-b0bd-4b20b134a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:24.928426 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.928336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znvvg\" (UniqueName: \"kubernetes.io/projected/6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef-kube-api-access-znvvg\") pod \"llmisvc-controller-manager-777c6bd7d5-dpm7f\" (UID: \"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:24.928426 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.928386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dpm7f\" (UID: \"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:24.934113 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.931695    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dpm7f\" (UID: \"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:24.940760 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.940736    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znvvg\" (UniqueName: \"kubernetes.io/projected/6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef-kube-api-access-znvvg\") pod \"llmisvc-controller-manager-777c6bd7d5-dpm7f\" (UID: \"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:24.975980 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:24.975952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:25.006025 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.005997    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:25.134159 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.134034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"]
Jul 06 12:28:25.136980 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:28:25.136956    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ff3487_07b6_4450_b0bd_4b20b134a39a.slice/crio-09c02488bd6638c75353381e4675559dee223eaa558decb38d946b4aa07ee551 WatchSource:0}: Error finding container 09c02488bd6638c75353381e4675559dee223eaa558decb38d946b4aa07ee551: Status 404 returned error can't find the container with id 09c02488bd6638c75353381e4675559dee223eaa558decb38d946b4aa07ee551
Jul 06 12:28:25.175937 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.175897    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"]
Jul 06 12:28:25.182108 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:28:25.182073    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a2fc5bc_2f42_4a78_9c34_a4fbb5cd3cef.slice/crio-95a968245087de7d0699ec2f0b9c543a7020237192c3b2ead4036ce8bb0ad840 WatchSource:0}: Error finding container 95a968245087de7d0699ec2f0b9c543a7020237192c3b2ead4036ce8bb0ad840: Status 404 returned error can't find the container with id 95a968245087de7d0699ec2f0b9c543a7020237192c3b2ead4036ce8bb0ad840
Jul 06 12:28:25.669882 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.669843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f" event={"ID":"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef","Type":"ContainerStarted","Data":"95a968245087de7d0699ec2f0b9c543a7020237192c3b2ead4036ce8bb0ad840"}
Jul 06 12:28:25.671162 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.671131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9" event={"ID":"18ff3487-07b6-4450-b0bd-4b20b134a39a","Type":"ContainerStarted","Data":"09c02488bd6638c75353381e4675559dee223eaa558decb38d946b4aa07ee551"}
Jul 06 12:28:25.846361 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.846331    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"]
Jul 06 12:28:25.849680 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.849657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:25.852468 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.852434    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 12:28:25.852582 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.852503    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 12:28:25.852582 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.852521    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 12:28:25.852855 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.852839    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 12:28:25.852993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.852974    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-njwm9\""
Jul 06 12:28:25.867455 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.867423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"]
Jul 06 12:28:25.937643 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.937573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:25.937801 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.937649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:25.937801 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.937693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zddqr\" (UniqueName: \"kubernetes.io/projected/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-kube-api-access-zddqr\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:25.937801 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.937731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:25.937801 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.937764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:25.937801 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.937787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:25.938017 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:25.937814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039045 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039197 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039197 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039197 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zddqr\" (UniqueName: \"kubernetes.io/projected/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-kube-api-access-zddqr\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039360 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039360 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039360 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.039764 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.039739    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.042032 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.042007    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.042132 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.042032    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.042132 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.042037    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.042255 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.042222    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.053879 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.053837    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zddqr\" (UniqueName: \"kubernetes.io/projected/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-kube-api-access-zddqr\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.054719 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.054689    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2111cdc2-dbf3-47e9-bdae-bbe7eab033ed-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5jkqn\" (UID: \"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.160132 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.159950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:26.802983 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:26.802954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"]
Jul 06 12:28:26.805141 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:28:26.805101    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2111cdc2_dbf3_47e9_bdae_bbe7eab033ed.slice/crio-e18d65e99235a4df3cafcec8f3a428aabfd943312c3244ff861ec93a0eb7b884 WatchSource:0}: Error finding container e18d65e99235a4df3cafcec8f3a428aabfd943312c3244ff861ec93a0eb7b884: Status 404 returned error can't find the container with id e18d65e99235a4df3cafcec8f3a428aabfd943312c3244ff861ec93a0eb7b884
Jul 06 12:28:27.692550 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:27.692303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn" event={"ID":"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed","Type":"ContainerStarted","Data":"e18d65e99235a4df3cafcec8f3a428aabfd943312c3244ff861ec93a0eb7b884"}
Jul 06 12:28:29.705005 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.704969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f" event={"ID":"6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef","Type":"ContainerStarted","Data":"8bc1a967db146372f3ec8b7bf04ff542ea23174ac8db7de0a3e47d63ed58ab7f"}
Jul 06 12:28:29.705462 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.705070    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:28:29.706570 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.706548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9" event={"ID":"18ff3487-07b6-4450-b0bd-4b20b134a39a","Type":"ContainerStarted","Data":"aa19d5e7a45afd0a02b68b630c42ca49ebe3793795451d977f083b8d12a207e2"}
Jul 06 12:28:29.706683 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.706590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:28:29.707971 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.707950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt" event={"ID":"7a136c3b-4c40-45ff-ba99-fa366c332ac6","Type":"ContainerStarted","Data":"2e36b01fcb1ed1693e3a496b3a745776ac792126758e55a9b8e69bc8c6624ced"}
Jul 06 12:28:29.737665 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.737627    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f" podStartSLOduration=1.9345379679999999 podStartE2EDuration="5.737614715s" totalImagesPullingTime="3.803076747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:29.730628736 +0000 UTC m=+356.470820069" watchObservedRunningTime="2026-07-06 12:28:29.737614715 +0000 UTC m=+356.477806047"
Jul 06 12:28:29.768247 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.768201    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9" podStartSLOduration=1.919266183 podStartE2EDuration="5.768183253s" totalImagesPullingTime="3.84891707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:29.766438654 +0000 UTC m=+356.506629998" watchObservedRunningTime="2026-07-06 12:28:29.768183253 +0000 UTC m=+356.508374588"
Jul 06 12:28:29.801973 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:29.801929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d7ff6d984-7lgkt" podStartSLOduration=2.304916507 podStartE2EDuration="6.801915429s" totalImagesPullingTime="4.496998922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:29.800927512 +0000 UTC m=+356.541118845" watchObservedRunningTime="2026-07-06 12:28:29.801915429 +0000 UTC m=+356.542106761"
Jul 06 12:28:31.780376 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:31.779679    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:28:31.780376 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:31.779773    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 12:28:32.725850 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:32.725811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn" event={"ID":"2111cdc2-dbf3-47e9-bdae-bbe7eab033ed","Type":"ContainerStarted","Data":"ac71140696a126b050b51c83f8e21c46b75e2859032bb6a283cadce1baa0bc60"}
Jul 06 12:28:32.726031 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:32.726006    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:28:32.727580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:32.727550    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-5jkqn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 12:28:32.727706 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:32.727608    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn" podUID="2111cdc2-dbf3-47e9-bdae-bbe7eab033ed" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:28:32.769642 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:32.769587    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn" podStartSLOduration=2.797617898 podStartE2EDuration="7.769570556s" totalImagesPullingTime="4.971952658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:28:32.76913733 +0000 UTC m=+359.509328686" watchObservedRunningTime="2026-07-06 12:28:32.769570556 +0000 UTC m=+359.509761889"
Jul 06 12:28:33.732464 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:28:33.732433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5jkqn"
Jul 06 12:29:00.717328 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:00.717295    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpm7f"
Jul 06 12:29:00.719841 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:00.719816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klpq9"
Jul 06 12:29:29.428963 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.428931    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"]
Jul 06 12:29:29.431614 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.431596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.435371 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.435350    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 12:29:29.435675 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.435658    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 12:29:29.436598 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.436582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v82jm\""
Jul 06 12:29:29.447715 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.447692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"]
Jul 06 12:29:29.563193 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.563168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ncc\" (UniqueName: \"kubernetes.io/projected/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-kube-api-access-42ncc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.563316 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.563212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.563316 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.563232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.664092 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.664065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ncc\" (UniqueName: \"kubernetes.io/projected/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-kube-api-access-42ncc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.664208 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.664120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.664208 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.664150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.664566 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.664522    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.664652 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.664593    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.674778 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.674751    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ncc\" (UniqueName: \"kubernetes.io/projected/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-kube-api-access-42ncc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.741610 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.741559    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:29.877261 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.877234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"]
Jul 06 12:29:29.879887 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:29:29.879861    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e967cc6_f6f1_47b2_8f07_adf3dcb4e766.slice/crio-0c145ea62ce4b54dca1e184ef463a1eebd643beaac837286a611612cf8a3af23 WatchSource:0}: Error finding container 0c145ea62ce4b54dca1e184ef463a1eebd643beaac837286a611612cf8a3af23: Status 404 returned error can't find the container with id 0c145ea62ce4b54dca1e184ef463a1eebd643beaac837286a611612cf8a3af23
Jul 06 12:29:29.998393 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.998331    2565 generic.go:356] "Generic (PLEG): container finished" podID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerID="aad71516df4f0c8d059ad57ccab86cbdea54282a30e6081cfc4e82e7b606e7ca" exitCode=0
Jul 06 12:29:29.998508 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.998408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr" event={"ID":"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766","Type":"ContainerDied","Data":"aad71516df4f0c8d059ad57ccab86cbdea54282a30e6081cfc4e82e7b606e7ca"}
Jul 06 12:29:29.998508 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:29.998464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr" event={"ID":"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766","Type":"ContainerStarted","Data":"0c145ea62ce4b54dca1e184ef463a1eebd643beaac837286a611612cf8a3af23"}
Jul 06 12:29:30.036845 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.036824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"]
Jul 06 12:29:30.039224 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.039208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.050195 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.050175    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"]
Jul 06 12:29:30.167748 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.167706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.167893 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.167824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.167893 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.167862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8xbg\" (UniqueName: \"kubernetes.io/projected/c4b8438e-4e45-4a64-bee3-7144fc6189c4-kube-api-access-x8xbg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.268381 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.268314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.268381 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.268354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8xbg\" (UniqueName: \"kubernetes.io/projected/c4b8438e-4e45-4a64-bee3-7144fc6189c4-kube-api-access-x8xbg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.268519 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.268411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.268708 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.268689    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.268812 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.268790    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.278246 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.278225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8xbg\" (UniqueName: \"kubernetes.io/projected/c4b8438e-4e45-4a64-bee3-7144fc6189c4-kube-api-access-x8xbg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.348320 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.348299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:30.454289 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.454260    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"]
Jul 06 12:29:30.457857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.457838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.478338 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.478314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"]
Jul 06 12:29:30.514311 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.514290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"]
Jul 06 12:29:30.516063 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:29:30.516037    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b8438e_4e45_4a64_bee3_7144fc6189c4.slice/crio-7992c4ef543fc266b486b9a8a1fd044218361a46fb25b1ef5134755c6df7464e WatchSource:0}: Error finding container 7992c4ef543fc266b486b9a8a1fd044218361a46fb25b1ef5134755c6df7464e: Status 404 returned error can't find the container with id 7992c4ef543fc266b486b9a8a1fd044218361a46fb25b1ef5134755c6df7464e
Jul 06 12:29:30.570913 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.570892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmjtz\" (UniqueName: \"kubernetes.io/projected/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-kube-api-access-wmjtz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.571002 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.570924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.571002 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.570957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.671462 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.671433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjtz\" (UniqueName: \"kubernetes.io/projected/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-kube-api-access-wmjtz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.671597 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.671469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.671597 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.671513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.671884 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.671864    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.671884 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.671875    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.680736 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.680711    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjtz\" (UniqueName: \"kubernetes.io/projected/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-kube-api-access-wmjtz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.768596 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.768569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:30.821906 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.821752    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"]
Jul 06 12:29:30.838498 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.838158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:30.839376 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.839349    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"]
Jul 06 12:29:30.915395 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.915368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"]
Jul 06 12:29:30.958312 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:29:30.958276    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a6d9f5_cd03_4a79_bd1c_a902fd30178b.slice/crio-49825bb7f43a0badddfb8d9ccc0bec7c607291c7d23654f34943e33a3afb38b5 WatchSource:0}: Error finding container 49825bb7f43a0badddfb8d9ccc0bec7c607291c7d23654f34943e33a3afb38b5: Status 404 returned error can't find the container with id 49825bb7f43a0badddfb8d9ccc0bec7c607291c7d23654f34943e33a3afb38b5
Jul 06 12:29:30.974762 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.974736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:30.974849 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.974773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr8ws\" (UniqueName: \"kubernetes.io/projected/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-kube-api-access-tr8ws\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:30.974889 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:30.974838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.005361 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.005335    2565 generic.go:356] "Generic (PLEG): container finished" podID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerID="edaad80db4ac90895efa8a5b329ec6d94e3e392bbd7d89e0304f69e65f348715" exitCode=0
Jul 06 12:29:31.005465 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.005412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr" event={"ID":"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766","Type":"ContainerDied","Data":"edaad80db4ac90895efa8a5b329ec6d94e3e392bbd7d89e0304f69e65f348715"}
Jul 06 12:29:31.006986 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.006933    2565 generic.go:356] "Generic (PLEG): container finished" podID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerID="5248b3f8ae82568c5bb62903364a78e8a77b280eaa606853a545cf95e1805c2f" exitCode=0
Jul 06 12:29:31.006986 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.006964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h" event={"ID":"c4b8438e-4e45-4a64-bee3-7144fc6189c4","Type":"ContainerDied","Data":"5248b3f8ae82568c5bb62903364a78e8a77b280eaa606853a545cf95e1805c2f"}
Jul 06 12:29:31.007126 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.007010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h" event={"ID":"c4b8438e-4e45-4a64-bee3-7144fc6189c4","Type":"ContainerStarted","Data":"7992c4ef543fc266b486b9a8a1fd044218361a46fb25b1ef5134755c6df7464e"}
Jul 06 12:29:31.008310 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.008281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht" event={"ID":"94a6d9f5-cd03-4a79-bd1c-a902fd30178b","Type":"ContainerStarted","Data":"49825bb7f43a0badddfb8d9ccc0bec7c607291c7d23654f34943e33a3afb38b5"}
Jul 06 12:29:31.075573 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.075523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.075709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.075589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr8ws\" (UniqueName: \"kubernetes.io/projected/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-kube-api-access-tr8ws\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.075709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.075624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.075981 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.075961    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.076053 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.075959    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.084016 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.083996    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr8ws\" (UniqueName: \"kubernetes.io/projected/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-kube-api-access-tr8ws\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.164923 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.164899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:31.297987 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:31.297920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"]
Jul 06 12:29:31.301049 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:29:31.301023    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b04d2ff_2155_4f59_905e_9d1d7fbd877b.slice/crio-6fba52504890eadec3cb666acb5d67a7c24d9de2db36b78a2de1bd1d0a620fcd WatchSource:0}: Error finding container 6fba52504890eadec3cb666acb5d67a7c24d9de2db36b78a2de1bd1d0a620fcd: Status 404 returned error can't find the container with id 6fba52504890eadec3cb666acb5d67a7c24d9de2db36b78a2de1bd1d0a620fcd
Jul 06 12:29:32.015111 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.015035    2565 generic.go:356] "Generic (PLEG): container finished" podID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerID="f78252f100538d919fa8b6266b56451ed87e61cb0554b31ba17a20c6a8eb70ad" exitCode=0
Jul 06 12:29:32.015468 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.015114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr" event={"ID":"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766","Type":"ContainerDied","Data":"f78252f100538d919fa8b6266b56451ed87e61cb0554b31ba17a20c6a8eb70ad"}
Jul 06 12:29:32.016816 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.016796    2565 generic.go:356] "Generic (PLEG): container finished" podID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerID="ad66714084ebc3c5b5c011b05a2d39296f231e4cb5f8d1854f50e2c66542d817" exitCode=0
Jul 06 12:29:32.016933 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.016885    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h" event={"ID":"c4b8438e-4e45-4a64-bee3-7144fc6189c4","Type":"ContainerDied","Data":"ad66714084ebc3c5b5c011b05a2d39296f231e4cb5f8d1854f50e2c66542d817"}
Jul 06 12:29:32.018577 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.018556    2565 generic.go:356] "Generic (PLEG): container finished" podID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerID="5effc47bbf8f533ae08ded0f9d63451c57c9929d2796a3a28938e29322906cb4" exitCode=0
Jul 06 12:29:32.018709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.018686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht" event={"ID":"94a6d9f5-cd03-4a79-bd1c-a902fd30178b","Type":"ContainerDied","Data":"5effc47bbf8f533ae08ded0f9d63451c57c9929d2796a3a28938e29322906cb4"}
Jul 06 12:29:32.020314 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.020291    2565 generic.go:356] "Generic (PLEG): container finished" podID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerID="7bdb21e47333c0684ba2a830f2a030e225a4de1fb9718d4219fde8470395720f" exitCode=0
Jul 06 12:29:32.020404 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.020325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l" event={"ID":"1b04d2ff-2155-4f59-905e-9d1d7fbd877b","Type":"ContainerDied","Data":"7bdb21e47333c0684ba2a830f2a030e225a4de1fb9718d4219fde8470395720f"}
Jul 06 12:29:32.020404 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:32.020367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l" event={"ID":"1b04d2ff-2155-4f59-905e-9d1d7fbd877b","Type":"ContainerStarted","Data":"6fba52504890eadec3cb666acb5d67a7c24d9de2db36b78a2de1bd1d0a620fcd"}
Jul 06 12:29:33.027430 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.027404    2565 generic.go:356] "Generic (PLEG): container finished" podID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerID="a9314ecb71a67f095da296d55cb56c31bd2ea7d567178f8a4b2662f901cf9fb9" exitCode=0
Jul 06 12:29:33.027748 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.027485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l" event={"ID":"1b04d2ff-2155-4f59-905e-9d1d7fbd877b","Type":"ContainerDied","Data":"a9314ecb71a67f095da296d55cb56c31bd2ea7d567178f8a4b2662f901cf9fb9"}
Jul 06 12:29:33.029742 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.029720    2565 generic.go:356] "Generic (PLEG): container finished" podID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerID="c96e9397aa1cd02d5a50014c80efd90c1ddce3fd4a4c6dbc069787c67c9319f3" exitCode=0
Jul 06 12:29:33.029887 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.029810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h" event={"ID":"c4b8438e-4e45-4a64-bee3-7144fc6189c4","Type":"ContainerDied","Data":"c96e9397aa1cd02d5a50014c80efd90c1ddce3fd4a4c6dbc069787c67c9319f3"}
Jul 06 12:29:33.031674 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.031647    2565 generic.go:356] "Generic (PLEG): container finished" podID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerID="78e29b3e23206e062970602d0c145ee579159904461cfa001d895b0ece2992fa" exitCode=0
Jul 06 12:29:33.031789 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.031687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht" event={"ID":"94a6d9f5-cd03-4a79-bd1c-a902fd30178b","Type":"ContainerDied","Data":"78e29b3e23206e062970602d0c145ee579159904461cfa001d895b0ece2992fa"}
Jul 06 12:29:33.168623 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.168596    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:33.296868 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.296846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42ncc\" (UniqueName: \"kubernetes.io/projected/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-kube-api-access-42ncc\") pod \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") "
Jul 06 12:29:33.296977 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.296877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-util\") pod \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") "
Jul 06 12:29:33.296977 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.296914    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-bundle\") pod \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\" (UID: \"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766\") "
Jul 06 12:29:33.297414 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.297389    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-bundle" (OuterVolumeSpecName: "bundle") pod "4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" (UID: "4e967cc6-f6f1-47b2-8f07-adf3dcb4e766"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:33.298969 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.298945    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-kube-api-access-42ncc" (OuterVolumeSpecName: "kube-api-access-42ncc") pod "4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" (UID: "4e967cc6-f6f1-47b2-8f07-adf3dcb4e766"). InnerVolumeSpecName "kube-api-access-42ncc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:29:33.302914 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.302893    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-util" (OuterVolumeSpecName: "util") pod "4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" (UID: "4e967cc6-f6f1-47b2-8f07-adf3dcb4e766"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:33.397965 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.397906    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42ncc\" (UniqueName: \"kubernetes.io/projected/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-kube-api-access-42ncc\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:33.397965 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.397927    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-util\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:33.397965 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:33.397936    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e967cc6-f6f1-47b2-8f07-adf3dcb4e766-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:34.038724 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.038690    2565 generic.go:356] "Generic (PLEG): container finished" podID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerID="682233da4258134852db705a0ed8044ecb3082c8e0c43d726b49a68c29e312a6" exitCode=0
Jul 06 12:29:34.039075 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.038781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht" event={"ID":"94a6d9f5-cd03-4a79-bd1c-a902fd30178b","Type":"ContainerDied","Data":"682233da4258134852db705a0ed8044ecb3082c8e0c43d726b49a68c29e312a6"}
Jul 06 12:29:34.040690 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.040667    2565 generic.go:356] "Generic (PLEG): container finished" podID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerID="37ba391da6f5057abaf51e19e431a0f172212db8d3e0cceaad9d6e4617392ac2" exitCode=0
Jul 06 12:29:34.040809 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.040693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l" event={"ID":"1b04d2ff-2155-4f59-905e-9d1d7fbd877b","Type":"ContainerDied","Data":"37ba391da6f5057abaf51e19e431a0f172212db8d3e0cceaad9d6e4617392ac2"}
Jul 06 12:29:34.042515 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.042495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr" event={"ID":"4e967cc6-f6f1-47b2-8f07-adf3dcb4e766","Type":"ContainerDied","Data":"0c145ea62ce4b54dca1e184ef463a1eebd643beaac837286a611612cf8a3af23"}
Jul 06 12:29:34.042606 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.042548    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c145ea62ce4b54dca1e184ef463a1eebd643beaac837286a611612cf8a3af23"
Jul 06 12:29:34.042724 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.042710    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr"
Jul 06 12:29:34.171819 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.171797    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:34.305216 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.305193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8xbg\" (UniqueName: \"kubernetes.io/projected/c4b8438e-4e45-4a64-bee3-7144fc6189c4-kube-api-access-x8xbg\") pod \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") "
Jul 06 12:29:34.305331 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.305228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-bundle\") pod \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") "
Jul 06 12:29:34.305331 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.305297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-util\") pod \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\" (UID: \"c4b8438e-4e45-4a64-bee3-7144fc6189c4\") "
Jul 06 12:29:34.305776 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.305753    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-bundle" (OuterVolumeSpecName: "bundle") pod "c4b8438e-4e45-4a64-bee3-7144fc6189c4" (UID: "c4b8438e-4e45-4a64-bee3-7144fc6189c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:34.307091 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.307064    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b8438e-4e45-4a64-bee3-7144fc6189c4-kube-api-access-x8xbg" (OuterVolumeSpecName: "kube-api-access-x8xbg") pod "c4b8438e-4e45-4a64-bee3-7144fc6189c4" (UID: "c4b8438e-4e45-4a64-bee3-7144fc6189c4"). InnerVolumeSpecName "kube-api-access-x8xbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:29:34.310999 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.310975    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-util" (OuterVolumeSpecName: "util") pod "c4b8438e-4e45-4a64-bee3-7144fc6189c4" (UID: "c4b8438e-4e45-4a64-bee3-7144fc6189c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:34.406609 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.406553    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-util\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:34.406609 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.406577    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8xbg\" (UniqueName: \"kubernetes.io/projected/c4b8438e-4e45-4a64-bee3-7144fc6189c4-kube-api-access-x8xbg\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:34.406609 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:34.406587    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4b8438e-4e45-4a64-bee3-7144fc6189c4-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:35.050206 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.050178    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h"
Jul 06 12:29:35.050206 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.050193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h" event={"ID":"c4b8438e-4e45-4a64-bee3-7144fc6189c4","Type":"ContainerDied","Data":"7992c4ef543fc266b486b9a8a1fd044218361a46fb25b1ef5134755c6df7464e"}
Jul 06 12:29:35.050636 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.050235    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7992c4ef543fc266b486b9a8a1fd044218361a46fb25b1ef5134755c6df7464e"
Jul 06 12:29:35.204448 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.204423    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:35.207005 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.206988    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:35.316921 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.316891    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-util\") pod \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") "
Jul 06 12:29:35.317054 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.316953    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-util\") pod \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") "
Jul 06 12:29:35.317054 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.316969    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-bundle\") pod \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") "
Jul 06 12:29:35.317054 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.317016    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmjtz\" (UniqueName: \"kubernetes.io/projected/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-kube-api-access-wmjtz\") pod \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\" (UID: \"94a6d9f5-cd03-4a79-bd1c-a902fd30178b\") "
Jul 06 12:29:35.317187 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.317058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr8ws\" (UniqueName: \"kubernetes.io/projected/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-kube-api-access-tr8ws\") pod \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") "
Jul 06 12:29:35.317187 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.317090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-bundle\") pod \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\" (UID: \"1b04d2ff-2155-4f59-905e-9d1d7fbd877b\") "
Jul 06 12:29:35.317627 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.317520    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-bundle" (OuterVolumeSpecName: "bundle") pod "94a6d9f5-cd03-4a79-bd1c-a902fd30178b" (UID: "94a6d9f5-cd03-4a79-bd1c-a902fd30178b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:35.317809 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.317790    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-bundle" (OuterVolumeSpecName: "bundle") pod "1b04d2ff-2155-4f59-905e-9d1d7fbd877b" (UID: "1b04d2ff-2155-4f59-905e-9d1d7fbd877b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:35.319555 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.319498    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-kube-api-access-wmjtz" (OuterVolumeSpecName: "kube-api-access-wmjtz") pod "94a6d9f5-cd03-4a79-bd1c-a902fd30178b" (UID: "94a6d9f5-cd03-4a79-bd1c-a902fd30178b"). InnerVolumeSpecName "kube-api-access-wmjtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:29:35.319555 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.319504    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-kube-api-access-tr8ws" (OuterVolumeSpecName: "kube-api-access-tr8ws") pod "1b04d2ff-2155-4f59-905e-9d1d7fbd877b" (UID: "1b04d2ff-2155-4f59-905e-9d1d7fbd877b"). InnerVolumeSpecName "kube-api-access-tr8ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:29:35.323539 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.323498    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-util" (OuterVolumeSpecName: "util") pod "1b04d2ff-2155-4f59-905e-9d1d7fbd877b" (UID: "1b04d2ff-2155-4f59-905e-9d1d7fbd877b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:35.323774 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.323754    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-util" (OuterVolumeSpecName: "util") pod "94a6d9f5-cd03-4a79-bd1c-a902fd30178b" (UID: "94a6d9f5-cd03-4a79-bd1c-a902fd30178b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:29:35.417868 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.417845    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-util\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:35.417868 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.417865    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-util\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:35.417868 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.417874    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:35.418039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.417883    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmjtz\" (UniqueName: \"kubernetes.io/projected/94a6d9f5-cd03-4a79-bd1c-a902fd30178b-kube-api-access-wmjtz\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:35.418039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.417893    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr8ws\" (UniqueName: \"kubernetes.io/projected/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-kube-api-access-tr8ws\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:35.418039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:35.417901    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b04d2ff-2155-4f59-905e-9d1d7fbd877b-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:29:36.057654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:36.057626    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht"
Jul 06 12:29:36.058033 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:36.057630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht" event={"ID":"94a6d9f5-cd03-4a79-bd1c-a902fd30178b","Type":"ContainerDied","Data":"49825bb7f43a0badddfb8d9ccc0bec7c607291c7d23654f34943e33a3afb38b5"}
Jul 06 12:29:36.058033 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:36.057749    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49825bb7f43a0badddfb8d9ccc0bec7c607291c7d23654f34943e33a3afb38b5"
Jul 06 12:29:36.059943 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:36.059920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l" event={"ID":"1b04d2ff-2155-4f59-905e-9d1d7fbd877b","Type":"ContainerDied","Data":"6fba52504890eadec3cb666acb5d67a7c24d9de2db36b78a2de1bd1d0a620fcd"}
Jul 06 12:29:36.060072 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:36.059960    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fba52504890eadec3cb666acb5d67a7c24d9de2db36b78a2de1bd1d0a620fcd"
Jul 06 12:29:36.060072 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:36.059979    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l"
Jul 06 12:29:51.208870 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.208836    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"]
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209174    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209185    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209196    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209201    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209209    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerName="util"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209215    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerName="util"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209220    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerName="util"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209225    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerName="util"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209231    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209236    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209247    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209252    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209258    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerName="util"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209262    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerName="util"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209268    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209274    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209281    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209286    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209292    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209296    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerName="extract"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209307    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209312    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerName="pull"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209321    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerName="util"
Jul 06 12:29:51.209335 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209326    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerName="util"
Jul 06 12:29:51.210171 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209376    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b04d2ff-2155-4f59-905e-9d1d7fbd877b" containerName="extract"
Jul 06 12:29:51.210171 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209383    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b8438e-4e45-4a64-bee3-7144fc6189c4" containerName="extract"
Jul 06 12:29:51.210171 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209390    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e967cc6-f6f1-47b2-8f07-adf3dcb4e766" containerName="extract"
Jul 06 12:29:51.210171 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.209396    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a6d9f5-cd03-4a79-bd1c-a902fd30178b" containerName="extract"
Jul 06 12:29:51.213817 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.213801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.216292 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.216266    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 12:29:51.216443 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.216424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-drd6q\""
Jul 06 12:29:51.216518 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.216500    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 12:29:51.226616 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.226593    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"]
Jul 06 12:29:51.247420 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.247389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7k9\" (UniqueName: \"kubernetes.io/projected/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-kube-api-access-nx7k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.247555 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.247458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.348523 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.348489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7k9\" (UniqueName: \"kubernetes.io/projected/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-kube-api-access-nx7k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.348681 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.348653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.348984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.348967    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.356906 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.356881    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7k9\" (UniqueName: \"kubernetes.io/projected/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-kube-api-access-nx7k9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.524002 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.523944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:51.663944 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:51.663919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"]
Jul 06 12:29:51.666496 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:29:51.666474    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6833b0f_0b18_4bba_b0b9_4e4f519014a8.slice/crio-c000f5a1604715fcfa661f6802b4e07ee8d98a77557d64eacfdf6bdc0131be57 WatchSource:0}: Error finding container c000f5a1604715fcfa661f6802b4e07ee8d98a77557d64eacfdf6bdc0131be57: Status 404 returned error can't find the container with id c000f5a1604715fcfa661f6802b4e07ee8d98a77557d64eacfdf6bdc0131be57
Jul 06 12:29:52.144019 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:52.143981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68" event={"ID":"e6833b0f-0b18-4bba-b0b9-4e4f519014a8","Type":"ContainerStarted","Data":"c000f5a1604715fcfa661f6802b4e07ee8d98a77557d64eacfdf6bdc0131be57"}
Jul 06 12:29:55.699477 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:55.699440    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"]
Jul 06 12:29:55.703146 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:55.703118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:29:55.706309 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:55.706282    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8h7jk\""
Jul 06 12:29:55.723226 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:55.723192    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"]
Jul 06 12:29:55.784105 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:55.784077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdj44\" (UniqueName: \"kubernetes.io/projected/e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e-kube-api-access-tdj44\") pod \"limitador-operator-controller-manager-859d7b78bd-n596h\" (UID: \"e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:29:55.884815 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:55.884781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdj44\" (UniqueName: \"kubernetes.io/projected/e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e-kube-api-access-tdj44\") pod \"limitador-operator-controller-manager-859d7b78bd-n596h\" (UID: \"e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:29:55.905440 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:55.905413    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdj44\" (UniqueName: \"kubernetes.io/projected/e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e-kube-api-access-tdj44\") pod \"limitador-operator-controller-manager-859d7b78bd-n596h\" (UID: \"e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:29:56.014699 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:56.014629    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:29:56.173571 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:56.173518    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"]
Jul 06 12:29:56.176076 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:29:56.176045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode195f8dd_3b32_4ac2_a7ae_f0351f4bb48e.slice/crio-4ea6c852b3363d762ae3fe4ca1b30db0756776402b54c89699925064af5b1c53 WatchSource:0}: Error finding container 4ea6c852b3363d762ae3fe4ca1b30db0756776402b54c89699925064af5b1c53: Status 404 returned error can't find the container with id 4ea6c852b3363d762ae3fe4ca1b30db0756776402b54c89699925064af5b1c53
Jul 06 12:29:57.171613 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:57.171566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h" event={"ID":"e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e","Type":"ContainerStarted","Data":"4ea6c852b3363d762ae3fe4ca1b30db0756776402b54c89699925064af5b1c53"}
Jul 06 12:29:58.179109 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:58.179080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68" event={"ID":"e6833b0f-0b18-4bba-b0b9-4e4f519014a8","Type":"ContainerStarted","Data":"0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e"}
Jul 06 12:29:58.179392 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:58.179144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:29:58.270234 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:58.270183    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68" podStartSLOduration=0.996644094 podStartE2EDuration="7.270164339s" totalImagesPullingTime="6.273520245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:29:58.269199197 +0000 UTC m=+445.009390537" watchObservedRunningTime="2026-07-06 12:29:58.270164339 +0000 UTC m=+445.010355682"
Jul 06 12:29:59.186129 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:59.186093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h" event={"ID":"e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e","Type":"ContainerStarted","Data":"21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b"}
Jul 06 12:29:59.186615 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:59.186308    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:29:59.217911 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:29:59.217864    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h" podStartSLOduration=1.64939071 podStartE2EDuration="4.217850243s" totalImagesPullingTime="2.568459533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:29:59.216559225 +0000 UTC m=+445.956750557" watchObservedRunningTime="2026-07-06 12:29:59.217850243 +0000 UTC m=+445.958041576"
Jul 06 12:30:09.187991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:09.187957    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:10.193727 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:10.193695    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:11.154787 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.154748    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"]
Jul 06 12:30:11.154970 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.154914    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" containerName="manager" containerID="cri-o://0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e" gracePeriod=2
Jul 06 12:30:11.164885 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.164858    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"]
Jul 06 12:30:11.168146 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.168105    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-8pr68\": pods \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:11.186524 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.186494    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"]
Jul 06 12:30:11.186754 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.186730    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" containerName="manager" containerID="cri-o://21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b" gracePeriod=2
Jul 06 12:30:11.190079 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.189689    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:11.193571 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.193513    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"]
Jul 06 12:30:11.193994 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.193972    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" containerName="manager"
Jul 06 12:30:11.193994 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.193995    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" containerName="manager"
Jul 06 12:30:11.194387 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.194130    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" containerName="manager"
Jul 06 12:30:11.194387 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.194260    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n596h\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:11.199161 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.199139    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"]
Jul 06 12:30:11.199263 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.199226    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.201516 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.201491    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:11.204853 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.204829    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n596h\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:11.222077 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.222045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"]
Jul 06 12:30:11.236023 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.236001    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"]
Jul 06 12:30:11.236520 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.236501    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" containerName="manager"
Jul 06 12:30:11.236632 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.236543    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" containerName="manager"
Jul 06 12:30:11.236700 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.236686    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" containerName="manager"
Jul 06 12:30:11.240050 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.240033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"
Jul 06 12:30:11.250662 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.250633    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n596h\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:11.252812 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.252788    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:11.263117 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.263093    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"]
Jul 06 12:30:11.310692 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.310659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qxh\" (UniqueName: \"kubernetes.io/projected/9d288870-3c55-42c8-9b6e-9c6f252d077a-kube-api-access-97qxh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjcnv\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.310814 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.310736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d288870-3c55-42c8-9b6e-9c6f252d077a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjcnv\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.310814 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.310765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b482r\" (UniqueName: \"kubernetes.io/projected/5a6cce54-16a4-46ee-831a-be69e961e98e-kube-api-access-b482r\") pod \"limitador-operator-controller-manager-859d7b78bd-v8dw2\" (UID: \"5a6cce54-16a4-46ee-831a-be69e961e98e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"
Jul 06 12:30:11.411630 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.411605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qxh\" (UniqueName: \"kubernetes.io/projected/9d288870-3c55-42c8-9b6e-9c6f252d077a-kube-api-access-97qxh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjcnv\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.411723 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.411671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d288870-3c55-42c8-9b6e-9c6f252d077a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjcnv\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.411723 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.411698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b482r\" (UniqueName: \"kubernetes.io/projected/5a6cce54-16a4-46ee-831a-be69e961e98e-kube-api-access-b482r\") pod \"limitador-operator-controller-manager-859d7b78bd-v8dw2\" (UID: \"5a6cce54-16a4-46ee-831a-be69e961e98e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"
Jul 06 12:30:11.412074 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.412052    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d288870-3c55-42c8-9b6e-9c6f252d077a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjcnv\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.425403 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.425381    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b482r\" (UniqueName: \"kubernetes.io/projected/5a6cce54-16a4-46ee-831a-be69e961e98e-kube-api-access-b482r\") pod \"limitador-operator-controller-manager-859d7b78bd-v8dw2\" (UID: \"5a6cce54-16a4-46ee-831a-be69e961e98e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"
Jul 06 12:30:11.425915 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.425893    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qxh\" (UniqueName: \"kubernetes.io/projected/9d288870-3c55-42c8-9b6e-9c6f252d077a-kube-api-access-97qxh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjcnv\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.433680 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.433664    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:11.435801 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.435777    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:11.436396 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.436380    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:11.438987 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.438962    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n596h\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:11.440827 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.440807    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8pr68\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:11.442789 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:11.442770    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n596h\" is forbidden: User \"system:node:ip-10-0-138-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-192.ec2.internal' and this object" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:11.512683 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.512661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdj44\" (UniqueName: \"kubernetes.io/projected/e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e-kube-api-access-tdj44\") pod \"e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e\" (UID: \"e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e\") "
Jul 06 12:30:11.512776 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.512700    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx7k9\" (UniqueName: \"kubernetes.io/projected/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-kube-api-access-nx7k9\") pod \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") "
Jul 06 12:30:11.512776 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.512749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-extensions-socket-volume\") pod \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\" (UID: \"e6833b0f-0b18-4bba-b0b9-4e4f519014a8\") "
Jul 06 12:30:11.513308 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.513281    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e6833b0f-0b18-4bba-b0b9-4e4f519014a8" (UID: "e6833b0f-0b18-4bba-b0b9-4e4f519014a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:30:11.514714 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.514688    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e-kube-api-access-tdj44" (OuterVolumeSpecName: "kube-api-access-tdj44") pod "e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" (UID: "e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e"). InnerVolumeSpecName "kube-api-access-tdj44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:30:11.514791 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.514726    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-kube-api-access-nx7k9" (OuterVolumeSpecName: "kube-api-access-nx7k9") pod "e6833b0f-0b18-4bba-b0b9-4e4f519014a8" (UID: "e6833b0f-0b18-4bba-b0b9-4e4f519014a8"). InnerVolumeSpecName "kube-api-access-nx7k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:30:11.570438 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.570419    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:11.577431 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.577412    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"
Jul 06 12:30:11.614712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.614677    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdj44\" (UniqueName: \"kubernetes.io/projected/e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e-kube-api-access-tdj44\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:30:11.614712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.614713    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx7k9\" (UniqueName: \"kubernetes.io/projected/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-kube-api-access-nx7k9\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:30:11.614886 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.614731    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6833b0f-0b18-4bba-b0b9-4e4f519014a8-extensions-socket-volume\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:30:11.723127 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.723097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"]
Jul 06 12:30:11.726246 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:30:11.726213    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d288870_3c55_42c8_9b6e_9c6f252d077a.slice/crio-4a87f4692c6c138dbb0f35cf4ca6a27e9a0f215b78f3bf25242aab66f34b8693 WatchSource:0}: Error finding container 4a87f4692c6c138dbb0f35cf4ca6a27e9a0f215b78f3bf25242aab66f34b8693: Status 404 returned error can't find the container with id 4a87f4692c6c138dbb0f35cf4ca6a27e9a0f215b78f3bf25242aab66f34b8693
Jul 06 12:30:11.741540 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.741499    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"]
Jul 06 12:30:11.742939 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:30:11.742918    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6cce54_16a4_46ee_831a_be69e961e98e.slice/crio-b21ed64fa652d9e057be0404d1c3dfcc28ca187112f53d5754c9f60663aea003 WatchSource:0}: Error finding container b21ed64fa652d9e057be0404d1c3dfcc28ca187112f53d5754c9f60663aea003: Status 404 returned error can't find the container with id b21ed64fa652d9e057be0404d1c3dfcc28ca187112f53d5754c9f60663aea003
Jul 06 12:30:11.885189 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.885163    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" path="/var/lib/kubelet/pods/e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e/volumes"
Jul 06 12:30:11.885505 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:11.885493    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" path="/var/lib/kubelet/pods/e6833b0f-0b18-4bba-b0b9-4e4f519014a8/volumes"
Jul 06 12:30:12.259193 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.259165    2565 generic.go:356] "Generic (PLEG): container finished" podID="e6833b0f-0b18-4bba-b0b9-4e4f519014a8" containerID="0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e" exitCode=0
Jul 06 12:30:12.259635 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.259219    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8pr68"
Jul 06 12:30:12.259635 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.259266    2565 scope.go:117] "RemoveContainer" containerID="0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e"
Jul 06 12:30:12.262888 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.262852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2" event={"ID":"5a6cce54-16a4-46ee-831a-be69e961e98e","Type":"ContainerStarted","Data":"ec0ae516ee77cbc5deea5a8a966868dd1746730c7dcbc56c4e303cae1d884a53"}
Jul 06 12:30:12.263001 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.262938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2" event={"ID":"5a6cce54-16a4-46ee-831a-be69e961e98e","Type":"ContainerStarted","Data":"b21ed64fa652d9e057be0404d1c3dfcc28ca187112f53d5754c9f60663aea003"}
Jul 06 12:30:12.263178 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.263159    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"
Jul 06 12:30:12.264817 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.264795    2565 generic.go:356] "Generic (PLEG): container finished" podID="e195f8dd-3b32-4ac2-a7ae-f0351f4bb48e" containerID="21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b" exitCode=0
Jul 06 12:30:12.264959 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.264923    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n596h"
Jul 06 12:30:12.266857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.266837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv" event={"ID":"9d288870-3c55-42c8-9b6e-9c6f252d077a","Type":"ContainerStarted","Data":"7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e"}
Jul 06 12:30:12.266984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.266964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv" event={"ID":"9d288870-3c55-42c8-9b6e-9c6f252d077a","Type":"ContainerStarted","Data":"4a87f4692c6c138dbb0f35cf4ca6a27e9a0f215b78f3bf25242aab66f34b8693"}
Jul 06 12:30:12.267056 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.267004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:12.272374 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.270847    2565 scope.go:117] "RemoveContainer" containerID="0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e"
Jul 06 12:30:12.272637 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:12.272615    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e\": container with ID starting with 0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e not found: ID does not exist" containerID="0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e"
Jul 06 12:30:12.272704 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.272647    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e"} err="failed to get container status \"0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e\": rpc error: code = NotFound desc = could not find container \"0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e\": container with ID starting with 0bfcf85d83e7ca29191271fe47332c20999deefd8a8c597fb9801dc8e41b077e not found: ID does not exist"
Jul 06 12:30:12.272704 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.272687    2565 scope.go:117] "RemoveContainer" containerID="21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b"
Jul 06 12:30:12.280871 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.280855    2565 scope.go:117] "RemoveContainer" containerID="21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b"
Jul 06 12:30:12.281136 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:12.281117    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b\": container with ID starting with 21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b not found: ID does not exist" containerID="21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b"
Jul 06 12:30:12.281201 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.281147    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b"} err="failed to get container status \"21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b\": rpc error: code = NotFound desc = could not find container \"21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b\": container with ID starting with 21af0ff0c7a245a79bc5f35dcbde68d11f137fb0772532fb8e797ee9e3bd1f6b not found: ID does not exist"
Jul 06 12:30:12.289764 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.289727    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2" podStartSLOduration=1.289716222 podStartE2EDuration="1.289716222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:12.287926849 +0000 UTC m=+459.028118195" watchObservedRunningTime="2026-07-06 12:30:12.289716222 +0000 UTC m=+459.029907555"
Jul 06 12:30:12.325638 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:12.325595    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv" podStartSLOduration=1.325583123 podStartE2EDuration="1.325583123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:12.32423965 +0000 UTC m=+459.064430983" watchObservedRunningTime="2026-07-06 12:30:12.325583123 +0000 UTC m=+459.065774455"
Jul 06 12:30:23.276402 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:23.276371    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8dw2"
Jul 06 12:30:23.276848 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:23.276583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:27.904229 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:27.904195    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"]
Jul 06 12:30:27.904648 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:27.904380    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv" podUID="9d288870-3c55-42c8-9b6e-9c6f252d077a" containerName="manager" containerID="cri-o://7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e" gracePeriod=10
Jul 06 12:30:28.195797 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.195773    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:28.351557 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.351510    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d288870-3c55-42c8-9b6e-9c6f252d077a" containerID="7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e" exitCode=0
Jul 06 12:30:28.351709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.351571    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"
Jul 06 12:30:28.351709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.351596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv" event={"ID":"9d288870-3c55-42c8-9b6e-9c6f252d077a","Type":"ContainerDied","Data":"7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e"}
Jul 06 12:30:28.351709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.351645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv" event={"ID":"9d288870-3c55-42c8-9b6e-9c6f252d077a","Type":"ContainerDied","Data":"4a87f4692c6c138dbb0f35cf4ca6a27e9a0f215b78f3bf25242aab66f34b8693"}
Jul 06 12:30:28.351709 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.351669    2565 scope.go:117] "RemoveContainer" containerID="7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e"
Jul 06 12:30:28.353712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.353695    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97qxh\" (UniqueName: \"kubernetes.io/projected/9d288870-3c55-42c8-9b6e-9c6f252d077a-kube-api-access-97qxh\") pod \"9d288870-3c55-42c8-9b6e-9c6f252d077a\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") "
Jul 06 12:30:28.353804 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.353787    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d288870-3c55-42c8-9b6e-9c6f252d077a-extensions-socket-volume\") pod \"9d288870-3c55-42c8-9b6e-9c6f252d077a\" (UID: \"9d288870-3c55-42c8-9b6e-9c6f252d077a\") "
Jul 06 12:30:28.354129 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.354109    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d288870-3c55-42c8-9b6e-9c6f252d077a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9d288870-3c55-42c8-9b6e-9c6f252d077a" (UID: "9d288870-3c55-42c8-9b6e-9c6f252d077a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:30:28.355850 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.355827    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d288870-3c55-42c8-9b6e-9c6f252d077a-kube-api-access-97qxh" (OuterVolumeSpecName: "kube-api-access-97qxh") pod "9d288870-3c55-42c8-9b6e-9c6f252d077a" (UID: "9d288870-3c55-42c8-9b6e-9c6f252d077a"). InnerVolumeSpecName "kube-api-access-97qxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:30:28.366899 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.366884    2565 scope.go:117] "RemoveContainer" containerID="7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e"
Jul 06 12:30:28.367197 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:30:28.367168    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e\": container with ID starting with 7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e not found: ID does not exist" containerID="7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e"
Jul 06 12:30:28.367249 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.367198    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e"} err="failed to get container status \"7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e\": rpc error: code = NotFound desc = could not find container \"7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e\": container with ID starting with 7dbcec6ad41ec080a6c667a86b13b1eecb805dcd29ca8b1572c6655acd0f589e not found: ID does not exist"
Jul 06 12:30:28.454911 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.454865    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d288870-3c55-42c8-9b6e-9c6f252d077a-extensions-socket-volume\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:30:28.454911 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.454884    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97qxh\" (UniqueName: \"kubernetes.io/projected/9d288870-3c55-42c8-9b6e-9c6f252d077a-kube-api-access-97qxh\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:30:28.701737 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.701654    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"]
Jul 06 12:30:28.709027 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:28.708964    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjcnv"]
Jul 06 12:30:29.884541 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:29.884492    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d288870-3c55-42c8-9b6e-9c6f252d077a" path="/var/lib/kubelet/pods/9d288870-3c55-42c8-9b6e-9c6f252d077a/volumes"
Jul 06 12:30:47.105060 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.105025    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"]
Jul 06 12:30:47.106225 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.106200    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d288870-3c55-42c8-9b6e-9c6f252d077a" containerName="manager"
Jul 06 12:30:47.106365 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.106354    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d288870-3c55-42c8-9b6e-9c6f252d077a" containerName="manager"
Jul 06 12:30:47.106563 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.106548    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d288870-3c55-42c8-9b6e-9c6f252d077a" containerName="manager"
Jul 06 12:30:47.110127 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.110105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.116550 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.113438    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v82jm\""
Jul 06 12:30:47.118900 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.118864    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 12:30:47.136121 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.136097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"]
Jul 06 12:30:47.215476 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.215439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"]
Jul 06 12:30:47.298509 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.298480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e95cd70c-2b1b-445f-828f-29474fff6da4-config-file\") pod \"limitador-limitador-64c94fd64f-qtmjj\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.298659 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.298549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5ksx\" (UniqueName: \"kubernetes.io/projected/e95cd70c-2b1b-445f-828f-29474fff6da4-kube-api-access-j5ksx\") pod \"limitador-limitador-64c94fd64f-qtmjj\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.399770 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.399690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e95cd70c-2b1b-445f-828f-29474fff6da4-config-file\") pod \"limitador-limitador-64c94fd64f-qtmjj\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.399770 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.399746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5ksx\" (UniqueName: \"kubernetes.io/projected/e95cd70c-2b1b-445f-828f-29474fff6da4-kube-api-access-j5ksx\") pod \"limitador-limitador-64c94fd64f-qtmjj\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.400318 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.400296    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e95cd70c-2b1b-445f-828f-29474fff6da4-config-file\") pod \"limitador-limitador-64c94fd64f-qtmjj\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.410891 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.410868    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5ksx\" (UniqueName: \"kubernetes.io/projected/e95cd70c-2b1b-445f-828f-29474fff6da4-kube-api-access-j5ksx\") pod \"limitador-limitador-64c94fd64f-qtmjj\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.428654 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.428633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:47.574869 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:47.574836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"]
Jul 06 12:30:47.578425 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:30:47.578397    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95cd70c_2b1b_445f_828f_29474fff6da4.slice/crio-644c8ff084d59aece35ca637608449528993ac34a90f397072a53fa191d26045 WatchSource:0}: Error finding container 644c8ff084d59aece35ca637608449528993ac34a90f397072a53fa191d26045: Status 404 returned error can't find the container with id 644c8ff084d59aece35ca637608449528993ac34a90f397072a53fa191d26045
Jul 06 12:30:48.460446 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:48.460408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj" event={"ID":"e95cd70c-2b1b-445f-828f-29474fff6da4","Type":"ContainerStarted","Data":"644c8ff084d59aece35ca637608449528993ac34a90f397072a53fa191d26045"}
Jul 06 12:30:50.474740 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:50.474714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj" event={"ID":"e95cd70c-2b1b-445f-828f-29474fff6da4","Type":"ContainerStarted","Data":"4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3"}
Jul 06 12:30:50.475042 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:50.474779    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:30:50.500737 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:30:50.500693    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj" podStartSLOduration=0.699956584 podStartE2EDuration="3.500676959s" totalImagesPullingTime="2.800720375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:30:50.499910905 +0000 UTC m=+497.240102258" watchObservedRunningTime="2026-07-06 12:30:50.500676959 +0000 UTC m=+497.240868291"
Jul 06 12:31:01.479999 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:01.479969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:31:01.921724 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:01.921686    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"]
Jul 06 12:31:01.921932 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:01.921887    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj" podUID="e95cd70c-2b1b-445f-828f-29474fff6da4" containerName="limitador" containerID="cri-o://4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3" gracePeriod=30
Jul 06 12:31:02.465312 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.465289    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:31:02.515390 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.515328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e95cd70c-2b1b-445f-828f-29474fff6da4-config-file\") pod \"e95cd70c-2b1b-445f-828f-29474fff6da4\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") "
Jul 06 12:31:02.515390 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.515370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5ksx\" (UniqueName: \"kubernetes.io/projected/e95cd70c-2b1b-445f-828f-29474fff6da4-kube-api-access-j5ksx\") pod \"e95cd70c-2b1b-445f-828f-29474fff6da4\" (UID: \"e95cd70c-2b1b-445f-828f-29474fff6da4\") "
Jul 06 12:31:02.515836 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.515661    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e95cd70c-2b1b-445f-828f-29474fff6da4-config-file" (OuterVolumeSpecName: "config-file") pod "e95cd70c-2b1b-445f-828f-29474fff6da4" (UID: "e95cd70c-2b1b-445f-828f-29474fff6da4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:31:02.517509 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.517487    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95cd70c-2b1b-445f-828f-29474fff6da4-kube-api-access-j5ksx" (OuterVolumeSpecName: "kube-api-access-j5ksx") pod "e95cd70c-2b1b-445f-828f-29474fff6da4" (UID: "e95cd70c-2b1b-445f-828f-29474fff6da4"). InnerVolumeSpecName "kube-api-access-j5ksx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:31:02.536390 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.536361    2565 generic.go:356] "Generic (PLEG): container finished" podID="e95cd70c-2b1b-445f-828f-29474fff6da4" containerID="4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3" exitCode=0
Jul 06 12:31:02.536492 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.536404    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"
Jul 06 12:31:02.536492 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.536441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj" event={"ID":"e95cd70c-2b1b-445f-828f-29474fff6da4","Type":"ContainerDied","Data":"4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3"}
Jul 06 12:31:02.536617 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.536493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtmjj" event={"ID":"e95cd70c-2b1b-445f-828f-29474fff6da4","Type":"ContainerDied","Data":"644c8ff084d59aece35ca637608449528993ac34a90f397072a53fa191d26045"}
Jul 06 12:31:02.536617 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.536514    2565 scope.go:117] "RemoveContainer" containerID="4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3"
Jul 06 12:31:02.545286 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.545273    2565 scope.go:117] "RemoveContainer" containerID="4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3"
Jul 06 12:31:02.545590 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:31:02.545571    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3\": container with ID starting with 4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3 not found: ID does not exist" containerID="4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3"
Jul 06 12:31:02.545661 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.545605    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3"} err="failed to get container status \"4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3\": rpc error: code = NotFound desc = could not find container \"4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3\": container with ID starting with 4670be16cf54b40b376883e6db9aeb7b35e8c8480df8688929463994e6c396d3 not found: ID does not exist"
Jul 06 12:31:02.575706 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.575687    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"]
Jul 06 12:31:02.581761 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.581735    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtmjj"]
Jul 06 12:31:02.616425 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.616394    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e95cd70c-2b1b-445f-828f-29474fff6da4-config-file\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:31:02.616425 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:02.616421    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5ksx\" (UniqueName: \"kubernetes.io/projected/e95cd70c-2b1b-445f-828f-29474fff6da4-kube-api-access-j5ksx\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:31:03.713621 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.713589    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"]
Jul 06 12:31:03.713966 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.713936    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95cd70c-2b1b-445f-828f-29474fff6da4" containerName="limitador"
Jul 06 12:31:03.713966 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.713947    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95cd70c-2b1b-445f-828f-29474fff6da4" containerName="limitador"
Jul 06 12:31:03.714035 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.714020    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e95cd70c-2b1b-445f-828f-29474fff6da4" containerName="limitador"
Jul 06 12:31:03.718230 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.718214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:03.721695 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.721674    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 06 12:31:03.722448 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.722421    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 06 12:31:03.722673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.722658    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v55sb\""
Jul 06 12:31:03.722887 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.722871    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 06 12:31:03.724877 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.724857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nfd9\" (UniqueName: \"kubernetes.io/projected/e8198f24-b57d-4a78-ada2-2832bcd50a8c-kube-api-access-5nfd9\") pod \"postgres-69fb4594cf-dqgd5\" (UID: \"e8198f24-b57d-4a78-ada2-2832bcd50a8c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:03.724967 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.724947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8198f24-b57d-4a78-ada2-2832bcd50a8c-data\") pod \"postgres-69fb4594cf-dqgd5\" (UID: \"e8198f24-b57d-4a78-ada2-2832bcd50a8c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:03.745928 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.745906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"]
Jul 06 12:31:03.825724 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.825692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nfd9\" (UniqueName: \"kubernetes.io/projected/e8198f24-b57d-4a78-ada2-2832bcd50a8c-kube-api-access-5nfd9\") pod \"postgres-69fb4594cf-dqgd5\" (UID: \"e8198f24-b57d-4a78-ada2-2832bcd50a8c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:03.825724 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.825727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8198f24-b57d-4a78-ada2-2832bcd50a8c-data\") pod \"postgres-69fb4594cf-dqgd5\" (UID: \"e8198f24-b57d-4a78-ada2-2832bcd50a8c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:03.826055 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.826039    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8198f24-b57d-4a78-ada2-2832bcd50a8c-data\") pod \"postgres-69fb4594cf-dqgd5\" (UID: \"e8198f24-b57d-4a78-ada2-2832bcd50a8c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:03.838778 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.838753    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nfd9\" (UniqueName: \"kubernetes.io/projected/e8198f24-b57d-4a78-ada2-2832bcd50a8c-kube-api-access-5nfd9\") pod \"postgres-69fb4594cf-dqgd5\" (UID: \"e8198f24-b57d-4a78-ada2-2832bcd50a8c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:03.884862 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:03.884834    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e95cd70c-2b1b-445f-828f-29474fff6da4" path="/var/lib/kubelet/pods/e95cd70c-2b1b-445f-828f-29474fff6da4/volumes"
Jul 06 12:31:04.027939 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:04.027861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:04.164209 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:04.164185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"]
Jul 06 12:31:04.166288 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:31:04.166263    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8198f24_b57d_4a78_ada2_2832bcd50a8c.slice/crio-ff4671b2d873d17e4f1af26a7d11ffa6fd0c81d2dcd1a32a60b96a7b1d1bdba5 WatchSource:0}: Error finding container ff4671b2d873d17e4f1af26a7d11ffa6fd0c81d2dcd1a32a60b96a7b1d1bdba5: Status 404 returned error can't find the container with id ff4671b2d873d17e4f1af26a7d11ffa6fd0c81d2dcd1a32a60b96a7b1d1bdba5
Jul 06 12:31:04.549752 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:04.549716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5" event={"ID":"e8198f24-b57d-4a78-ada2-2832bcd50a8c","Type":"ContainerStarted","Data":"ff4671b2d873d17e4f1af26a7d11ffa6fd0c81d2dcd1a32a60b96a7b1d1bdba5"}
Jul 06 12:31:15.614342 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:15.614300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5" event={"ID":"e8198f24-b57d-4a78-ada2-2832bcd50a8c","Type":"ContainerStarted","Data":"fe4176469fb0cc94f8ef4a1c9a3f4ab3f2d90f03d00914ae9d99d3df15f336e4"}
Jul 06 12:31:15.614812 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:15.614369    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:15.641341 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:15.641291    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5" podStartSLOduration=1.544881849 podStartE2EDuration="12.641273971s" totalImagesPullingTime="11.096392122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:31:15.639154898 +0000 UTC m=+522.379346231" watchObservedRunningTime="2026-07-06 12:31:15.641273971 +0000 UTC m=+522.381465305"
Jul 06 12:31:21.649790 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:21.649755    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dqgd5"
Jul 06 12:31:28.562589 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.562495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dd9f4c6cb-26h5f"]
Jul 06 12:31:28.565833 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.565814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:28.569566 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.569543    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 12:31:28.569699 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.569649    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5krdf\""
Jul 06 12:31:28.570339 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.570321    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 12:31:28.578668 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.578647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dd9f4c6cb-26h5f"]
Jul 06 12:31:28.646443 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.646404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqbkh\" (UniqueName: \"kubernetes.io/projected/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-kube-api-access-tqbkh\") pod \"maas-controller-5dd9f4c6cb-26h5f\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") " pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:28.646637 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.646602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert\") pod \"maas-controller-5dd9f4c6cb-26h5f\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") " pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:28.747581 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.747517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqbkh\" (UniqueName: \"kubernetes.io/projected/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-kube-api-access-tqbkh\") pod \"maas-controller-5dd9f4c6cb-26h5f\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") " pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:28.747774 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.747649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert\") pod \"maas-controller-5dd9f4c6cb-26h5f\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") " pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:28.747841 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:31:28.747822    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 12:31:28.747928 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:31:28.747914    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert podName:a20a8c02-01e3-4dd8-a1f4-118fb3c8e345 nodeName:}" failed. No retries permitted until 2026-07-06 12:31:29.247892263 +0000 UTC m=+535.988083591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert") pod "maas-controller-5dd9f4c6cb-26h5f" (UID: "a20a8c02-01e3-4dd8-a1f4-118fb3c8e345") : secret "maas-controller-webhook-cert" not found
Jul 06 12:31:28.762948 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.762923    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqbkh\" (UniqueName: \"kubernetes.io/projected/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-kube-api-access-tqbkh\") pod \"maas-controller-5dd9f4c6cb-26h5f\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") " pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:28.802977 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.802940    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-7hr22"]
Jul 06 12:31:28.806377 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.806354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:28.835097 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.835071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-7hr22"]
Jul 06 12:31:28.950357 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.950316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-webhook-cert\") pod \"maas-controller-79f4fc5cc-7hr22\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") " pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:28.950357 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:28.950361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7j4\" (UniqueName: \"kubernetes.io/projected/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-kube-api-access-vm7j4\") pod \"maas-controller-79f4fc5cc-7hr22\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") " pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:29.051837 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.051792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-webhook-cert\") pod \"maas-controller-79f4fc5cc-7hr22\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") " pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:29.052040 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.051846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7j4\" (UniqueName: \"kubernetes.io/projected/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-kube-api-access-vm7j4\") pod \"maas-controller-79f4fc5cc-7hr22\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") " pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:29.054347 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.054320    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-webhook-cert\") pod \"maas-controller-79f4fc5cc-7hr22\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") " pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:29.061049 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.061026    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7j4\" (UniqueName: \"kubernetes.io/projected/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-kube-api-access-vm7j4\") pod \"maas-controller-79f4fc5cc-7hr22\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") " pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:29.116921 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.116894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:29.253328 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.253300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-7hr22"]
Jul 06 12:31:29.253662 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.253641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert\") pod \"maas-controller-5dd9f4c6cb-26h5f\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") " pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:29.255079 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:31:29.255053    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ba35c5_71b5_42de_99f7_b9c5ad6df6ba.slice/crio-f458f51d542721e198c3b67faab0f410101bb64779b1c0127bd650dead75a87d WatchSource:0}: Error finding container f458f51d542721e198c3b67faab0f410101bb64779b1c0127bd650dead75a87d: Status 404 returned error can't find the container with id f458f51d542721e198c3b67faab0f410101bb64779b1c0127bd650dead75a87d
Jul 06 12:31:29.256075 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.256055    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert\") pod \"maas-controller-5dd9f4c6cb-26h5f\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") " pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:29.476760 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.476675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:29.629811 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.629788    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dd9f4c6cb-26h5f"]
Jul 06 12:31:29.631852 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:31:29.631824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20a8c02_01e3_4dd8_a1f4_118fb3c8e345.slice/crio-5f12906dc0d602d8cf98ce9dbafee9496209e7673014333ad1d33e7d5bf94455 WatchSource:0}: Error finding container 5f12906dc0d602d8cf98ce9dbafee9496209e7673014333ad1d33e7d5bf94455: Status 404 returned error can't find the container with id 5f12906dc0d602d8cf98ce9dbafee9496209e7673014333ad1d33e7d5bf94455
Jul 06 12:31:29.689670 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.689635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f4fc5cc-7hr22" event={"ID":"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba","Type":"ContainerStarted","Data":"f458f51d542721e198c3b67faab0f410101bb64779b1c0127bd650dead75a87d"}
Jul 06 12:31:29.690845 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:29.690814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f" event={"ID":"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345","Type":"ContainerStarted","Data":"5f12906dc0d602d8cf98ce9dbafee9496209e7673014333ad1d33e7d5bf94455"}
Jul 06 12:31:31.705564 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:31.705515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f" event={"ID":"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345","Type":"ContainerStarted","Data":"f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0"}
Jul 06 12:31:31.705976 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:31.705706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:31.707121 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:31.707096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f4fc5cc-7hr22" event={"ID":"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba","Type":"ContainerStarted","Data":"14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e"}
Jul 06 12:31:31.707251 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:31.707222    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:31.745523 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:31.745476    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f" podStartSLOduration=2.007514447 podStartE2EDuration="3.745460268s" totalImagesPullingTime="1.737945821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:31:31.74383621 +0000 UTC m=+538.484027537" watchObservedRunningTime="2026-07-06 12:31:31.745460268 +0000 UTC m=+538.485651601"
Jul 06 12:31:31.776971 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:31.776927    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79f4fc5cc-7hr22" podStartSLOduration=1.765902621 podStartE2EDuration="3.776913842s" totalImagesPullingTime="2.011011221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:31:31.774007213 +0000 UTC m=+538.514198546" watchObservedRunningTime="2026-07-06 12:31:31.776913842 +0000 UTC m=+538.517105175"
Jul 06 12:31:42.718916 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:42.718887    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:31:42.719310 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:42.718979    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:42.797605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:42.797575    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dd9f4c6cb-26h5f"]
Jul 06 12:31:42.797770 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:42.797748    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f" podUID="a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" containerName="manager" containerID="cri-o://f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0" gracePeriod=30
Jul 06 12:31:43.042054 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.042030    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:43.175706 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.175674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqbkh\" (UniqueName: \"kubernetes.io/projected/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-kube-api-access-tqbkh\") pod \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") "
Jul 06 12:31:43.175844 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.175720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert\") pod \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\" (UID: \"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345\") "
Jul 06 12:31:43.177777 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.177746    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" (UID: "a20a8c02-01e3-4dd8-a1f4-118fb3c8e345"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:31:43.177777 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.177761    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-kube-api-access-tqbkh" (OuterVolumeSpecName: "kube-api-access-tqbkh") pod "a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" (UID: "a20a8c02-01e3-4dd8-a1f4-118fb3c8e345"). InnerVolumeSpecName "kube-api-access-tqbkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:31:43.276288 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.276235    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-webhook-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:31:43.276288 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.276257    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqbkh\" (UniqueName: \"kubernetes.io/projected/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345-kube-api-access-tqbkh\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:31:43.771991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.771961    2565 generic.go:356] "Generic (PLEG): container finished" podID="a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" containerID="f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0" exitCode=0
Jul 06 12:31:43.772399 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.772006    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f"
Jul 06 12:31:43.772399 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.772021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f" event={"ID":"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345","Type":"ContainerDied","Data":"f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0"}
Jul 06 12:31:43.772399 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.772061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dd9f4c6cb-26h5f" event={"ID":"a20a8c02-01e3-4dd8-a1f4-118fb3c8e345","Type":"ContainerDied","Data":"5f12906dc0d602d8cf98ce9dbafee9496209e7673014333ad1d33e7d5bf94455"}
Jul 06 12:31:43.772399 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.772083    2565 scope.go:117] "RemoveContainer" containerID="f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0"
Jul 06 12:31:43.781620 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.781599    2565 scope.go:117] "RemoveContainer" containerID="f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0"
Jul 06 12:31:43.781872 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:31:43.781853    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0\": container with ID starting with f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0 not found: ID does not exist" containerID="f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0"
Jul 06 12:31:43.781940 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.781879    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0"} err="failed to get container status \"f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0\": rpc error: code = NotFound desc = could not find container \"f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0\": container with ID starting with f1265529a471e19fe080e3a75fde22317847cec996e1ada5f7e15c706bfcbae0 not found: ID does not exist"
Jul 06 12:31:43.795943 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.795918    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dd9f4c6cb-26h5f"]
Jul 06 12:31:43.801323 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.801302    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5dd9f4c6cb-26h5f"]
Jul 06 12:31:43.884696 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:31:43.884674    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" path="/var/lib/kubelet/pods/a20a8c02-01e3-4dd8-a1f4-118fb3c8e345/volumes"
Jul 06 12:32:03.794824 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.794794    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-58db446c68-67n9w"]
Jul 06 12:32:03.795304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.795185    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" containerName="manager"
Jul 06 12:32:03.795304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.795199    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" containerName="manager"
Jul 06 12:32:03.795304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.795298    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20a8c02-01e3-4dd8-a1f4-118fb3c8e345" containerName="manager"
Jul 06 12:32:03.801057 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.801033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.805389 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.805357    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-frggv\""
Jul 06 12:32:03.805389 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.805372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 06 12:32:03.817681 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.817660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58db446c68-67n9w"]
Jul 06 12:32:03.838523 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.838499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c56eee9-4169-4fdb-b586-ef5295862dad-openshift-service-ca\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.838638 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.838563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c56eee9-4169-4fdb-b586-ef5295862dad-maas-api-tls\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.838679 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.838627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swkbk\" (UniqueName: \"kubernetes.io/projected/7c56eee9-4169-4fdb-b586-ef5295862dad-kube-api-access-swkbk\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.939727 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.939695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c56eee9-4169-4fdb-b586-ef5295862dad-openshift-service-ca\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.939868 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.939845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c56eee9-4169-4fdb-b586-ef5295862dad-maas-api-tls\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.939957 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.939939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swkbk\" (UniqueName: \"kubernetes.io/projected/7c56eee9-4169-4fdb-b586-ef5295862dad-kube-api-access-swkbk\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.940313 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.940287    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c56eee9-4169-4fdb-b586-ef5295862dad-openshift-service-ca\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.942331 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.942308    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c56eee9-4169-4fdb-b586-ef5295862dad-maas-api-tls\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:03.953458 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:03.953436    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swkbk\" (UniqueName: \"kubernetes.io/projected/7c56eee9-4169-4fdb-b586-ef5295862dad-kube-api-access-swkbk\") pod \"maas-api-58db446c68-67n9w\" (UID: \"7c56eee9-4169-4fdb-b586-ef5295862dad\") " pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:04.111694 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.111668    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:04.334727 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.334704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58db446c68-67n9w"]
Jul 06 12:32:04.336896 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:32:04.336866    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c56eee9_4169_4fdb_b586_ef5295862dad.slice/crio-bbdf02b43667387340f46f2a90a4d575165346ae7173f7277327665b89410b55 WatchSource:0}: Error finding container bbdf02b43667387340f46f2a90a4d575165346ae7173f7277327665b89410b55: Status 404 returned error can't find the container with id bbdf02b43667387340f46f2a90a4d575165346ae7173f7277327665b89410b55
Jul 06 12:32:04.888036 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.888004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w" event={"ID":"7c56eee9-4169-4fdb-b586-ef5295862dad","Type":"ContainerStarted","Data":"bbdf02b43667387340f46f2a90a4d575165346ae7173f7277327665b89410b55"}
Jul 06 12:32:04.910196 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.910168    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-tfj2d"]
Jul 06 12:32:04.916325 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.916307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:04.921749 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.921727    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 12:32:04.921878 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.921731    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h6gzf\""
Jul 06 12:32:04.928903 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.928881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-tfj2d"]
Jul 06 12:32:04.931513 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.931482    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-8l9th"]
Jul 06 12:32:04.935820 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.935804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:04.950290 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.950268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbe8764-71a0-4ae2-a381-6db142d2f39f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-tfj2d\" (UID: \"cbbe8764-71a0-4ae2-a381-6db142d2f39f\") " pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:04.950384 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.950310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfbnk\" (UniqueName: \"kubernetes.io/projected/cbbe8764-71a0-4ae2-a381-6db142d2f39f-kube-api-access-bfbnk\") pod \"payload-pre-processing-7964457696-tfj2d\" (UID: \"cbbe8764-71a0-4ae2-a381-6db142d2f39f\") " pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:04.960429 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:04.960406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-8l9th"]
Jul 06 12:32:05.050954 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.050923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239d71a3-22fd-42a7-aeda-c125158e23fc-plugins-config-volume\") pod \"payload-processing-58f86c7798-8l9th\" (UID: \"239d71a3-22fd-42a7-aeda-c125158e23fc\") " pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:05.050954 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.050956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnpjx\" (UniqueName: \"kubernetes.io/projected/239d71a3-22fd-42a7-aeda-c125158e23fc-kube-api-access-qnpjx\") pod \"payload-processing-58f86c7798-8l9th\" (UID: \"239d71a3-22fd-42a7-aeda-c125158e23fc\") " pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:05.051139 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.051056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbe8764-71a0-4ae2-a381-6db142d2f39f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-tfj2d\" (UID: \"cbbe8764-71a0-4ae2-a381-6db142d2f39f\") " pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:05.051139 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.051121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfbnk\" (UniqueName: \"kubernetes.io/projected/cbbe8764-71a0-4ae2-a381-6db142d2f39f-kube-api-access-bfbnk\") pod \"payload-pre-processing-7964457696-tfj2d\" (UID: \"cbbe8764-71a0-4ae2-a381-6db142d2f39f\") " pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:05.051683 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.051666    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbe8764-71a0-4ae2-a381-6db142d2f39f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-tfj2d\" (UID: \"cbbe8764-71a0-4ae2-a381-6db142d2f39f\") " pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:05.068730 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.068707    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfbnk\" (UniqueName: \"kubernetes.io/projected/cbbe8764-71a0-4ae2-a381-6db142d2f39f-kube-api-access-bfbnk\") pod \"payload-pre-processing-7964457696-tfj2d\" (UID: \"cbbe8764-71a0-4ae2-a381-6db142d2f39f\") " pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:05.152141 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.152057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239d71a3-22fd-42a7-aeda-c125158e23fc-plugins-config-volume\") pod \"payload-processing-58f86c7798-8l9th\" (UID: \"239d71a3-22fd-42a7-aeda-c125158e23fc\") " pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:05.152141 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.152104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnpjx\" (UniqueName: \"kubernetes.io/projected/239d71a3-22fd-42a7-aeda-c125158e23fc-kube-api-access-qnpjx\") pod \"payload-processing-58f86c7798-8l9th\" (UID: \"239d71a3-22fd-42a7-aeda-c125158e23fc\") " pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:05.152807 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.152789    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/239d71a3-22fd-42a7-aeda-c125158e23fc-plugins-config-volume\") pod \"payload-processing-58f86c7798-8l9th\" (UID: \"239d71a3-22fd-42a7-aeda-c125158e23fc\") " pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:05.166633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.166605    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnpjx\" (UniqueName: \"kubernetes.io/projected/239d71a3-22fd-42a7-aeda-c125158e23fc-kube-api-access-qnpjx\") pod \"payload-processing-58f86c7798-8l9th\" (UID: \"239d71a3-22fd-42a7-aeda-c125158e23fc\") " pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:05.227116 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.227062    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:05.245273 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.245242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:05.422972 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.422908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-8l9th"]
Jul 06 12:32:05.425143 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:32:05.425113    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239d71a3_22fd_42a7_aeda_c125158e23fc.slice/crio-35c78f20c2892738907fa37e9a8039940adacd905074ae8d0e2578b7682e577b WatchSource:0}: Error finding container 35c78f20c2892738907fa37e9a8039940adacd905074ae8d0e2578b7682e577b: Status 404 returned error can't find the container with id 35c78f20c2892738907fa37e9a8039940adacd905074ae8d0e2578b7682e577b
Jul 06 12:32:05.437867 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.437843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-tfj2d"]
Jul 06 12:32:05.439059 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:32:05.439036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbe8764_71a0_4ae2_a381_6db142d2f39f.slice/crio-3735ca754d7674e95e0555796792000a37a7d25c6648fa5b356329edc6fbe592 WatchSource:0}: Error finding container 3735ca754d7674e95e0555796792000a37a7d25c6648fa5b356329edc6fbe592: Status 404 returned error can't find the container with id 3735ca754d7674e95e0555796792000a37a7d25c6648fa5b356329edc6fbe592
Jul 06 12:32:05.895420 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.895393    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-8l9th" event={"ID":"239d71a3-22fd-42a7-aeda-c125158e23fc","Type":"ContainerStarted","Data":"35c78f20c2892738907fa37e9a8039940adacd905074ae8d0e2578b7682e577b"}
Jul 06 12:32:05.897074 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:05.897050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d" event={"ID":"cbbe8764-71a0-4ae2-a381-6db142d2f39f","Type":"ContainerStarted","Data":"3735ca754d7674e95e0555796792000a37a7d25c6648fa5b356329edc6fbe592"}
Jul 06 12:32:06.905682 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:06.905640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w" event={"ID":"7c56eee9-4169-4fdb-b586-ef5295862dad","Type":"ContainerStarted","Data":"748e0744862953d6d6d3043a042a6a93d4f71dc1641cf1e97738f582360dcb65"}
Jul 06 12:32:06.906077 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:06.905728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:06.938478 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:06.938419    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w" podStartSLOduration=2.034336501 podStartE2EDuration="3.93840135s" totalImagesPullingTime="1.904064849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:06.935021036 +0000 UTC m=+573.675212373" watchObservedRunningTime="2026-07-06 12:32:06.93840135 +0000 UTC m=+573.678592698"
Jul 06 12:32:07.918851 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:07.918816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-8l9th" event={"ID":"239d71a3-22fd-42a7-aeda-c125158e23fc","Type":"ContainerStarted","Data":"703041bcf1d3e35e0f3accc492302b17c0cdfcfbecf76553fa6124f5e735d543"}
Jul 06 12:32:07.919227 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:07.918931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:07.922015 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:07.921836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d" event={"ID":"cbbe8764-71a0-4ae2-a381-6db142d2f39f","Type":"ContainerStarted","Data":"11eaf4c00343461e64d0cb326c636e518e60e497c5070420aa3384a35a67fab3"}
Jul 06 12:32:07.922015 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:07.921878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:07.957151 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:07.957110    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-8l9th" podStartSLOduration=2.121372065 podStartE2EDuration="3.957097047s" totalImagesPullingTime="1.835724982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:07.955471955 +0000 UTC m=+574.695663290" watchObservedRunningTime="2026-07-06 12:32:07.957097047 +0000 UTC m=+574.697288419"
Jul 06 12:32:08.006724 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:08.006681    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d" podStartSLOduration=2.187623569 podStartE2EDuration="4.006668342s" totalImagesPullingTime="1.819044773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:08.005763638 +0000 UTC m=+574.745954991" watchObservedRunningTime="2026-07-06 12:32:08.006668342 +0000 UTC m=+574.746859676"
Jul 06 12:32:12.927269 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:12.927243    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-58db446c68-67n9w"
Jul 06 12:32:18.929086 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:18.929058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-tfj2d"
Jul 06 12:32:18.929570 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:18.929124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-8l9th"
Jul 06 12:32:24.998015 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:24.997983    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"]
Jul 06 12:32:25.003326 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.003304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.008757 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.008737    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 12:32:25.010002 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.009975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lkt9g\""
Jul 06 12:32:25.010114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.010034    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 12:32:25.011213 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.010240    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 12:32:25.029826 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.029799    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"]
Jul 06 12:32:25.127707 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.127668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.127859 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.127717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r76rf\" (UniqueName: \"kubernetes.io/projected/217427e1-937d-4495-90e2-3e8c7671a454-kube-api-access-r76rf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.127859 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.127814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/217427e1-937d-4495-90e2-3e8c7671a454-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.127859 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.127856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.127965 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.127876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.128000 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.127971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228459 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228622 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228622 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76rf\" (UniqueName: \"kubernetes.io/projected/217427e1-937d-4495-90e2-3e8c7671a454-kube-api-access-r76rf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228622 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/217427e1-937d-4495-90e2-3e8c7671a454-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228816 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228903 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228863    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.228903 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.228800    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.229030 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.229011    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.231049 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.231019    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/217427e1-937d-4495-90e2-3e8c7671a454-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.231049 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.231036    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/217427e1-937d-4495-90e2-3e8c7671a454-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.238459 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.238432    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r76rf\" (UniqueName: \"kubernetes.io/projected/217427e1-937d-4495-90e2-3e8c7671a454-kube-api-access-r76rf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw\" (UID: \"217427e1-937d-4495-90e2-3e8c7671a454\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.335580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.335558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:25.519803 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:25.519778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"]
Jul 06 12:32:25.522506 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:32:25.522476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217427e1_937d_4495_90e2_3e8c7671a454.slice/crio-0dec422f6732b7d639e3568f078be09524817fbf623ee677ede58336b197ada3 WatchSource:0}: Error finding container 0dec422f6732b7d639e3568f078be09524817fbf623ee677ede58336b197ada3: Status 404 returned error can't find the container with id 0dec422f6732b7d639e3568f078be09524817fbf623ee677ede58336b197ada3
Jul 06 12:32:26.055715 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:26.055675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw" event={"ID":"217427e1-937d-4495-90e2-3e8c7671a454","Type":"ContainerStarted","Data":"0dec422f6732b7d639e3568f078be09524817fbf623ee677ede58336b197ada3"}
Jul 06 12:32:27.062876 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:27.062787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw" event={"ID":"217427e1-937d-4495-90e2-3e8c7671a454","Type":"ContainerStarted","Data":"7e8c5327459bf73a58d2dd18c50da77ccec4ae0b70549a32ea0d2f1df07343f4"}
Jul 06 12:32:27.084208 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:27.084161    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw" podStartSLOduration=1.838923019 podStartE2EDuration="3.084145338s" totalImagesPullingTime="1.245222319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:27.082712031 +0000 UTC m=+593.822903364" watchObservedRunningTime="2026-07-06 12:32:27.084145338 +0000 UTC m=+593.824336714"
Jul 06 12:32:33.681514 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:33.681486    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:32:33.682389 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:33.682367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:32:35.335794 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:35.335744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:35.335794 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:35.335805    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:35.354298 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:35.354271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:36.123141 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:36.123109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw"
Jul 06 12:32:46.647394 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.647368    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"]
Jul 06 12:32:46.655158 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.654890    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.658451 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.658430    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 12:32:46.666920 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.666894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"]
Jul 06 12:32:46.709376 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.709354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.709484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.709395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwl9r\" (UniqueName: \"kubernetes.io/projected/74e68241-0fc6-4bad-b07b-ee0391865ba6-kube-api-access-fwl9r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.709553 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.709478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.709553 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.709506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.709647 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.709591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.709647 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.709612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e68241-0fc6-4bad-b07b-ee0391865ba6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.810623 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.810586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.810623 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.810629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.810819 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.810663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.810819 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.810690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e68241-0fc6-4bad-b07b-ee0391865ba6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.810819 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.810731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.810819 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.810778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwl9r\" (UniqueName: \"kubernetes.io/projected/74e68241-0fc6-4bad-b07b-ee0391865ba6-kube-api-access-fwl9r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.811062 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.811039    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.811137 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.811120    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.811194 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.811137    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.812961 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.812941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74e68241-0fc6-4bad-b07b-ee0391865ba6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.813114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.813095    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74e68241-0fc6-4bad-b07b-ee0391865ba6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.819812 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.819790    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwl9r\" (UniqueName: \"kubernetes.io/projected/74e68241-0fc6-4bad-b07b-ee0391865ba6-kube-api-access-fwl9r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8q97w\" (UID: \"74e68241-0fc6-4bad-b07b-ee0391865ba6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:46.968782 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:46.968714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:47.113972 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:47.113948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"]
Jul 06 12:32:47.115705 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:32:47.115677    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e68241_0fc6_4bad_b07b_ee0391865ba6.slice/crio-ee63378d50ee1ab678393cd4269a677cc718068182e7d1329c962b6492cb4905 WatchSource:0}: Error finding container ee63378d50ee1ab678393cd4269a677cc718068182e7d1329c962b6492cb4905: Status 404 returned error can't find the container with id ee63378d50ee1ab678393cd4269a677cc718068182e7d1329c962b6492cb4905
Jul 06 12:32:47.117432 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:47.117413    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:32:47.173478 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:47.173452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w" event={"ID":"74e68241-0fc6-4bad-b07b-ee0391865ba6","Type":"ContainerStarted","Data":"ee63378d50ee1ab678393cd4269a677cc718068182e7d1329c962b6492cb4905"}
Jul 06 12:32:48.180214 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:48.180180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w" event={"ID":"74e68241-0fc6-4bad-b07b-ee0391865ba6","Type":"ContainerStarted","Data":"45c6e4ddfd07e39351588d77542c89e3f285c76c050f2a5eb8701a600f043b10"}
Jul 06 12:32:48.214484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:48.214434    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w" podStartSLOduration=2.00350709 podStartE2EDuration="2.214419237s" totalImagesPullingTime="210.912147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:32:48.211706157 +0000 UTC m=+614.951897510" watchObservedRunningTime="2026-07-06 12:32:48.214419237 +0000 UTC m=+614.954610570"
Jul 06 12:32:56.969187 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:56.969104    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:56.969187 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:56.969170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:56.981751 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:56.981723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:32:57.241413 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:32:57.241329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8q97w"
Jul 06 12:35:24.391048 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.391013    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-7hr22"]
Jul 06 12:35:24.391554 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.391234    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79f4fc5cc-7hr22" podUID="a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" containerName="manager" containerID="cri-o://14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e" gracePeriod=30
Jul 06 12:35:24.645319 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.645262    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:35:24.818773 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.818747    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-webhook-cert\") pod \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") "
Jul 06 12:35:24.818954 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.818819    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm7j4\" (UniqueName: \"kubernetes.io/projected/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-kube-api-access-vm7j4\") pod \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\" (UID: \"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba\") "
Jul 06 12:35:24.820799 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.820770    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" (UID: "a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:35:24.820896 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.820859    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-kube-api-access-vm7j4" (OuterVolumeSpecName: "kube-api-access-vm7j4") pod "a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" (UID: "a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba"). InnerVolumeSpecName "kube-api-access-vm7j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:35:24.919576 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.919498    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-webhook-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:35:24.919576 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:24.919523    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm7j4\" (UniqueName: \"kubernetes.io/projected/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba-kube-api-access-vm7j4\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:35:25.045988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.045959    2565 generic.go:356] "Generic (PLEG): container finished" podID="a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" containerID="14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e" exitCode=0
Jul 06 12:35:25.046114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.046002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f4fc5cc-7hr22"
Jul 06 12:35:25.046114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.046045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f4fc5cc-7hr22" event={"ID":"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba","Type":"ContainerDied","Data":"14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e"}
Jul 06 12:35:25.046114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.046090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f4fc5cc-7hr22" event={"ID":"a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba","Type":"ContainerDied","Data":"f458f51d542721e198c3b67faab0f410101bb64779b1c0127bd650dead75a87d"}
Jul 06 12:35:25.046114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.046113    2565 scope.go:117] "RemoveContainer" containerID="14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e"
Jul 06 12:35:25.055937 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.055920    2565 scope.go:117] "RemoveContainer" containerID="14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e"
Jul 06 12:35:25.056174 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:35:25.056157    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e\": container with ID starting with 14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e not found: ID does not exist" containerID="14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e"
Jul 06 12:35:25.056225 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.056181    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e"} err="failed to get container status \"14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e\": rpc error: code = NotFound desc = could not find container \"14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e\": container with ID starting with 14017212600fb7753f2763163ad46aaa78c10034348946cbba16842a0c7fe41e not found: ID does not exist"
Jul 06 12:35:25.070584 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.070563    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-7hr22"]
Jul 06 12:35:25.078851 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.078833    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-7hr22"]
Jul 06 12:35:25.854710 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.854676    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-mvg4t"]
Jul 06 12:35:25.855095 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.855081    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" containerName="manager"
Jul 06 12:35:25.855135 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.855096    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" containerName="manager"
Jul 06 12:35:25.855179 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.855170    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" containerName="manager"
Jul 06 12:35:25.859367 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.859350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:25.862071 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.862039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 12:35:25.863857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.863839    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5krdf\""
Jul 06 12:35:25.863951 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.863842    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 12:35:25.870277 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.870256    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-mvg4t"]
Jul 06 12:35:25.887131 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:25.887105    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba" path="/var/lib/kubelet/pods/a5ba35c5-71b5-42de-99f7-b9c5ad6df6ba/volumes"
Jul 06 12:35:26.029224 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.029186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab-webhook-cert\") pod \"maas-controller-79f4fc5cc-mvg4t\" (UID: \"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab\") " pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:26.029361 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.029248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5cfb\" (UniqueName: \"kubernetes.io/projected/f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab-kube-api-access-t5cfb\") pod \"maas-controller-79f4fc5cc-mvg4t\" (UID: \"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab\") " pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:26.130712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.130641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab-webhook-cert\") pod \"maas-controller-79f4fc5cc-mvg4t\" (UID: \"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab\") " pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:26.130712 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.130694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5cfb\" (UniqueName: \"kubernetes.io/projected/f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab-kube-api-access-t5cfb\") pod \"maas-controller-79f4fc5cc-mvg4t\" (UID: \"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab\") " pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:26.132988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.132964    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab-webhook-cert\") pod \"maas-controller-79f4fc5cc-mvg4t\" (UID: \"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab\") " pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:26.141603 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.141583    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5cfb\" (UniqueName: \"kubernetes.io/projected/f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab-kube-api-access-t5cfb\") pod \"maas-controller-79f4fc5cc-mvg4t\" (UID: \"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab\") " pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:26.170175 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.170152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:26.314194 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:26.314166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79f4fc5cc-mvg4t"]
Jul 06 12:35:26.314996 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:35:26.314972    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cc69bc_8ee8_4aa4_b665_dfd1ad2e95ab.slice/crio-d6688b8d321983ca8a0ce53064d8dcd63d829a2c6c14937abaf4700689b03529 WatchSource:0}: Error finding container d6688b8d321983ca8a0ce53064d8dcd63d829a2c6c14937abaf4700689b03529: Status 404 returned error can't find the container with id d6688b8d321983ca8a0ce53064d8dcd63d829a2c6c14937abaf4700689b03529
Jul 06 12:35:27.060021 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:27.059986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f4fc5cc-mvg4t" event={"ID":"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab","Type":"ContainerStarted","Data":"ec1dda1eac88c9c1addd68c3476e2520987cb46feeafe302bcc4322d054f36bb"}
Jul 06 12:35:27.060392 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:27.060043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:35:27.060392 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:27.060065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79f4fc5cc-mvg4t" event={"ID":"f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab","Type":"ContainerStarted","Data":"d6688b8d321983ca8a0ce53064d8dcd63d829a2c6c14937abaf4700689b03529"}
Jul 06 12:35:27.084312 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:27.084240    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79f4fc5cc-mvg4t" podStartSLOduration=1.533892205 podStartE2EDuration="2.084221492s" totalImagesPullingTime="550.329287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:35:27.084146622 +0000 UTC m=+773.824337956" watchObservedRunningTime="2026-07-06 12:35:27.084221492 +0000 UTC m=+773.824412826"
Jul 06 12:35:38.071128 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:35:38.071098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79f4fc5cc-mvg4t"
Jul 06 12:37:33.724956 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:37:33.724879    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:37:33.729462 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:37:33.729439    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:42:33.766079 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:42:33.766055    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:42:33.772134 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:42:33.772110    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:45:00.158302 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.158214    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"]
Jul 06 12:45:00.162088 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.162067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"
Jul 06 12:45:00.181205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.181181    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"]
Jul 06 12:45:00.277088 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.277055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h25wh\" (UniqueName: \"kubernetes.io/projected/59dc2783-5bda-4cd7-b757-2afd4e262132-kube-api-access-h25wh\") pod \"maas-api-key-cleanup-29722365-fn45n\" (UID: \"59dc2783-5bda-4cd7-b757-2afd4e262132\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"
Jul 06 12:45:00.378027 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.377986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h25wh\" (UniqueName: \"kubernetes.io/projected/59dc2783-5bda-4cd7-b757-2afd4e262132-kube-api-access-h25wh\") pod \"maas-api-key-cleanup-29722365-fn45n\" (UID: \"59dc2783-5bda-4cd7-b757-2afd4e262132\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"
Jul 06 12:45:00.387519 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.387486    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h25wh\" (UniqueName: \"kubernetes.io/projected/59dc2783-5bda-4cd7-b757-2afd4e262132-kube-api-access-h25wh\") pod \"maas-api-key-cleanup-29722365-fn45n\" (UID: \"59dc2783-5bda-4cd7-b757-2afd4e262132\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"
Jul 06 12:45:00.472373 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.472268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"
Jul 06 12:45:00.614823 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:45:00.614787    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dc2783_5bda_4cd7_b757_2afd4e262132.slice/crio-d7d41bbfa821510b691dfeb62f2aac4e9747387a6cdd7af769c34e3ff509abde WatchSource:0}: Error finding container d7d41bbfa821510b691dfeb62f2aac4e9747387a6cdd7af769c34e3ff509abde: Status 404 returned error can't find the container with id d7d41bbfa821510b691dfeb62f2aac4e9747387a6cdd7af769c34e3ff509abde
Jul 06 12:45:00.615293 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.615272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"]
Jul 06 12:45:00.616787 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:00.616771    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:45:01.272362 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:01.272329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n" event={"ID":"59dc2783-5bda-4cd7-b757-2afd4e262132","Type":"ContainerStarted","Data":"d7d41bbfa821510b691dfeb62f2aac4e9747387a6cdd7af769c34e3ff509abde"}
Jul 06 12:45:03.286648 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:03.286560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n" event={"ID":"59dc2783-5bda-4cd7-b757-2afd4e262132","Type":"ContainerStarted","Data":"b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e"}
Jul 06 12:45:03.312423 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:45:03.312376    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n" podStartSLOduration=1.110526498 podStartE2EDuration="3.312362001s" totalImagesPullingTime="2.201835503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:45:03.311810666 +0000 UTC m=+1350.052001999" watchObservedRunningTime="2026-07-06 12:45:03.312362001 +0000 UTC m=+1350.052553333"
Jul 06 12:46:00.016379 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:00.016339    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"]
Jul 06 12:46:00.017004 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:00.016619    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n" podUID="59dc2783-5bda-4cd7-b757-2afd4e262132" containerName="cleanup" containerID="cri-o://b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e" gracePeriod=30
Jul 06 12:46:30.196797 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.196769    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"
Jul 06 12:46:30.250669 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.250638    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h25wh\" (UniqueName: \"kubernetes.io/projected/59dc2783-5bda-4cd7-b757-2afd4e262132-kube-api-access-h25wh\") pod \"59dc2783-5bda-4cd7-b757-2afd4e262132\" (UID: \"59dc2783-5bda-4cd7-b757-2afd4e262132\") "
Jul 06 12:46:30.252813 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.252783    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59dc2783-5bda-4cd7-b757-2afd4e262132-kube-api-access-h25wh" (OuterVolumeSpecName: "kube-api-access-h25wh") pod "59dc2783-5bda-4cd7-b757-2afd4e262132" (UID: "59dc2783-5bda-4cd7-b757-2afd4e262132"). InnerVolumeSpecName "kube-api-access-h25wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:46:30.352190 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.352152    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h25wh\" (UniqueName: \"kubernetes.io/projected/59dc2783-5bda-4cd7-b757-2afd4e262132-kube-api-access-h25wh\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:46:30.777304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.777211    2565 generic.go:356] "Generic (PLEG): container finished" podID="59dc2783-5bda-4cd7-b757-2afd4e262132" containerID="b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e" exitCode=137
Jul 06 12:46:30.777304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.777260    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"
Jul 06 12:46:30.777550 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.777295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n" event={"ID":"59dc2783-5bda-4cd7-b757-2afd4e262132","Type":"ContainerDied","Data":"b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e"}
Jul 06 12:46:30.777550 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.777359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n" event={"ID":"59dc2783-5bda-4cd7-b757-2afd4e262132","Type":"ContainerDied","Data":"d7d41bbfa821510b691dfeb62f2aac4e9747387a6cdd7af769c34e3ff509abde"}
Jul 06 12:46:30.777550 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.777388    2565 scope.go:117] "RemoveContainer" containerID="b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e"
Jul 06 12:46:30.786769 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.786749    2565 scope.go:117] "RemoveContainer" containerID="b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e"
Jul 06 12:46:30.787005 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:46:30.786987    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e\": container with ID starting with b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e not found: ID does not exist" containerID="b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e"
Jul 06 12:46:30.787069 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.787013    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e"} err="failed to get container status \"b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e\": rpc error: code = NotFound desc = could not find container \"b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e\": container with ID starting with b08b1dc57882c3d04bfe7ea42e2a57322d813d52f43cf0cf1eb7544f2004912e not found: ID does not exist"
Jul 06 12:46:30.801114 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.801093    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"]
Jul 06 12:46:30.811073 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:30.811056    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722365-fn45n"]
Jul 06 12:46:31.885212 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:46:31.885179    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59dc2783-5bda-4cd7-b757-2afd4e262132" path="/var/lib/kubelet/pods/59dc2783-5bda-4cd7-b757-2afd4e262132/volumes"
Jul 06 12:47:33.802871 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:33.802831    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:47:33.809189 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:33.809168    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:47:46.632966 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.632931    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"]
Jul 06 12:47:46.633595 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.633574    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59dc2783-5bda-4cd7-b757-2afd4e262132" containerName="cleanup"
Jul 06 12:47:46.633595 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.633596    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="59dc2783-5bda-4cd7-b757-2afd4e262132" containerName="cleanup"
Jul 06 12:47:46.633771 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.633709    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="59dc2783-5bda-4cd7-b757-2afd4e262132" containerName="cleanup"
Jul 06 12:47:46.636726 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.636705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.639758 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.639736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a7d35e82-serving-cert\""
Jul 06 12:47:46.648381 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.648357    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"]
Jul 06 12:47:46.730722 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.730691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5918ad-160b-4fa1-a22e-861c37d3cddb-openshift-service-ca\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.730894 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.730756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4xf4\" (UniqueName: \"kubernetes.io/projected/2e5918ad-160b-4fa1-a22e-861c37d3cddb-kube-api-access-l4xf4\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.730894 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.730858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.831637 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.831606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4xf4\" (UniqueName: \"kubernetes.io/projected/2e5918ad-160b-4fa1-a22e-861c37d3cddb-kube-api-access-l4xf4\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.831770 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.831661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.831770 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:47:46.831766    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-serving-cert: secret "maas-api-e2e-ait-a7d35e82-serving-cert" not found
Jul 06 12:47:46.831870 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:47:46.831817    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls podName:2e5918ad-160b-4fa1-a22e-861c37d3cddb nodeName:}" failed. No retries permitted until 2026-07-06 12:47:47.33179683 +0000 UTC m=+1514.071988142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls") pod "maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9" (UID: "2e5918ad-160b-4fa1-a22e-861c37d3cddb") : secret "maas-api-e2e-ait-a7d35e82-serving-cert" not found
Jul 06 12:47:46.831870 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.831837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5918ad-160b-4fa1-a22e-861c37d3cddb-openshift-service-ca\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.832426 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.832402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5918ad-160b-4fa1-a22e-861c37d3cddb-openshift-service-ca\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:46.842906 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:46.842874    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4xf4\" (UniqueName: \"kubernetes.io/projected/2e5918ad-160b-4fa1-a22e-861c37d3cddb-kube-api-access-l4xf4\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:47.337613 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:47.337581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:47.339959 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:47.339934    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls\") pod \"maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:47.548983 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:47.548950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:47.713648 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:47.713621    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"]
Jul 06 12:47:47.714500 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:47:47.714476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5918ad_160b_4fa1_a22e_861c37d3cddb.slice/crio-c91f491aec6fb61cd6a710c8fc4b739b8a4f8cfe3b8fded9644875ada96b0f40 WatchSource:0}: Error finding container c91f491aec6fb61cd6a710c8fc4b739b8a4f8cfe3b8fded9644875ada96b0f40: Status 404 returned error can't find the container with id c91f491aec6fb61cd6a710c8fc4b739b8a4f8cfe3b8fded9644875ada96b0f40
Jul 06 12:47:48.221045 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:48.221002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9" event={"ID":"2e5918ad-160b-4fa1-a22e-861c37d3cddb","Type":"ContainerStarted","Data":"c91f491aec6fb61cd6a710c8fc4b739b8a4f8cfe3b8fded9644875ada96b0f40"}
Jul 06 12:47:49.229144 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:49.229110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9" event={"ID":"2e5918ad-160b-4fa1-a22e-861c37d3cddb","Type":"ContainerStarted","Data":"911735153b3d9da68f20f6419f1727e614668b8001befbe8f386627d42ec6143"}
Jul 06 12:47:49.229561 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:49.229257    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:52.002141 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.002076    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9" podStartSLOduration=5.333680862 podStartE2EDuration="6.002051528s" totalImagesPullingTime="668.370666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:49.267565398 +0000 UTC m=+1516.007756729" watchObservedRunningTime="2026-07-06 12:47:52.002051528 +0000 UTC m=+1518.742242857"
Jul 06 12:47:52.005115 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.005089    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"]
Jul 06 12:47:52.005271 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.005252    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9" podUID="2e5918ad-160b-4fa1-a22e-861c37d3cddb" containerName="maas-api" containerID="cri-o://911735153b3d9da68f20f6419f1727e614668b8001befbe8f386627d42ec6143" gracePeriod=30
Jul 06 12:47:52.249271 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.249244    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e5918ad-160b-4fa1-a22e-861c37d3cddb" containerID="911735153b3d9da68f20f6419f1727e614668b8001befbe8f386627d42ec6143" exitCode=0
Jul 06 12:47:52.249377 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.249314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9" event={"ID":"2e5918ad-160b-4fa1-a22e-861c37d3cddb","Type":"ContainerDied","Data":"911735153b3d9da68f20f6419f1727e614668b8001befbe8f386627d42ec6143"}
Jul 06 12:47:52.249377 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.249368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9" event={"ID":"2e5918ad-160b-4fa1-a22e-861c37d3cddb","Type":"ContainerDied","Data":"c91f491aec6fb61cd6a710c8fc4b739b8a4f8cfe3b8fded9644875ada96b0f40"}
Jul 06 12:47:52.249457 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.249384    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c91f491aec6fb61cd6a710c8fc4b739b8a4f8cfe3b8fded9644875ada96b0f40"
Jul 06 12:47:52.259078 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.259028    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:52.384092 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.384059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4xf4\" (UniqueName: \"kubernetes.io/projected/2e5918ad-160b-4fa1-a22e-861c37d3cddb-kube-api-access-l4xf4\") pod \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") "
Jul 06 12:47:52.384279 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.384098    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5918ad-160b-4fa1-a22e-861c37d3cddb-openshift-service-ca\") pod \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") "
Jul 06 12:47:52.384279 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.384127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls\") pod \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\" (UID: \"2e5918ad-160b-4fa1-a22e-861c37d3cddb\") "
Jul 06 12:47:52.384510 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.384482    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5918ad-160b-4fa1-a22e-861c37d3cddb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e5918ad-160b-4fa1-a22e-861c37d3cddb" (UID: "2e5918ad-160b-4fa1-a22e-861c37d3cddb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:47:52.386214 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.386190    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e5918ad-160b-4fa1-a22e-861c37d3cddb" (UID: "2e5918ad-160b-4fa1-a22e-861c37d3cddb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:47:52.386292 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.386271    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5918ad-160b-4fa1-a22e-861c37d3cddb-kube-api-access-l4xf4" (OuterVolumeSpecName: "kube-api-access-l4xf4") pod "2e5918ad-160b-4fa1-a22e-861c37d3cddb" (UID: "2e5918ad-160b-4fa1-a22e-861c37d3cddb"). InnerVolumeSpecName "kube-api-access-l4xf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:47:52.485438 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.485400    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4xf4\" (UniqueName: \"kubernetes.io/projected/2e5918ad-160b-4fa1-a22e-861c37d3cddb-kube-api-access-l4xf4\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:47:52.485438 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.485432    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5918ad-160b-4fa1-a22e-861c37d3cddb-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:47:52.485438 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:52.485446    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5918ad-160b-4fa1-a22e-861c37d3cddb-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:47:53.254288 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:53.254254    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"
Jul 06 12:47:53.277063 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:53.277035    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"]
Jul 06 12:47:53.281373 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:53.281354    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a7d35e82-5768c98746-fr7h9"]
Jul 06 12:47:53.885782 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:47:53.885738    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e5918ad-160b-4fa1-a22e-861c37d3cddb" path="/var/lib/kubelet/pods/2e5918ad-160b-4fa1-a22e-861c37d3cddb/volumes"
Jul 06 12:48:00.250605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.250572    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"]
Jul 06 12:48:00.251206 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.251183    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5918ad-160b-4fa1-a22e-861c37d3cddb" containerName="maas-api"
Jul 06 12:48:00.251358 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.251343    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5918ad-160b-4fa1-a22e-861c37d3cddb" containerName="maas-api"
Jul 06 12:48:00.251632 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.251614    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5918ad-160b-4fa1-a22e-861c37d3cddb" containerName="maas-api"
Jul 06 12:48:00.255260 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.255237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.258117 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.258095    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-22175320-serving-cert\""
Jul 06 12:48:00.267718 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.267692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"]
Jul 06 12:48:00.355580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.355544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c871ba-286b-472b-a388-503d320c8c1c-maas-api-tls\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.355730 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.355619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2vg2\" (UniqueName: \"kubernetes.io/projected/63c871ba-286b-472b-a388-503d320c8c1c-kube-api-access-n2vg2\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.355730 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.355639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c871ba-286b-472b-a388-503d320c8c1c-openshift-service-ca\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.456165 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.456131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c871ba-286b-472b-a388-503d320c8c1c-maas-api-tls\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.456345 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.456185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2vg2\" (UniqueName: \"kubernetes.io/projected/63c871ba-286b-472b-a388-503d320c8c1c-kube-api-access-n2vg2\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.456345 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.456205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c871ba-286b-472b-a388-503d320c8c1c-openshift-service-ca\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.456899 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.456880    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c871ba-286b-472b-a388-503d320c8c1c-openshift-service-ca\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.458722 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.458695    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c871ba-286b-472b-a388-503d320c8c1c-maas-api-tls\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.464881 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.464859    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2vg2\" (UniqueName: \"kubernetes.io/projected/63c871ba-286b-472b-a388-503d320c8c1c-kube-api-access-n2vg2\") pod \"maas-api-e2e-ait-22175320-5cc678dd87-s8rfz\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.569388 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.569358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:00.716054 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:00.715853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"]
Jul 06 12:48:00.718339 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:48:00.718314    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c871ba_286b_472b_a388_503d320c8c1c.slice/crio-ff77c80d01c3681b39be741797c7b135bdb74f668873ab6924bd734b47553b94 WatchSource:0}: Error finding container ff77c80d01c3681b39be741797c7b135bdb74f668873ab6924bd734b47553b94: Status 404 returned error can't find the container with id ff77c80d01c3681b39be741797c7b135bdb74f668873ab6924bd734b47553b94
Jul 06 12:48:01.301490 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:01.301450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz" event={"ID":"63c871ba-286b-472b-a388-503d320c8c1c","Type":"ContainerStarted","Data":"385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794"}
Jul 06 12:48:01.301912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:01.301523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz" event={"ID":"63c871ba-286b-472b-a388-503d320c8c1c","Type":"ContainerStarted","Data":"ff77c80d01c3681b39be741797c7b135bdb74f668873ab6924bd734b47553b94"}
Jul 06 12:48:01.301912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:01.301685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:01.329085 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:01.329034    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz" podStartSLOduration=0.870904177 podStartE2EDuration="1.329019251s" totalImagesPullingTime="458.115074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:01.327684181 +0000 UTC m=+1528.067875558" watchObservedRunningTime="2026-07-06 12:48:01.329019251 +0000 UTC m=+1528.069210584"
Jul 06 12:48:05.330607 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.330575    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"]
Jul 06 12:48:05.331215 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.330852    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz" podUID="63c871ba-286b-472b-a388-503d320c8c1c" containerName="maas-api" containerID="cri-o://385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794" gracePeriod=30
Jul 06 12:48:05.581084 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.581024    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:05.597828 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.597803    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c871ba-286b-472b-a388-503d320c8c1c-maas-api-tls\") pod \"63c871ba-286b-472b-a388-503d320c8c1c\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") "
Jul 06 12:48:05.597930 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.597852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c871ba-286b-472b-a388-503d320c8c1c-openshift-service-ca\") pod \"63c871ba-286b-472b-a388-503d320c8c1c\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") "
Jul 06 12:48:05.597930 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.597913    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2vg2\" (UniqueName: \"kubernetes.io/projected/63c871ba-286b-472b-a388-503d320c8c1c-kube-api-access-n2vg2\") pod \"63c871ba-286b-472b-a388-503d320c8c1c\" (UID: \"63c871ba-286b-472b-a388-503d320c8c1c\") "
Jul 06 12:48:05.598238 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.598216    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63c871ba-286b-472b-a388-503d320c8c1c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63c871ba-286b-472b-a388-503d320c8c1c" (UID: "63c871ba-286b-472b-a388-503d320c8c1c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:48:05.599833 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.599800    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c871ba-286b-472b-a388-503d320c8c1c-kube-api-access-n2vg2" (OuterVolumeSpecName: "kube-api-access-n2vg2") pod "63c871ba-286b-472b-a388-503d320c8c1c" (UID: "63c871ba-286b-472b-a388-503d320c8c1c"). InnerVolumeSpecName "kube-api-access-n2vg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:48:05.599914 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.599867    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63c871ba-286b-472b-a388-503d320c8c1c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63c871ba-286b-472b-a388-503d320c8c1c" (UID: "63c871ba-286b-472b-a388-503d320c8c1c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:48:05.698905 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.698867    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c871ba-286b-472b-a388-503d320c8c1c-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:48:05.698905 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.698899    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c871ba-286b-472b-a388-503d320c8c1c-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:48:05.698905 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:05.698908    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2vg2\" (UniqueName: \"kubernetes.io/projected/63c871ba-286b-472b-a388-503d320c8c1c-kube-api-access-n2vg2\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:48:06.335523 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.335489    2565 generic.go:356] "Generic (PLEG): container finished" podID="63c871ba-286b-472b-a388-503d320c8c1c" containerID="385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794" exitCode=0
Jul 06 12:48:06.335993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.335561    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"
Jul 06 12:48:06.335993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.335575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz" event={"ID":"63c871ba-286b-472b-a388-503d320c8c1c","Type":"ContainerDied","Data":"385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794"}
Jul 06 12:48:06.335993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.335641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz" event={"ID":"63c871ba-286b-472b-a388-503d320c8c1c","Type":"ContainerDied","Data":"ff77c80d01c3681b39be741797c7b135bdb74f668873ab6924bd734b47553b94"}
Jul 06 12:48:06.335993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.335674    2565 scope.go:117] "RemoveContainer" containerID="385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794"
Jul 06 12:48:06.346928 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.346905    2565 scope.go:117] "RemoveContainer" containerID="385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794"
Jul 06 12:48:06.347329 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:48:06.347308    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794\": container with ID starting with 385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794 not found: ID does not exist" containerID="385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794"
Jul 06 12:48:06.347395 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.347341    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794"} err="failed to get container status \"385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794\": rpc error: code = NotFound desc = could not find container \"385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794\": container with ID starting with 385001d77739ebba8d8e23f634c22d205a944387596330bce00f835a5064d794 not found: ID does not exist"
Jul 06 12:48:06.355623 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.355600    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"]
Jul 06 12:48:06.360250 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:06.360222    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22175320-5cc678dd87-s8rfz"]
Jul 06 12:48:07.885185 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:07.885154    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63c871ba-286b-472b-a388-503d320c8c1c" path="/var/lib/kubelet/pods/63c871ba-286b-472b-a388-503d320c8c1c/volumes"
Jul 06 12:48:19.654497 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.654454    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"]
Jul 06 12:48:19.655109 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.655087    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c871ba-286b-472b-a388-503d320c8c1c" containerName="maas-api"
Jul 06 12:48:19.655196 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.655112    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c871ba-286b-472b-a388-503d320c8c1c" containerName="maas-api"
Jul 06 12:48:19.655247 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.655210    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c871ba-286b-472b-a388-503d320c8c1c" containerName="maas-api"
Jul 06 12:48:19.659524 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.659504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.662166 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.662148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-15e56f76-serving-cert\""
Jul 06 12:48:19.672819 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.672794    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"]
Jul 06 12:48:19.718067 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.718032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-maas-api-tls\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.718210 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.718071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw9zs\" (UniqueName: \"kubernetes.io/projected/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-kube-api-access-nw9zs\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.718265 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.718215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-openshift-service-ca\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.819679 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.819647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-openshift-service-ca\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.819679 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.819687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-maas-api-tls\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.819915 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.819710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw9zs\" (UniqueName: \"kubernetes.io/projected/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-kube-api-access-nw9zs\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.820465 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.820446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-openshift-service-ca\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.822398 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.822375    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-maas-api-tls\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.831312 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.831286    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw9zs\" (UniqueName: \"kubernetes.io/projected/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-kube-api-access-nw9zs\") pod \"maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:19.970884 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:19.970799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:20.115402 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:20.115377    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"]
Jul 06 12:48:20.117169 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:48:20.117143    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7389d9_d8f9_48ee_b9f3_60fa86940e7c.slice/crio-ee7808e08a578c56382665ba53917adb0626d3f8855a6405990420dd8b7693a4 WatchSource:0}: Error finding container ee7808e08a578c56382665ba53917adb0626d3f8855a6405990420dd8b7693a4: Status 404 returned error can't find the container with id ee7808e08a578c56382665ba53917adb0626d3f8855a6405990420dd8b7693a4
Jul 06 12:48:20.412802 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:20.412770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z" event={"ID":"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c","Type":"ContainerStarted","Data":"ee7808e08a578c56382665ba53917adb0626d3f8855a6405990420dd8b7693a4"}
Jul 06 12:48:21.420061 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:21.420025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z" event={"ID":"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c","Type":"ContainerStarted","Data":"6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7"}
Jul 06 12:48:21.420444 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:21.420119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:21.456038 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:21.455984    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z" podStartSLOduration=2.026678974 podStartE2EDuration="2.455967042s" totalImagesPullingTime="429.288068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:21.455204421 +0000 UTC m=+1548.195395756" watchObservedRunningTime="2026-07-06 12:48:21.455967042 +0000 UTC m=+1548.196158374"
Jul 06 12:48:24.470472 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.470439    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"]
Jul 06 12:48:24.470887 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.470703    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z" podUID="8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" containerName="maas-api" containerID="cri-o://6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7" gracePeriod=30
Jul 06 12:48:24.723052 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.722986    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:24.766778 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.766751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw9zs\" (UniqueName: \"kubernetes.io/projected/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-kube-api-access-nw9zs\") pod \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") "
Jul 06 12:48:24.766927 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.766806    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-openshift-service-ca\") pod \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") "
Jul 06 12:48:24.766927 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.766842    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-maas-api-tls\") pod \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\" (UID: \"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c\") "
Jul 06 12:48:24.767232 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.767201    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" (UID: "8a7389d9-d8f9-48ee-b9f3-60fa86940e7c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:48:24.769043 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.769011    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" (UID: "8a7389d9-d8f9-48ee-b9f3-60fa86940e7c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:48:24.769043 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.769016    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-kube-api-access-nw9zs" (OuterVolumeSpecName: "kube-api-access-nw9zs") pod "8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" (UID: "8a7389d9-d8f9-48ee-b9f3-60fa86940e7c"). InnerVolumeSpecName "kube-api-access-nw9zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:48:24.867728 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.867693    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw9zs\" (UniqueName: \"kubernetes.io/projected/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-kube-api-access-nw9zs\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:48:24.867728 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.867720    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:48:24.867728 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:24.867731    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:48:25.442719 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.442680    2565 generic.go:356] "Generic (PLEG): container finished" podID="8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" containerID="6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7" exitCode=0
Jul 06 12:48:25.442899 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.442739    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"
Jul 06 12:48:25.442899 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.442760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z" event={"ID":"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c","Type":"ContainerDied","Data":"6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7"}
Jul 06 12:48:25.442899 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.442815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z" event={"ID":"8a7389d9-d8f9-48ee-b9f3-60fa86940e7c","Type":"ContainerDied","Data":"ee7808e08a578c56382665ba53917adb0626d3f8855a6405990420dd8b7693a4"}
Jul 06 12:48:25.442899 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.442837    2565 scope.go:117] "RemoveContainer" containerID="6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7"
Jul 06 12:48:25.454886 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.453478    2565 scope.go:117] "RemoveContainer" containerID="6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7"
Jul 06 12:48:25.455188 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:48:25.455168    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7\": container with ID starting with 6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7 not found: ID does not exist" containerID="6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7"
Jul 06 12:48:25.455260 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.455195    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7"} err="failed to get container status \"6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7\": rpc error: code = NotFound desc = could not find container \"6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7\": container with ID starting with 6883984ef876a19222635d5407a6e834989dc9e5a9edcfdea3930032089882a7 not found: ID does not exist"
Jul 06 12:48:25.479658 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.479635    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"]
Jul 06 12:48:25.492253 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.492233    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-15e56f76-fbb5f6f4c-wzs9z"]
Jul 06 12:48:25.884818 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:48:25.884783    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" path="/var/lib/kubelet/pods/8a7389d9-d8f9-48ee-b9f3-60fa86940e7c/volumes"
Jul 06 12:50:12.946072 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.946041    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"]
Jul 06 12:50:12.946605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.946433    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" containerName="maas-api"
Jul 06 12:50:12.946605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.946444    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" containerName="maas-api"
Jul 06 12:50:12.946605 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.946538    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a7389d9-d8f9-48ee-b9f3-60fa86940e7c" containerName="maas-api"
Jul 06 12:50:12.949580 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.949562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:12.954083 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.954061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-75df4d48-serving-cert\""
Jul 06 12:50:12.964520 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.964495    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"]
Jul 06 12:50:12.999493 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.999467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzgn\" (UniqueName: \"kubernetes.io/projected/4eead70b-3887-45ad-b6f4-d9b8f492fd58-kube-api-access-zrzgn\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:12.999670 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.999500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4eead70b-3887-45ad-b6f4-d9b8f492fd58-openshift-service-ca\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:12.999670 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:12.999641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.100282 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.100241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzgn\" (UniqueName: \"kubernetes.io/projected/4eead70b-3887-45ad-b6f4-d9b8f492fd58-kube-api-access-zrzgn\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.100457 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.100290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4eead70b-3887-45ad-b6f4-d9b8f492fd58-openshift-service-ca\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.100457 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.100354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.100578 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:50:13.100482    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-serving-cert: secret "maas-api-e2e-mt-75df4d48-serving-cert" not found
Jul 06 12:50:13.100578 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:50:13.100575    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls podName:4eead70b-3887-45ad-b6f4-d9b8f492fd58 nodeName:}" failed. No retries permitted until 2026-07-06 12:50:13.60055471 +0000 UTC m=+1660.340746036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls") pod "maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk" (UID: "4eead70b-3887-45ad-b6f4-d9b8f492fd58") : secret "maas-api-e2e-mt-75df4d48-serving-cert" not found
Jul 06 12:50:13.100960 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.100938    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4eead70b-3887-45ad-b6f4-d9b8f492fd58-openshift-service-ca\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.121450 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.121423    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzgn\" (UniqueName: \"kubernetes.io/projected/4eead70b-3887-45ad-b6f4-d9b8f492fd58-kube-api-access-zrzgn\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.606464 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.606431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.608981 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.608958    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls\") pod \"maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:13.860761 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:13.860672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:14.018667 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:14.018642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"]
Jul 06 12:50:14.020021 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:50:14.019994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eead70b_3887_45ad_b6f4_d9b8f492fd58.slice/crio-8784911277b191e6238ebbb1d9132afb1f733d0e828fba36ec04a1d125b6e761 WatchSource:0}: Error finding container 8784911277b191e6238ebbb1d9132afb1f733d0e828fba36ec04a1d125b6e761: Status 404 returned error can't find the container with id 8784911277b191e6238ebbb1d9132afb1f733d0e828fba36ec04a1d125b6e761
Jul 06 12:50:14.021435 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:14.021413    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:50:14.044400 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:14.044361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk" event={"ID":"4eead70b-3887-45ad-b6f4-d9b8f492fd58","Type":"ContainerStarted","Data":"8784911277b191e6238ebbb1d9132afb1f733d0e828fba36ec04a1d125b6e761"}
Jul 06 12:50:15.051317 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:15.051283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk" event={"ID":"4eead70b-3887-45ad-b6f4-d9b8f492fd58","Type":"ContainerStarted","Data":"c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e"}
Jul 06 12:50:15.051722 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:15.051414    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:15.076062 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:15.076017    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk" podStartSLOduration=2.674088686 podStartE2EDuration="3.076002309s" totalImagesPullingTime="401.913623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:50:15.073519819 +0000 UTC m=+1661.813711150" watchObservedRunningTime="2026-07-06 12:50:15.076002309 +0000 UTC m=+1661.816193641"
Jul 06 12:50:21.063134 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:21.063105    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:25.581545 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.581487    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"]
Jul 06 12:50:25.581952 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.581787    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk" podUID="4eead70b-3887-45ad-b6f4-d9b8f492fd58" containerName="maas-api" containerID="cri-o://c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e" gracePeriod=30
Jul 06 12:50:25.842225 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.842167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:25.916848 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.916820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrzgn\" (UniqueName: \"kubernetes.io/projected/4eead70b-3887-45ad-b6f4-d9b8f492fd58-kube-api-access-zrzgn\") pod \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") "
Jul 06 12:50:25.917027 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.916884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4eead70b-3887-45ad-b6f4-d9b8f492fd58-openshift-service-ca\") pod \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") "
Jul 06 12:50:25.917093 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.917073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls\") pod \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\" (UID: \"4eead70b-3887-45ad-b6f4-d9b8f492fd58\") "
Jul 06 12:50:25.917277 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.917250    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eead70b-3887-45ad-b6f4-d9b8f492fd58-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4eead70b-3887-45ad-b6f4-d9b8f492fd58" (UID: "4eead70b-3887-45ad-b6f4-d9b8f492fd58"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:50:25.917365 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.917342    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4eead70b-3887-45ad-b6f4-d9b8f492fd58-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:50:25.918879 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.918853    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4eead70b-3887-45ad-b6f4-d9b8f492fd58" (UID: "4eead70b-3887-45ad-b6f4-d9b8f492fd58"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:50:25.919006 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:25.918990    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eead70b-3887-45ad-b6f4-d9b8f492fd58-kube-api-access-zrzgn" (OuterVolumeSpecName: "kube-api-access-zrzgn") pod "4eead70b-3887-45ad-b6f4-d9b8f492fd58" (UID: "4eead70b-3887-45ad-b6f4-d9b8f492fd58"). InnerVolumeSpecName "kube-api-access-zrzgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:50:26.019928 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.019893    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4eead70b-3887-45ad-b6f4-d9b8f492fd58-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:50:26.020145 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.020129    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrzgn\" (UniqueName: \"kubernetes.io/projected/4eead70b-3887-45ad-b6f4-d9b8f492fd58-kube-api-access-zrzgn\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:50:26.117053 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.116968    2565 generic.go:356] "Generic (PLEG): container finished" podID="4eead70b-3887-45ad-b6f4-d9b8f492fd58" containerID="c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e" exitCode=0
Jul 06 12:50:26.117053 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.117013    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"
Jul 06 12:50:26.117265 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.117058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk" event={"ID":"4eead70b-3887-45ad-b6f4-d9b8f492fd58","Type":"ContainerDied","Data":"c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e"}
Jul 06 12:50:26.117265 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.117117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk" event={"ID":"4eead70b-3887-45ad-b6f4-d9b8f492fd58","Type":"ContainerDied","Data":"8784911277b191e6238ebbb1d9132afb1f733d0e828fba36ec04a1d125b6e761"}
Jul 06 12:50:26.117265 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.117147    2565 scope.go:117] "RemoveContainer" containerID="c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e"
Jul 06 12:50:26.127337 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.127317    2565 scope.go:117] "RemoveContainer" containerID="c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e"
Jul 06 12:50:26.127633 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:50:26.127613    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e\": container with ID starting with c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e not found: ID does not exist" containerID="c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e"
Jul 06 12:50:26.127689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.127642    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e"} err="failed to get container status \"c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e\": rpc error: code = NotFound desc = could not find container \"c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e\": container with ID starting with c3d24392c515015d70a35ecce02a4b85d061d354ae338029cdc5f498db70f38e not found: ID does not exist"
Jul 06 12:50:26.143322 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.143296    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"]
Jul 06 12:50:26.146327 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:26.146309    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-75df4d48-7dd76f784d-kpzdk"]
Jul 06 12:50:27.886145 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:27.886116    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eead70b-3887-45ad-b6f4-d9b8f492fd58" path="/var/lib/kubelet/pods/4eead70b-3887-45ad-b6f4-d9b8f492fd58/volumes"
Jul 06 12:50:55.026448 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.026417    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"]
Jul 06 12:50:55.028794 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.026890    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eead70b-3887-45ad-b6f4-d9b8f492fd58" containerName="maas-api"
Jul 06 12:50:55.028794 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.026908    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eead70b-3887-45ad-b6f4-d9b8f492fd58" containerName="maas-api"
Jul 06 12:50:55.028794 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.026989    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eead70b-3887-45ad-b6f4-d9b8f492fd58" containerName="maas-api"
Jul 06 12:50:55.030082 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.030066    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.038366 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.038350    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0113cf1b-serving-cert\""
Jul 06 12:50:55.046018 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.045994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"]
Jul 06 12:50:55.082502 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.082451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0602fd7-45c5-4f7a-a659-921bd1963bf0-maas-api-tls\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.082502 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.082491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0602fd7-45c5-4f7a-a659-921bd1963bf0-openshift-service-ca\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.082734 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.082602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrw2t\" (UniqueName: \"kubernetes.io/projected/b0602fd7-45c5-4f7a-a659-921bd1963bf0-kube-api-access-jrw2t\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.183233 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.183191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrw2t\" (UniqueName: \"kubernetes.io/projected/b0602fd7-45c5-4f7a-a659-921bd1963bf0-kube-api-access-jrw2t\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.183423 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.183280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0602fd7-45c5-4f7a-a659-921bd1963bf0-maas-api-tls\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.183423 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.183302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0602fd7-45c5-4f7a-a659-921bd1963bf0-openshift-service-ca\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.184065 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.184046    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0602fd7-45c5-4f7a-a659-921bd1963bf0-openshift-service-ca\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.185803 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.185781    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0602fd7-45c5-4f7a-a659-921bd1963bf0-maas-api-tls\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.202591 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.202569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrw2t\" (UniqueName: \"kubernetes.io/projected/b0602fd7-45c5-4f7a-a659-921bd1963bf0-kube-api-access-jrw2t\") pod \"maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.340690 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.340649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:55.481993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:55.481968    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"]
Jul 06 12:50:55.483498 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:50:55.483473    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0602fd7_45c5_4f7a_a659_921bd1963bf0.slice/crio-caee3c7050bcc88287655ea062fb3a693cf0826e84fb7b6bb381431024aa888f WatchSource:0}: Error finding container caee3c7050bcc88287655ea062fb3a693cf0826e84fb7b6bb381431024aa888f: Status 404 returned error can't find the container with id caee3c7050bcc88287655ea062fb3a693cf0826e84fb7b6bb381431024aa888f
Jul 06 12:50:56.288007 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:56.287883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh" event={"ID":"b0602fd7-45c5-4f7a-a659-921bd1963bf0","Type":"ContainerStarted","Data":"7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a"}
Jul 06 12:50:56.288007 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:56.287943    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh" event={"ID":"b0602fd7-45c5-4f7a-a659-921bd1963bf0","Type":"ContainerStarted","Data":"caee3c7050bcc88287655ea062fb3a693cf0826e84fb7b6bb381431024aa888f"}
Jul 06 12:50:56.288511 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:56.288110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:50:56.332770 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:50:56.332725    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh" podStartSLOduration=2.000543311 podStartE2EDuration="2.332709829s" totalImagesPullingTime="332.166518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:50:56.327786134 +0000 UTC m=+1703.067977467" watchObservedRunningTime="2026-07-06 12:50:56.332709829 +0000 UTC m=+1703.072901178"
Jul 06 12:51:02.299456 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:02.299423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:51:32.220272 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.220238    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"]
Jul 06 12:51:32.220829 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.220499    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh" podUID="b0602fd7-45c5-4f7a-a659-921bd1963bf0" containerName="maas-api" containerID="cri-o://7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a" gracePeriod=30
Jul 06 12:51:32.293714 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.293676    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh" podUID="b0602fd7-45c5-4f7a-a659-921bd1963bf0" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.56:8443/health\": dial tcp 10.132.0.56:8443: connect: connection refused"
Jul 06 12:51:32.475518 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.475463    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:51:32.501908 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.501877    2565 generic.go:356] "Generic (PLEG): container finished" podID="b0602fd7-45c5-4f7a-a659-921bd1963bf0" containerID="7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a" exitCode=0
Jul 06 12:51:32.502045 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.501928    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"
Jul 06 12:51:32.502045 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.501942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh" event={"ID":"b0602fd7-45c5-4f7a-a659-921bd1963bf0","Type":"ContainerDied","Data":"7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a"}
Jul 06 12:51:32.502045 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.501989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh" event={"ID":"b0602fd7-45c5-4f7a-a659-921bd1963bf0","Type":"ContainerDied","Data":"caee3c7050bcc88287655ea062fb3a693cf0826e84fb7b6bb381431024aa888f"}
Jul 06 12:51:32.502045 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.502015    2565 scope.go:117] "RemoveContainer" containerID="7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a"
Jul 06 12:51:32.503225 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.503206    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrw2t\" (UniqueName: \"kubernetes.io/projected/b0602fd7-45c5-4f7a-a659-921bd1963bf0-kube-api-access-jrw2t\") pod \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") "
Jul 06 12:51:32.503304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.503252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0602fd7-45c5-4f7a-a659-921bd1963bf0-maas-api-tls\") pod \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") "
Jul 06 12:51:32.503304 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.503278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0602fd7-45c5-4f7a-a659-921bd1963bf0-openshift-service-ca\") pod \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\" (UID: \"b0602fd7-45c5-4f7a-a659-921bd1963bf0\") "
Jul 06 12:51:32.503763 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.503734    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0602fd7-45c5-4f7a-a659-921bd1963bf0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0602fd7-45c5-4f7a-a659-921bd1963bf0" (UID: "b0602fd7-45c5-4f7a-a659-921bd1963bf0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:51:32.505830 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.505801    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0602fd7-45c5-4f7a-a659-921bd1963bf0-kube-api-access-jrw2t" (OuterVolumeSpecName: "kube-api-access-jrw2t") pod "b0602fd7-45c5-4f7a-a659-921bd1963bf0" (UID: "b0602fd7-45c5-4f7a-a659-921bd1963bf0"). InnerVolumeSpecName "kube-api-access-jrw2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:51:32.505930 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.505873    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0602fd7-45c5-4f7a-a659-921bd1963bf0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0602fd7-45c5-4f7a-a659-921bd1963bf0" (UID: "b0602fd7-45c5-4f7a-a659-921bd1963bf0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:51:32.523705 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.523686    2565 scope.go:117] "RemoveContainer" containerID="7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a"
Jul 06 12:51:32.523981 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:51:32.523961    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a\": container with ID starting with 7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a not found: ID does not exist" containerID="7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a"
Jul 06 12:51:32.524045 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.523991    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a"} err="failed to get container status \"7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a\": rpc error: code = NotFound desc = could not find container \"7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a\": container with ID starting with 7e645ba22cf2e7b3ea13a48c4caf0749ca44aab6f86f236fadfd171b2b69421a not found: ID does not exist"
Jul 06 12:51:32.604883 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.604850    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrw2t\" (UniqueName: \"kubernetes.io/projected/b0602fd7-45c5-4f7a-a659-921bd1963bf0-kube-api-access-jrw2t\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:51:32.604883 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.604879    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0602fd7-45c5-4f7a-a659-921bd1963bf0-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:51:32.604883 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.604889    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0602fd7-45c5-4f7a-a659-921bd1963bf0-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:51:32.823950 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.823921    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"]
Jul 06 12:51:32.827559 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:32.827517    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0113cf1b-75b6c4b5c-hcgfh"]
Jul 06 12:51:33.885484 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:51:33.885444    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0602fd7-45c5-4f7a-a659-921bd1963bf0" path="/var/lib/kubelet/pods/b0602fd7-45c5-4f7a-a659-921bd1963bf0/volumes"
Jul 06 12:52:33.845689 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:52:33.845661    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:52:33.853215 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:52:33.853192    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:53:41.886393 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:41.886363    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"]
Jul 06 12:53:41.886878 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:41.886764    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0602fd7-45c5-4f7a-a659-921bd1963bf0" containerName="maas-api"
Jul 06 12:53:41.886878 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:41.886778    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0602fd7-45c5-4f7a-a659-921bd1963bf0" containerName="maas-api"
Jul 06 12:53:41.886878 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:41.886857    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0602fd7-45c5-4f7a-a659-921bd1963bf0" containerName="maas-api"
Jul 06 12:53:41.889817 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:41.889801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:41.897193 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:41.897171    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-86ab8b-serving-cert\""
Jul 06 12:53:41.905687 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:41.905663    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"]
Jul 06 12:53:42.029537 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.029493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.029724 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.029639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-maas-api-tls\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.029796 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.029734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnnnb\" (UniqueName: \"kubernetes.io/projected/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-kube-api-access-xnnnb\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.130473 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.130439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-maas-api-tls\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.130625 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.130490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnnnb\" (UniqueName: \"kubernetes.io/projected/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-kube-api-access-xnnnb\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.130625 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.130578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.131263 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.131245    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.133072 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.133053    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-maas-api-tls\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.199451 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.199391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnnnb\" (UniqueName: \"kubernetes.io/projected/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-kube-api-access-xnnnb\") pod \"maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.203175 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.203155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:42.345602 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:42.345575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"]
Jul 06 12:53:42.347479 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:53:42.347456    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c315e5a_47d4_4427_b4b4_e0310cfe84e8.slice/crio-fd77795f7261e1ad95a77281158bb0ccb473b81544c43cb1b6a2aad12c705a10 WatchSource:0}: Error finding container fd77795f7261e1ad95a77281158bb0ccb473b81544c43cb1b6a2aad12c705a10: Status 404 returned error can't find the container with id fd77795f7261e1ad95a77281158bb0ccb473b81544c43cb1b6a2aad12c705a10
Jul 06 12:53:43.236417 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:43.236320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2" event={"ID":"4c315e5a-47d4-4427-b4b4-e0310cfe84e8","Type":"ContainerStarted","Data":"3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3"}
Jul 06 12:53:43.236793 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:43.236424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2" event={"ID":"4c315e5a-47d4-4427-b4b4-e0310cfe84e8","Type":"ContainerStarted","Data":"fd77795f7261e1ad95a77281158bb0ccb473b81544c43cb1b6a2aad12c705a10"}
Jul 06 12:53:43.236793 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:43.236477    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:43.257069 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:43.257024    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2" podStartSLOduration=1.7264222999999999 podStartE2EDuration="2.257008875s" totalImagesPullingTime="530.586575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:53:43.255085477 +0000 UTC m=+1869.995276815" watchObservedRunningTime="2026-07-06 12:53:43.257008875 +0000 UTC m=+1869.997200208"
Jul 06 12:53:49.246837 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.246810    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:53:49.746972 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.746932    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"]
Jul 06 12:53:49.751376 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.751354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:49.753912 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.753893    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c5c936-serving-cert\""
Jul 06 12:53:49.763815 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.763794    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"]
Jul 06 12:53:49.901123 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.901086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbml\" (UniqueName: \"kubernetes.io/projected/39950873-ff53-4392-8bbd-60458159fb38-kube-api-access-wbbml\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:49.901123 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.901119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39950873-ff53-4392-8bbd-60458159fb38-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:49.901328 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:49.901236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39950873-ff53-4392-8bbd-60458159fb38-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.002369 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.002293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbml\" (UniqueName: \"kubernetes.io/projected/39950873-ff53-4392-8bbd-60458159fb38-kube-api-access-wbbml\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.002369 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.002332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39950873-ff53-4392-8bbd-60458159fb38-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.002571 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.002447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39950873-ff53-4392-8bbd-60458159fb38-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.002998 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.002977    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39950873-ff53-4392-8bbd-60458159fb38-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.004785 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.004765    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39950873-ff53-4392-8bbd-60458159fb38-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.017104 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.017083    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbml\" (UniqueName: \"kubernetes.io/projected/39950873-ff53-4392-8bbd-60458159fb38-kube-api-access-wbbml\") pod \"maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.063059 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.063028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:50.209066 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.209032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"]
Jul 06 12:53:50.210024 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:53:50.209994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39950873_ff53_4392_8bbd_60458159fb38.slice/crio-81cd4b9d583804ae8e3b092e18e80c120b04e45de16203159b945c92a4ace390 WatchSource:0}: Error finding container 81cd4b9d583804ae8e3b092e18e80c120b04e45de16203159b945c92a4ace390: Status 404 returned error can't find the container with id 81cd4b9d583804ae8e3b092e18e80c120b04e45de16203159b945c92a4ace390
Jul 06 12:53:50.279306 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:50.279220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm" event={"ID":"39950873-ff53-4392-8bbd-60458159fb38","Type":"ContainerStarted","Data":"81cd4b9d583804ae8e3b092e18e80c120b04e45de16203159b945c92a4ace390"}
Jul 06 12:53:51.287142 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:51.287103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm" event={"ID":"39950873-ff53-4392-8bbd-60458159fb38","Type":"ContainerStarted","Data":"26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027"}
Jul 06 12:53:51.287562 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:51.287174    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:53:51.308977 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:51.308932    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm" podStartSLOduration=1.8875963759999999 podStartE2EDuration="2.308913371s" totalImagesPullingTime="421.316995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:53:51.30727027 +0000 UTC m=+1878.047461627" watchObservedRunningTime="2026-07-06 12:53:51.308913371 +0000 UTC m=+1878.049104704"
Jul 06 12:53:57.298693 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:53:57.298615    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:54:33.933177 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:33.933138    2565 scope.go:117] "RemoveContainer" containerID="911735153b3d9da68f20f6419f1727e614668b8001befbe8f386627d42ec6143"
Jul 06 12:54:44.697804 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:44.697769    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"]
Jul 06 12:54:44.698244 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:44.697987    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2" podUID="4c315e5a-47d4-4427-b4b4-e0310cfe84e8" containerName="maas-api" containerID="cri-o://3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3" gracePeriod=30
Jul 06 12:54:44.955326 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:44.955266    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:54:45.089850 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.089818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-maas-api-tls\") pod \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") "
Jul 06 12:54:45.090012 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.089910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-openshift-service-ca\") pod \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") "
Jul 06 12:54:45.090012 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.089988    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnnnb\" (UniqueName: \"kubernetes.io/projected/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-kube-api-access-xnnnb\") pod \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\" (UID: \"4c315e5a-47d4-4427-b4b4-e0310cfe84e8\") "
Jul 06 12:54:45.090300 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.090272    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c315e5a-47d4-4427-b4b4-e0310cfe84e8" (UID: "4c315e5a-47d4-4427-b4b4-e0310cfe84e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:54:45.091891 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.091864    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c315e5a-47d4-4427-b4b4-e0310cfe84e8" (UID: "4c315e5a-47d4-4427-b4b4-e0310cfe84e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:54:45.091993 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.091946    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-kube-api-access-xnnnb" (OuterVolumeSpecName: "kube-api-access-xnnnb") pod "4c315e5a-47d4-4427-b4b4-e0310cfe84e8" (UID: "4c315e5a-47d4-4427-b4b4-e0310cfe84e8"). InnerVolumeSpecName "kube-api-access-xnnnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:54:45.190947 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.190914    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:54:45.190947 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.190941    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnnnb\" (UniqueName: \"kubernetes.io/projected/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-kube-api-access-xnnnb\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:54:45.190947 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.190952    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c315e5a-47d4-4427-b4b4-e0310cfe84e8-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:54:45.608269 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.608225    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c315e5a-47d4-4427-b4b4-e0310cfe84e8" containerID="3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3" exitCode=0
Jul 06 12:54:45.608466 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.608276    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"
Jul 06 12:54:45.608466 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.608320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2" event={"ID":"4c315e5a-47d4-4427-b4b4-e0310cfe84e8","Type":"ContainerDied","Data":"3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3"}
Jul 06 12:54:45.608466 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.608385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2" event={"ID":"4c315e5a-47d4-4427-b4b4-e0310cfe84e8","Type":"ContainerDied","Data":"fd77795f7261e1ad95a77281158bb0ccb473b81544c43cb1b6a2aad12c705a10"}
Jul 06 12:54:45.608466 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.608427    2565 scope.go:117] "RemoveContainer" containerID="3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3"
Jul 06 12:54:45.617678 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.617659    2565 scope.go:117] "RemoveContainer" containerID="3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3"
Jul 06 12:54:45.617945 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:54:45.617928    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3\": container with ID starting with 3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3 not found: ID does not exist" containerID="3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3"
Jul 06 12:54:45.618008 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.617952    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3"} err="failed to get container status \"3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3\": rpc error: code = NotFound desc = could not find container \"3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3\": container with ID starting with 3dabfd5b75370c6453b1e41289f09e95cd3eb1e3028d7e423b2a89a5caf953e3 not found: ID does not exist"
Jul 06 12:54:45.635600 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.635578    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"]
Jul 06 12:54:45.639157 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.639139    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-86ab8b-76ffb6bb7f-fq4m2"]
Jul 06 12:54:45.885458 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:54:45.885387    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c315e5a-47d4-4427-b4b4-e0310cfe84e8" path="/var/lib/kubelet/pods/4c315e5a-47d4-4427-b4b4-e0310cfe84e8/volumes"
Jul 06 12:55:28.180381 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:28.180290    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"]
Jul 06 12:55:28.180880 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:28.180506    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm" podUID="39950873-ff53-4392-8bbd-60458159fb38" containerName="maas-api" containerID="cri-o://26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027" gracePeriod=30
Jul 06 12:55:29.535670 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.535645    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:55:29.665967 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.665935    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39950873-ff53-4392-8bbd-60458159fb38-openshift-service-ca\") pod \"39950873-ff53-4392-8bbd-60458159fb38\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") "
Jul 06 12:55:29.666140 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.666038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39950873-ff53-4392-8bbd-60458159fb38-maas-api-tls\") pod \"39950873-ff53-4392-8bbd-60458159fb38\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") "
Jul 06 12:55:29.666140 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.666105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbbml\" (UniqueName: \"kubernetes.io/projected/39950873-ff53-4392-8bbd-60458159fb38-kube-api-access-wbbml\") pod \"39950873-ff53-4392-8bbd-60458159fb38\" (UID: \"39950873-ff53-4392-8bbd-60458159fb38\") "
Jul 06 12:55:29.666294 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.666270    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39950873-ff53-4392-8bbd-60458159fb38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39950873-ff53-4392-8bbd-60458159fb38" (UID: "39950873-ff53-4392-8bbd-60458159fb38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:55:29.666368 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.666356    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39950873-ff53-4392-8bbd-60458159fb38-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:55:29.668116 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.668089    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39950873-ff53-4392-8bbd-60458159fb38-kube-api-access-wbbml" (OuterVolumeSpecName: "kube-api-access-wbbml") pod "39950873-ff53-4392-8bbd-60458159fb38" (UID: "39950873-ff53-4392-8bbd-60458159fb38"). InnerVolumeSpecName "kube-api-access-wbbml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:55:29.668116 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.668106    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39950873-ff53-4392-8bbd-60458159fb38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39950873-ff53-4392-8bbd-60458159fb38" (UID: "39950873-ff53-4392-8bbd-60458159fb38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:55:29.767454 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.767427    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbbml\" (UniqueName: \"kubernetes.io/projected/39950873-ff53-4392-8bbd-60458159fb38-kube-api-access-wbbml\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:55:29.767454 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.767451    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39950873-ff53-4392-8bbd-60458159fb38-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:55:29.865599 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.865563    2565 generic.go:356] "Generic (PLEG): container finished" podID="39950873-ff53-4392-8bbd-60458159fb38" containerID="26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027" exitCode=0
Jul 06 12:55:29.865746 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.865640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm" event={"ID":"39950873-ff53-4392-8bbd-60458159fb38","Type":"ContainerDied","Data":"26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027"}
Jul 06 12:55:29.865746 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.865677    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"
Jul 06 12:55:29.865746 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.865730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm" event={"ID":"39950873-ff53-4392-8bbd-60458159fb38","Type":"ContainerDied","Data":"81cd4b9d583804ae8e3b092e18e80c120b04e45de16203159b945c92a4ace390"}
Jul 06 12:55:29.865854 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.865763    2565 scope.go:117] "RemoveContainer" containerID="26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027"
Jul 06 12:55:29.875551 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.875517    2565 scope.go:117] "RemoveContainer" containerID="26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027"
Jul 06 12:55:29.875801 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:55:29.875782    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027\": container with ID starting with 26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027 not found: ID does not exist" containerID="26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027"
Jul 06 12:55:29.875868 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.875806    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027"} err="failed to get container status \"26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027\": rpc error: code = NotFound desc = could not find container \"26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027\": container with ID starting with 26960a77d5e293ee0b1bd09c0c1e77d7091e4390356c0dca936dc6edf13fe027 not found: ID does not exist"
Jul 06 12:55:29.889633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.889609    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"]
Jul 06 12:55:29.891794 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:29.891775    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5c936-6644b4844-lt7lm"]
Jul 06 12:55:31.885325 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:31.885291    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39950873-ff53-4392-8bbd-60458159fb38" path="/var/lib/kubelet/pods/39950873-ff53-4392-8bbd-60458159fb38/volumes"
Jul 06 12:55:38.307451 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.307413    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"]
Jul 06 12:55:38.307946 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.307829    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39950873-ff53-4392-8bbd-60458159fb38" containerName="maas-api"
Jul 06 12:55:38.307946 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.307840    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="39950873-ff53-4392-8bbd-60458159fb38" containerName="maas-api"
Jul 06 12:55:38.307946 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.307855    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c315e5a-47d4-4427-b4b4-e0310cfe84e8" containerName="maas-api"
Jul 06 12:55:38.307946 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.307860    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c315e5a-47d4-4427-b4b4-e0310cfe84e8" containerName="maas-api"
Jul 06 12:55:38.307946 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.307930    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="39950873-ff53-4392-8bbd-60458159fb38" containerName="maas-api"
Jul 06 12:55:38.307946 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.307938    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c315e5a-47d4-4427-b4b4-e0310cfe84e8" containerName="maas-api"
Jul 06 12:55:38.311089 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.311068    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.314083 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.314061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b84121-serving-cert\""
Jul 06 12:55:38.325117 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.325092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"]
Jul 06 12:55:38.442018 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.441978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.442212 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.442033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7d5938-01c6-4eb6-b4d0-63758b412291-openshift-service-ca\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.442212 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.442103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ncfr\" (UniqueName: \"kubernetes.io/projected/2b7d5938-01c6-4eb6-b4d0-63758b412291-kube-api-access-4ncfr\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.543711 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.543668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.543903 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.543751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7d5938-01c6-4eb6-b4d0-63758b412291-openshift-service-ca\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.543903 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.543781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ncfr\" (UniqueName: \"kubernetes.io/projected/2b7d5938-01c6-4eb6-b4d0-63758b412291-kube-api-access-4ncfr\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.543903 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:55:38.543855    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-serving-cert: secret "maas-api-e2e-api-a-b84121-serving-cert" not found
Jul 06 12:55:38.544023 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:55:38.543936    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls podName:2b7d5938-01c6-4eb6-b4d0-63758b412291 nodeName:}" failed. No retries permitted until 2026-07-06 12:55:39.043915301 +0000 UTC m=+1985.784106616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls") pod "maas-api-e2e-api-a-b84121-99d78d6df-lx2lz" (UID: "2b7d5938-01c6-4eb6-b4d0-63758b412291") : secret "maas-api-e2e-api-a-b84121-serving-cert" not found
Jul 06 12:55:38.544417 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.544400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7d5938-01c6-4eb6-b4d0-63758b412291-openshift-service-ca\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:38.553352 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:38.553321    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ncfr\" (UniqueName: \"kubernetes.io/projected/2b7d5938-01c6-4eb6-b4d0-63758b412291-kube-api-access-4ncfr\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:39.048172 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.048134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:39.050751 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.050726    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls\") pod \"maas-api-e2e-api-a-b84121-99d78d6df-lx2lz\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:39.221673 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.221635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:39.369548 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.369494    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"]
Jul 06 12:55:39.369977 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:55:39.369939    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7d5938_01c6_4eb6_b4d0_63758b412291.slice/crio-be19755930eb0941c7f02eab61f38f9a6527866f361e40a5bc8e9fa4bda4c744 WatchSource:0}: Error finding container be19755930eb0941c7f02eab61f38f9a6527866f361e40a5bc8e9fa4bda4c744: Status 404 returned error can't find the container with id be19755930eb0941c7f02eab61f38f9a6527866f361e40a5bc8e9fa4bda4c744
Jul 06 12:55:39.371399 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.371380    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:55:39.924050 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.924013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz" event={"ID":"2b7d5938-01c6-4eb6-b4d0-63758b412291","Type":"ContainerStarted","Data":"9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4"}
Jul 06 12:55:39.924239 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.924068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz" event={"ID":"2b7d5938-01c6-4eb6-b4d0-63758b412291","Type":"ContainerStarted","Data":"be19755930eb0941c7f02eab61f38f9a6527866f361e40a5bc8e9fa4bda4c744"}
Jul 06 12:55:39.924239 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.924125    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:39.945243 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:39.945188    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz" podStartSLOduration=1.49946518 podStartE2EDuration="1.945169954s" totalImagesPullingTime="445.704774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:39.94343101 +0000 UTC m=+1986.683622343" watchObservedRunningTime="2026-07-06 12:55:39.945169954 +0000 UTC m=+1986.685361286"
Jul 06 12:55:45.936188 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:45.936161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:55:47.515707 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.515666    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"]
Jul 06 12:55:47.519482 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.519465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.521604 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.521585    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4a355b-serving-cert\""
Jul 06 12:55:47.534885 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.534861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"]
Jul 06 12:55:47.627607 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.627562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdnnb\" (UniqueName: \"kubernetes.io/projected/16218f2c-48ea-4df9-8325-59ecf0229bd4-kube-api-access-rdnnb\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.627607 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.627603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16218f2c-48ea-4df9-8325-59ecf0229bd4-openshift-service-ca\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.627857 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.627620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.729074 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.729034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdnnb\" (UniqueName: \"kubernetes.io/projected/16218f2c-48ea-4df9-8325-59ecf0229bd4-kube-api-access-rdnnb\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.729074 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.729073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16218f2c-48ea-4df9-8325-59ecf0229bd4-openshift-service-ca\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.729293 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.729090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.729293 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:55:47.729193    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-serving-cert: secret "maas-api-e2e-api-b-4a355b-serving-cert" not found
Jul 06 12:55:47.729293 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:55:47.729256    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls podName:16218f2c-48ea-4df9-8325-59ecf0229bd4 nodeName:}" failed. No retries permitted until 2026-07-06 12:55:48.229241168 +0000 UTC m=+1994.969432479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls") pod "maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj" (UID: "16218f2c-48ea-4df9-8325-59ecf0229bd4") : secret "maas-api-e2e-api-b-4a355b-serving-cert" not found
Jul 06 12:55:47.729943 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.729920    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16218f2c-48ea-4df9-8325-59ecf0229bd4-openshift-service-ca\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:47.740085 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:47.740051    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdnnb\" (UniqueName: \"kubernetes.io/projected/16218f2c-48ea-4df9-8325-59ecf0229bd4-kube-api-access-rdnnb\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:48.234991 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:48.234957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:48.237436 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:48.237413    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls\") pod \"maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:48.430641 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:48.430605    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:48.577921 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:48.577847    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"]
Jul 06 12:55:48.580452 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:55:48.580423    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16218f2c_48ea_4df9_8325_59ecf0229bd4.slice/crio-9181e9f19b0ae1bfb7225d9165adbbff846347e5f6168a4100abfe30a886e355 WatchSource:0}: Error finding container 9181e9f19b0ae1bfb7225d9165adbbff846347e5f6168a4100abfe30a886e355: Status 404 returned error can't find the container with id 9181e9f19b0ae1bfb7225d9165adbbff846347e5f6168a4100abfe30a886e355
Jul 06 12:55:48.974433 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:48.974398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj" event={"ID":"16218f2c-48ea-4df9-8325-59ecf0229bd4","Type":"ContainerStarted","Data":"9181e9f19b0ae1bfb7225d9165adbbff846347e5f6168a4100abfe30a886e355"}
Jul 06 12:55:49.981882 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:49.981844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj" event={"ID":"16218f2c-48ea-4df9-8325-59ecf0229bd4","Type":"ContainerStarted","Data":"c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494"}
Jul 06 12:55:49.982276 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:49.981974    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:55:50.003326 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:50.003280    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj" podStartSLOduration=2.653846901 podStartE2EDuration="3.003266441s" totalImagesPullingTime="349.41954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:50.000835944 +0000 UTC m=+1996.741027320" watchObservedRunningTime="2026-07-06 12:55:50.003266441 +0000 UTC m=+1996.743457774"
Jul 06 12:55:55.992667 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:55:55.992641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:56:00.941266 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:00.941231    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"]
Jul 06 12:56:00.941735 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:00.941487    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz" podUID="2b7d5938-01c6-4eb6-b4d0-63758b412291" containerName="maas-api" containerID="cri-o://9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4" gracePeriod=30
Jul 06 12:56:01.195018 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.194965    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:56:01.228494 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.228468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7d5938-01c6-4eb6-b4d0-63758b412291-openshift-service-ca\") pod \"2b7d5938-01c6-4eb6-b4d0-63758b412291\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") "
Jul 06 12:56:01.228645 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.228524    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ncfr\" (UniqueName: \"kubernetes.io/projected/2b7d5938-01c6-4eb6-b4d0-63758b412291-kube-api-access-4ncfr\") pod \"2b7d5938-01c6-4eb6-b4d0-63758b412291\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") "
Jul 06 12:56:01.228694 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.228666    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls\") pod \"2b7d5938-01c6-4eb6-b4d0-63758b412291\" (UID: \"2b7d5938-01c6-4eb6-b4d0-63758b412291\") "
Jul 06 12:56:01.228871 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.228850    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7d5938-01c6-4eb6-b4d0-63758b412291-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b7d5938-01c6-4eb6-b4d0-63758b412291" (UID: "2b7d5938-01c6-4eb6-b4d0-63758b412291"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:01.228964 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.228911    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7d5938-01c6-4eb6-b4d0-63758b412291-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:56:01.230595 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.230551    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b7d5938-01c6-4eb6-b4d0-63758b412291" (UID: "2b7d5938-01c6-4eb6-b4d0-63758b412291"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:56:01.230681 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.230639    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7d5938-01c6-4eb6-b4d0-63758b412291-kube-api-access-4ncfr" (OuterVolumeSpecName: "kube-api-access-4ncfr") pod "2b7d5938-01c6-4eb6-b4d0-63758b412291" (UID: "2b7d5938-01c6-4eb6-b4d0-63758b412291"). InnerVolumeSpecName "kube-api-access-4ncfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:56:01.329837 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.329795    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b7d5938-01c6-4eb6-b4d0-63758b412291-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:56:01.329837 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:01.329834    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ncfr\" (UniqueName: \"kubernetes.io/projected/2b7d5938-01c6-4eb6-b4d0-63758b412291-kube-api-access-4ncfr\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:56:02.063434 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.063388    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b7d5938-01c6-4eb6-b4d0-63758b412291" containerID="9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4" exitCode=0
Jul 06 12:56:02.063434 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.063429    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"
Jul 06 12:56:02.063988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.063462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz" event={"ID":"2b7d5938-01c6-4eb6-b4d0-63758b412291","Type":"ContainerDied","Data":"9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4"}
Jul 06 12:56:02.063988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.063544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz" event={"ID":"2b7d5938-01c6-4eb6-b4d0-63758b412291","Type":"ContainerDied","Data":"be19755930eb0941c7f02eab61f38f9a6527866f361e40a5bc8e9fa4bda4c744"}
Jul 06 12:56:02.063988 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.063582    2565 scope.go:117] "RemoveContainer" containerID="9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4"
Jul 06 12:56:02.072455 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.072437    2565 scope.go:117] "RemoveContainer" containerID="9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4"
Jul 06 12:56:02.072856 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:56:02.072836    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4\": container with ID starting with 9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4 not found: ID does not exist" containerID="9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4"
Jul 06 12:56:02.072926 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.072864    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4"} err="failed to get container status \"9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4\": rpc error: code = NotFound desc = could not find container \"9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4\": container with ID starting with 9e71638a08c759123b3bf135cb8acbdb74d583ad7572438c91b41edf518164b4 not found: ID does not exist"
Jul 06 12:56:02.096238 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.096214    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"]
Jul 06 12:56:02.105245 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:02.105216    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b84121-99d78d6df-lx2lz"]
Jul 06 12:56:03.884860 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:03.884824    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b7d5938-01c6-4eb6-b4d0-63758b412291" path="/var/lib/kubelet/pods/2b7d5938-01c6-4eb6-b4d0-63758b412291/volumes"
Jul 06 12:56:08.202453 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.202419    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"]
Jul 06 12:56:08.202889 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.202687    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj" podUID="16218f2c-48ea-4df9-8325-59ecf0229bd4" containerName="maas-api" containerID="cri-o://c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494" gracePeriod=30
Jul 06 12:56:08.453793 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.453731    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:56:08.493889 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.493862    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16218f2c-48ea-4df9-8325-59ecf0229bd4-openshift-service-ca\") pod \"16218f2c-48ea-4df9-8325-59ecf0229bd4\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") "
Jul 06 12:56:08.494039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.493970    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls\") pod \"16218f2c-48ea-4df9-8325-59ecf0229bd4\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") "
Jul 06 12:56:08.494039 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.494008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdnnb\" (UniqueName: \"kubernetes.io/projected/16218f2c-48ea-4df9-8325-59ecf0229bd4-kube-api-access-rdnnb\") pod \"16218f2c-48ea-4df9-8325-59ecf0229bd4\" (UID: \"16218f2c-48ea-4df9-8325-59ecf0229bd4\") "
Jul 06 12:56:08.494280 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.494248    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16218f2c-48ea-4df9-8325-59ecf0229bd4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16218f2c-48ea-4df9-8325-59ecf0229bd4" (UID: "16218f2c-48ea-4df9-8325-59ecf0229bd4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:08.496055 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.496026    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16218f2c-48ea-4df9-8325-59ecf0229bd4" (UID: "16218f2c-48ea-4df9-8325-59ecf0229bd4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:56:08.496271 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.496243    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16218f2c-48ea-4df9-8325-59ecf0229bd4-kube-api-access-rdnnb" (OuterVolumeSpecName: "kube-api-access-rdnnb") pod "16218f2c-48ea-4df9-8325-59ecf0229bd4" (UID: "16218f2c-48ea-4df9-8325-59ecf0229bd4"). InnerVolumeSpecName "kube-api-access-rdnnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:56:08.594690 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.594656    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16218f2c-48ea-4df9-8325-59ecf0229bd4-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:56:08.594690 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.594681    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdnnb\" (UniqueName: \"kubernetes.io/projected/16218f2c-48ea-4df9-8325-59ecf0229bd4-kube-api-access-rdnnb\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:56:08.594690 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:08.594691    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16218f2c-48ea-4df9-8325-59ecf0229bd4-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 12:56:09.106842 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.106808    2565 generic.go:356] "Generic (PLEG): container finished" podID="16218f2c-48ea-4df9-8325-59ecf0229bd4" containerID="c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494" exitCode=0
Jul 06 12:56:09.107015 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.106845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj" event={"ID":"16218f2c-48ea-4df9-8325-59ecf0229bd4","Type":"ContainerDied","Data":"c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494"}
Jul 06 12:56:09.107015 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.106860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"
Jul 06 12:56:09.107015 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.106890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj" event={"ID":"16218f2c-48ea-4df9-8325-59ecf0229bd4","Type":"ContainerDied","Data":"9181e9f19b0ae1bfb7225d9165adbbff846347e5f6168a4100abfe30a886e355"}
Jul 06 12:56:09.107015 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.106914    2565 scope.go:117] "RemoveContainer" containerID="c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494"
Jul 06 12:56:09.116437 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.116411    2565 scope.go:117] "RemoveContainer" containerID="c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494"
Jul 06 12:56:09.116699 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:56:09.116680    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494\": container with ID starting with c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494 not found: ID does not exist" containerID="c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494"
Jul 06 12:56:09.116752 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.116707    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494"} err="failed to get container status \"c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494\": rpc error: code = NotFound desc = could not find container \"c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494\": container with ID starting with c1caea0a18a4d30778038fcf5782578ad714ab6fa5afd73c5141634d33e00494 not found: ID does not exist"
Jul 06 12:56:09.129823 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.129789    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"]
Jul 06 12:56:09.136956 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.136935    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4a355b-7bd789cf76-6rjrj"]
Jul 06 12:56:09.885900 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:09.885863    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16218f2c-48ea-4df9-8325-59ecf0229bd4" path="/var/lib/kubelet/pods/16218f2c-48ea-4df9-8325-59ecf0229bd4/volumes"
Jul 06 12:56:18.680735 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.680701    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"]
Jul 06 12:56:18.681294 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.681278    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16218f2c-48ea-4df9-8325-59ecf0229bd4" containerName="maas-api"
Jul 06 12:56:18.681337 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.681296    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="16218f2c-48ea-4df9-8325-59ecf0229bd4" containerName="maas-api"
Jul 06 12:56:18.681337 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.681326    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7d5938-01c6-4eb6-b4d0-63758b412291" containerName="maas-api"
Jul 06 12:56:18.681337 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.681334    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7d5938-01c6-4eb6-b4d0-63758b412291" containerName="maas-api"
Jul 06 12:56:18.681448 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.681426    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="16218f2c-48ea-4df9-8325-59ecf0229bd4" containerName="maas-api"
Jul 06 12:56:18.681448 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.681442    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7d5938-01c6-4eb6-b4d0-63758b412291" containerName="maas-api"
Jul 06 12:56:18.684953 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.684933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.688754 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.688733    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e47695-serving-cert\""
Jul 06 12:56:18.704020 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.703994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"]
Jul 06 12:56:18.793945 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.793910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88636dfd-6830-4d89-b987-38b6a5d334a2-maas-api-tls\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.794102 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.793952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkdd2\" (UniqueName: \"kubernetes.io/projected/88636dfd-6830-4d89-b987-38b6a5d334a2-kube-api-access-dkdd2\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.794102 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.794033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88636dfd-6830-4d89-b987-38b6a5d334a2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.895429 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.895389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88636dfd-6830-4d89-b987-38b6a5d334a2-maas-api-tls\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.895731 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.895435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkdd2\" (UniqueName: \"kubernetes.io/projected/88636dfd-6830-4d89-b987-38b6a5d334a2-kube-api-access-dkdd2\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.895731 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.895497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88636dfd-6830-4d89-b987-38b6a5d334a2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.896198 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.896176    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88636dfd-6830-4d89-b987-38b6a5d334a2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.897982 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.897958    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88636dfd-6830-4d89-b987-38b6a5d334a2-maas-api-tls\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.905079 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.905057    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkdd2\" (UniqueName: \"kubernetes.io/projected/88636dfd-6830-4d89-b987-38b6a5d334a2-kube-api-access-dkdd2\") pod \"maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:18.995042 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:18.994946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:19.141165 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:19.141132    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"]
Jul 06 12:56:19.142428 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:56:19.142403    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88636dfd_6830_4d89_b987_38b6a5d334a2.slice/crio-c93f8b247e16a38826ef99982c1a6b2462dca39f127f124cbba450b1e2de7945 WatchSource:0}: Error finding container c93f8b247e16a38826ef99982c1a6b2462dca39f127f124cbba450b1e2de7945: Status 404 returned error can't find the container with id c93f8b247e16a38826ef99982c1a6b2462dca39f127f124cbba450b1e2de7945
Jul 06 12:56:19.168602 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:19.168564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4" event={"ID":"88636dfd-6830-4d89-b987-38b6a5d334a2","Type":"ContainerStarted","Data":"c93f8b247e16a38826ef99982c1a6b2462dca39f127f124cbba450b1e2de7945"}
Jul 06 12:56:20.175108 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:20.175068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4" event={"ID":"88636dfd-6830-4d89-b987-38b6a5d334a2","Type":"ContainerStarted","Data":"d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d"}
Jul 06 12:56:20.175554 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:20.175195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:20.199188 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:20.199135    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4" podStartSLOduration=1.867271455 podStartE2EDuration="2.199118412s" totalImagesPullingTime="331.846957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:56:20.197442108 +0000 UTC m=+2026.937633441" watchObservedRunningTime="2026-07-06 12:56:20.199118412 +0000 UTC m=+2026.939309745"
Jul 06 12:56:26.186664 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.186637    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 12:56:26.838989 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.838952    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"]
Jul 06 12:56:26.842493 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.842475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:26.845568 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.845519    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-984f35-serving-cert\""
Jul 06 12:56:26.857514 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.857482    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"]
Jul 06 12:56:26.969515 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.969465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:26.969698 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.969564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:26.969698 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:26.969621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rcn\" (UniqueName: \"kubernetes.io/projected/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-kube-api-access-h4rcn\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.071011 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.070977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.071205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.071037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rcn\" (UniqueName: \"kubernetes.io/projected/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-kube-api-access-h4rcn\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.071205 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.071087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.071205 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:56:27.071129    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-serving-cert: secret "maas-api-e2e-shared-b-984f35-serving-cert" not found
Jul 06 12:56:27.071205 ip-10-0-138-192 kubenswrapper[2565]: E0706 12:56:27.071203    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls podName:aaf2b63c-9318-427b-aa8a-ee0f5f850bb1 nodeName:}" failed. No retries permitted until 2026-07-06 12:56:27.571185713 +0000 UTC m=+2034.311377023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls") pod "maas-api-e2e-shared-b-984f35-559764b4d-62p5t" (UID: "aaf2b63c-9318-427b-aa8a-ee0f5f850bb1") : secret "maas-api-e2e-shared-b-984f35-serving-cert" not found
Jul 06 12:56:27.071749 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.071732    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.087267 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.087241    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rcn\" (UniqueName: \"kubernetes.io/projected/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-kube-api-access-h4rcn\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.575006 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.574976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.577372 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.577340    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls\") pod \"maas-api-e2e-shared-b-984f35-559764b4d-62p5t\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.758631 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.758596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:27.904633 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:27.904600    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"]
Jul 06 12:56:27.906405 ip-10-0-138-192 kubenswrapper[2565]: W0706 12:56:27.906365    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf2b63c_9318_427b_aa8a_ee0f5f850bb1.slice/crio-83d19efc20023249cf80fe653e182b816c7ac5d303efde7febc3fb2cf2ddafc7 WatchSource:0}: Error finding container 83d19efc20023249cf80fe653e182b816c7ac5d303efde7febc3fb2cf2ddafc7: Status 404 returned error can't find the container with id 83d19efc20023249cf80fe653e182b816c7ac5d303efde7febc3fb2cf2ddafc7
Jul 06 12:56:28.221816 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:28.221732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t" event={"ID":"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1","Type":"ContainerStarted","Data":"83d19efc20023249cf80fe653e182b816c7ac5d303efde7febc3fb2cf2ddafc7"}
Jul 06 12:56:29.229607 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:29.229562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t" event={"ID":"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1","Type":"ContainerStarted","Data":"00b7d6a981ad21cefbe798aae9468535fd3291d13fca14a1bf0f928e4ffcb771"}
Jul 06 12:56:29.229984 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:29.229642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:56:29.257299 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:29.257251    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t" podStartSLOduration=2.901668128 podStartE2EDuration="3.257238772s" totalImagesPullingTime="355.570644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:56:29.255095284 +0000 UTC m=+2035.995286630" watchObservedRunningTime="2026-07-06 12:56:29.257238772 +0000 UTC m=+2035.997430105"
Jul 06 12:56:35.240963 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:56:35.240932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 12:57:33.885369 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:57:33.885342    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 12:57:33.893827 ip-10-0-138-192 kubenswrapper[2565]: I0706 12:57:33.893808    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 13:00:00.155958 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.155869    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"]
Jul 06 13:00:00.159733 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.159711    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"]
Jul 06 13:00:00.159855 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.159821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"
Jul 06 13:00:00.163070 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.163048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"
Jul 06 13:00:00.180060 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.180032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"]
Jul 06 13:00:00.182676 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.182651    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"]
Jul 06 13:00:00.329237 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.329195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29sj\" (UniqueName: \"kubernetes.io/projected/6baa87fe-2bd1-4c8c-96bb-38965e63c8fa-kube-api-access-q29sj\") pod \"maas-api-key-cleanup-29722380-n5wwb\" (UID: \"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"
Jul 06 13:00:00.329416 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.329258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64pn6\" (UniqueName: \"kubernetes.io/projected/be3c2b87-0ef6-45ec-a302-386e0809ae90-kube-api-access-64pn6\") pod \"maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj\" (UID: \"be3c2b87-0ef6-45ec-a302-386e0809ae90\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"
Jul 06 13:00:00.430101 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.430007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29sj\" (UniqueName: \"kubernetes.io/projected/6baa87fe-2bd1-4c8c-96bb-38965e63c8fa-kube-api-access-q29sj\") pod \"maas-api-key-cleanup-29722380-n5wwb\" (UID: \"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"
Jul 06 13:00:00.430101 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.430052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64pn6\" (UniqueName: \"kubernetes.io/projected/be3c2b87-0ef6-45ec-a302-386e0809ae90-kube-api-access-64pn6\") pod \"maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj\" (UID: \"be3c2b87-0ef6-45ec-a302-386e0809ae90\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"
Jul 06 13:00:00.440060 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.440029    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29sj\" (UniqueName: \"kubernetes.io/projected/6baa87fe-2bd1-4c8c-96bb-38965e63c8fa-kube-api-access-q29sj\") pod \"maas-api-key-cleanup-29722380-n5wwb\" (UID: \"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"
Jul 06 13:00:00.440747 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.440724    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64pn6\" (UniqueName: \"kubernetes.io/projected/be3c2b87-0ef6-45ec-a302-386e0809ae90-kube-api-access-64pn6\") pod \"maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj\" (UID: \"be3c2b87-0ef6-45ec-a302-386e0809ae90\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"
Jul 06 13:00:00.472609 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.472575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"
Jul 06 13:00:00.478727 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.478707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"
Jul 06 13:00:00.626453 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.626427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"]
Jul 06 13:00:00.627650 ip-10-0-138-192 kubenswrapper[2565]: W0706 13:00:00.627608    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6baa87fe_2bd1_4c8c_96bb_38965e63c8fa.slice/crio-bc4168a327fc7f58186d80743073c19017433d9d7ba35fb4097a377e01d486ed WatchSource:0}: Error finding container bc4168a327fc7f58186d80743073c19017433d9d7ba35fb4097a377e01d486ed: Status 404 returned error can't find the container with id bc4168a327fc7f58186d80743073c19017433d9d7ba35fb4097a377e01d486ed
Jul 06 13:00:00.864521 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:00.864495    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"]
Jul 06 13:00:00.874590 ip-10-0-138-192 kubenswrapper[2565]: W0706 13:00:00.874565    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3c2b87_0ef6_45ec_a302_386e0809ae90.slice/crio-4d5b02c4ec72d1c39272ee9d49d4e4763f6e10ae7408e13b0a415eba54e0b787 WatchSource:0}: Error finding container 4d5b02c4ec72d1c39272ee9d49d4e4763f6e10ae7408e13b0a415eba54e0b787: Status 404 returned error can't find the container with id 4d5b02c4ec72d1c39272ee9d49d4e4763f6e10ae7408e13b0a415eba54e0b787
Jul 06 13:00:01.439956 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:01.439855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj" event={"ID":"be3c2b87-0ef6-45ec-a302-386e0809ae90","Type":"ContainerStarted","Data":"9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f"}
Jul 06 13:00:01.439956 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:01.439919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj" event={"ID":"be3c2b87-0ef6-45ec-a302-386e0809ae90","Type":"ContainerStarted","Data":"4d5b02c4ec72d1c39272ee9d49d4e4763f6e10ae7408e13b0a415eba54e0b787"}
Jul 06 13:00:01.441463 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:01.441437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb" event={"ID":"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa","Type":"ContainerStarted","Data":"bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37"}
Jul 06 13:00:01.441623 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:01.441485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb" event={"ID":"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa","Type":"ContainerStarted","Data":"bc4168a327fc7f58186d80743073c19017433d9d7ba35fb4097a377e01d486ed"}
Jul 06 13:00:01.468468 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:01.468401    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj" podStartSLOduration=1.468372454 podStartE2EDuration="1.468372454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:00:01.463611322 +0000 UTC m=+2248.203802667" watchObservedRunningTime="2026-07-06 13:00:01.468372454 +0000 UTC m=+2248.208563804"
Jul 06 13:00:01.499456 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:00:01.499403    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb" podStartSLOduration=1.499388824 podStartE2EDuration="1.499388824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:00:01.497318 +0000 UTC m=+2248.237509330" watchObservedRunningTime="2026-07-06 13:00:01.499388824 +0000 UTC m=+2248.239580157"
Jul 06 13:01:00.013003 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:00.012966    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"]
Jul 06 13:01:00.015650 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:00.013167    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj" podUID="be3c2b87-0ef6-45ec-a302-386e0809ae90" containerName="cleanup" containerID="cri-o://9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f" gracePeriod=30
Jul 06 13:01:00.018358 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:00.018337    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"]
Jul 06 13:01:00.018537 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:00.018507    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb" podUID="6baa87fe-2bd1-4c8c-96bb-38965e63c8fa" containerName="cleanup" containerID="cri-o://bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37" gracePeriod=30
Jul 06 13:01:30.229890 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.229860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"
Jul 06 13:01:30.233246 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.233228    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"
Jul 06 13:01:30.321291 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.321267    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64pn6\" (UniqueName: \"kubernetes.io/projected/be3c2b87-0ef6-45ec-a302-386e0809ae90-kube-api-access-64pn6\") pod \"be3c2b87-0ef6-45ec-a302-386e0809ae90\" (UID: \"be3c2b87-0ef6-45ec-a302-386e0809ae90\") "
Jul 06 13:01:30.321474 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.321416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q29sj\" (UniqueName: \"kubernetes.io/projected/6baa87fe-2bd1-4c8c-96bb-38965e63c8fa-kube-api-access-q29sj\") pod \"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa\" (UID: \"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa\") "
Jul 06 13:01:30.323356 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.323320    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be3c2b87-0ef6-45ec-a302-386e0809ae90-kube-api-access-64pn6" (OuterVolumeSpecName: "kube-api-access-64pn6") pod "be3c2b87-0ef6-45ec-a302-386e0809ae90" (UID: "be3c2b87-0ef6-45ec-a302-386e0809ae90"). InnerVolumeSpecName "kube-api-access-64pn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:01:30.323496 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.323410    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6baa87fe-2bd1-4c8c-96bb-38965e63c8fa-kube-api-access-q29sj" (OuterVolumeSpecName: "kube-api-access-q29sj") pod "6baa87fe-2bd1-4c8c-96bb-38965e63c8fa" (UID: "6baa87fe-2bd1-4c8c-96bb-38965e63c8fa"). InnerVolumeSpecName "kube-api-access-q29sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:01:30.422746 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.422716    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q29sj\" (UniqueName: \"kubernetes.io/projected/6baa87fe-2bd1-4c8c-96bb-38965e63c8fa-kube-api-access-q29sj\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:01:30.422746 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.422746    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64pn6\" (UniqueName: \"kubernetes.io/projected/be3c2b87-0ef6-45ec-a302-386e0809ae90-kube-api-access-64pn6\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:01:30.949221 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.949186    2565 generic.go:356] "Generic (PLEG): container finished" podID="6baa87fe-2bd1-4c8c-96bb-38965e63c8fa" containerID="bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37" exitCode=137
Jul 06 13:01:30.949428 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.949231    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"
Jul 06 13:01:30.949428 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.949276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb" event={"ID":"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa","Type":"ContainerDied","Data":"bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37"}
Jul 06 13:01:30.949428 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.949334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb" event={"ID":"6baa87fe-2bd1-4c8c-96bb-38965e63c8fa","Type":"ContainerDied","Data":"bc4168a327fc7f58186d80743073c19017433d9d7ba35fb4097a377e01d486ed"}
Jul 06 13:01:30.949428 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.949364    2565 scope.go:117] "RemoveContainer" containerID="bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37"
Jul 06 13:01:30.950579 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.950558    2565 generic.go:356] "Generic (PLEG): container finished" podID="be3c2b87-0ef6-45ec-a302-386e0809ae90" containerID="9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f" exitCode=137
Jul 06 13:01:30.950685 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.950598    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"
Jul 06 13:01:30.950685 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.950600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj" event={"ID":"be3c2b87-0ef6-45ec-a302-386e0809ae90","Type":"ContainerDied","Data":"9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f"}
Jul 06 13:01:30.950685 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.950655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj" event={"ID":"be3c2b87-0ef6-45ec-a302-386e0809ae90","Type":"ContainerDied","Data":"4d5b02c4ec72d1c39272ee9d49d4e4763f6e10ae7408e13b0a415eba54e0b787"}
Jul 06 13:01:30.960651 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.960633    2565 scope.go:117] "RemoveContainer" containerID="bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37"
Jul 06 13:01:30.960928 ip-10-0-138-192 kubenswrapper[2565]: E0706 13:01:30.960900    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37\": container with ID starting with bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37 not found: ID does not exist" containerID="bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37"
Jul 06 13:01:30.960995 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.960940    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37"} err="failed to get container status \"bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37\": rpc error: code = NotFound desc = could not find container \"bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37\": container with ID starting with bdaf58112847578f4fb1e465d2f550977fa4af9f7aacab7605eb720742b1ee37 not found: ID does not exist"
Jul 06 13:01:30.960995 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.960959    2565 scope.go:117] "RemoveContainer" containerID="9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f"
Jul 06 13:01:30.969448 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.969425    2565 scope.go:117] "RemoveContainer" containerID="9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f"
Jul 06 13:01:30.970376 ip-10-0-138-192 kubenswrapper[2565]: E0706 13:01:30.970319    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f\": container with ID starting with 9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f not found: ID does not exist" containerID="9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f"
Jul 06 13:01:30.970376 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.970356    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f"} err="failed to get container status \"9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f\": rpc error: code = NotFound desc = could not find container \"9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f\": container with ID starting with 9d30489ebf9f4c1008c0bd7c5eb5a58960606c870d4162225fb43013a8310e2f not found: ID does not exist"
Jul 06 13:01:30.974901 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.974881    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"]
Jul 06 13:01:30.977407 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.977389    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722380-n5wwb"]
Jul 06 13:01:30.987831 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.987807    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"]
Jul 06 13:01:30.991658 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:30.991641    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e47695-29722380-n46sj"]
Jul 06 13:01:31.885740 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:31.885711    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6baa87fe-2bd1-4c8c-96bb-38965e63c8fa" path="/var/lib/kubelet/pods/6baa87fe-2bd1-4c8c-96bb-38965e63c8fa/volumes"
Jul 06 13:01:31.886099 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:01:31.886022    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be3c2b87-0ef6-45ec-a302-386e0809ae90" path="/var/lib/kubelet/pods/be3c2b87-0ef6-45ec-a302-386e0809ae90/volumes"
Jul 06 13:02:19.856581 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:19.856546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"]
Jul 06 13:02:19.857068 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:19.856752    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4" podUID="88636dfd-6830-4d89-b987-38b6a5d334a2" containerName="maas-api" containerID="cri-o://d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d" gracePeriod=30
Jul 06 13:02:20.111727 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.111705    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 13:02:20.167823 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.167796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88636dfd-6830-4d89-b987-38b6a5d334a2-maas-api-tls\") pod \"88636dfd-6830-4d89-b987-38b6a5d334a2\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") "
Jul 06 13:02:20.167988 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.167833    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88636dfd-6830-4d89-b987-38b6a5d334a2-openshift-service-ca\") pod \"88636dfd-6830-4d89-b987-38b6a5d334a2\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") "
Jul 06 13:02:20.167988 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.167856    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkdd2\" (UniqueName: \"kubernetes.io/projected/88636dfd-6830-4d89-b987-38b6a5d334a2-kube-api-access-dkdd2\") pod \"88636dfd-6830-4d89-b987-38b6a5d334a2\" (UID: \"88636dfd-6830-4d89-b987-38b6a5d334a2\") "
Jul 06 13:02:20.168133 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.168111    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88636dfd-6830-4d89-b987-38b6a5d334a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88636dfd-6830-4d89-b987-38b6a5d334a2" (UID: "88636dfd-6830-4d89-b987-38b6a5d334a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:02:20.169886 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.169864    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88636dfd-6830-4d89-b987-38b6a5d334a2-kube-api-access-dkdd2" (OuterVolumeSpecName: "kube-api-access-dkdd2") pod "88636dfd-6830-4d89-b987-38b6a5d334a2" (UID: "88636dfd-6830-4d89-b987-38b6a5d334a2"). InnerVolumeSpecName "kube-api-access-dkdd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:02:20.169978 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.169867    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88636dfd-6830-4d89-b987-38b6a5d334a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88636dfd-6830-4d89-b987-38b6a5d334a2" (UID: "88636dfd-6830-4d89-b987-38b6a5d334a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:02:20.225611 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.225584    2565 generic.go:356] "Generic (PLEG): container finished" podID="88636dfd-6830-4d89-b987-38b6a5d334a2" containerID="d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d" exitCode=0
Jul 06 13:02:20.225724 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.225629    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"
Jul 06 13:02:20.225724 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.225674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4" event={"ID":"88636dfd-6830-4d89-b987-38b6a5d334a2","Type":"ContainerDied","Data":"d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d"}
Jul 06 13:02:20.225804 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.225727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4" event={"ID":"88636dfd-6830-4d89-b987-38b6a5d334a2","Type":"ContainerDied","Data":"c93f8b247e16a38826ef99982c1a6b2462dca39f127f124cbba450b1e2de7945"}
Jul 06 13:02:20.225804 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.225750    2565 scope.go:117] "RemoveContainer" containerID="d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d"
Jul 06 13:02:20.234842 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.234819    2565 scope.go:117] "RemoveContainer" containerID="d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d"
Jul 06 13:02:20.235084 ip-10-0-138-192 kubenswrapper[2565]: E0706 13:02:20.235066    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d\": container with ID starting with d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d not found: ID does not exist" containerID="d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d"
Jul 06 13:02:20.235131 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.235091    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d"} err="failed to get container status \"d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d\": rpc error: code = NotFound desc = could not find container \"d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d\": container with ID starting with d7f4e9d8b10df97ef7ab93d57a75aac6bfe1c56f5cd3ef7605b40ad65916f62d not found: ID does not exist"
Jul 06 13:02:20.251579 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.251558    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"]
Jul 06 13:02:20.260253 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.260229    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e47695-6fc6fc7f4b-l5lp4"]
Jul 06 13:02:20.269311 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.269294    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88636dfd-6830-4d89-b987-38b6a5d334a2-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:02:20.269372 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.269315    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88636dfd-6830-4d89-b987-38b6a5d334a2-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:02:20.269372 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:20.269325    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkdd2\" (UniqueName: \"kubernetes.io/projected/88636dfd-6830-4d89-b987-38b6a5d334a2-kube-api-access-dkdd2\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:02:21.885986 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:21.885948    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88636dfd-6830-4d89-b987-38b6a5d334a2" path="/var/lib/kubelet/pods/88636dfd-6830-4d89-b987-38b6a5d334a2/volumes"
Jul 06 13:02:33.923508 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:33.923476    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 13:02:33.939101 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:02:33.939074    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 13:03:04.306264 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.306185    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"]
Jul 06 13:03:04.306718 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.306369    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t" podUID="aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" containerName="maas-api" containerID="cri-o://00b7d6a981ad21cefbe798aae9468535fd3291d13fca14a1bf0f928e4ffcb771" gracePeriod=30
Jul 06 13:03:04.470787 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.470751    2565 generic.go:356] "Generic (PLEG): container finished" podID="aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" containerID="00b7d6a981ad21cefbe798aae9468535fd3291d13fca14a1bf0f928e4ffcb771" exitCode=0
Jul 06 13:03:04.470949 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.470831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t" event={"ID":"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1","Type":"ContainerDied","Data":"00b7d6a981ad21cefbe798aae9468535fd3291d13fca14a1bf0f928e4ffcb771"}
Jul 06 13:03:04.565221 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.565152    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 13:03:04.666272 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.666237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4rcn\" (UniqueName: \"kubernetes.io/projected/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-kube-api-access-h4rcn\") pod \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") "
Jul 06 13:03:04.666448 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.666300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-openshift-service-ca\") pod \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") "
Jul 06 13:03:04.666448 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.666405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls\") pod \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\" (UID: \"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1\") "
Jul 06 13:03:04.666631 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.666611    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" (UID: "aaf2b63c-9318-427b-aa8a-ee0f5f850bb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:03:04.666788 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.666769    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-openshift-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:03:04.668301 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.668278    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-kube-api-access-h4rcn" (OuterVolumeSpecName: "kube-api-access-h4rcn") pod "aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" (UID: "aaf2b63c-9318-427b-aa8a-ee0f5f850bb1"). InnerVolumeSpecName "kube-api-access-h4rcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:03:04.668435 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.668414    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" (UID: "aaf2b63c-9318-427b-aa8a-ee0f5f850bb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:03:04.767436 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.767408    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-maas-api-tls\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:03:04.767436 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:04.767431    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4rcn\" (UniqueName: \"kubernetes.io/projected/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1-kube-api-access-h4rcn\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\""
Jul 06 13:03:05.477907 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:05.477870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t" event={"ID":"aaf2b63c-9318-427b-aa8a-ee0f5f850bb1","Type":"ContainerDied","Data":"83d19efc20023249cf80fe653e182b816c7ac5d303efde7febc3fb2cf2ddafc7"}
Jul 06 13:03:05.478390 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:05.477941    2565 scope.go:117] "RemoveContainer" containerID="00b7d6a981ad21cefbe798aae9468535fd3291d13fca14a1bf0f928e4ffcb771"
Jul 06 13:03:05.478390 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:05.477881    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"
Jul 06 13:03:05.505368 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:05.505342    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"]
Jul 06 13:03:05.509388 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:05.509366    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-984f35-559764b4d-62p5t"]
Jul 06 13:03:05.885706 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:05.885673    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" path="/var/lib/kubelet/pods/aaf2b63c-9318-427b-aa8a-ee0f5f850bb1/volumes"
Jul 06 13:03:16.230960 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:16.230925    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-klpq9_18ff3487-07b6-4450-b0bd-4b20b134a39a/manager/0.log"
Jul 06 13:03:16.357893 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:16.357861    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dpm7f_6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef/manager/0.log"
Jul 06 13:03:16.492041 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:16.491954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79f4fc5cc-mvg4t_f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab/manager/0.log"
Jul 06 13:03:17.142366 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:17.142338    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zmrgq_5ae2bf7e-583d-4406-9424-927f9b94047f/copy-manifests/0.log"
Jul 06 13:03:17.162327 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:17.162297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zmrgq_5ae2bf7e-583d-4406-9424-927f9b94047f/manager/0.log"
Jul 06 13:03:17.963013 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:17.962982    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht_94a6d9f5-cd03-4a79-bd1c-a902fd30178b/extract/0.log"
Jul 06 13:03:17.973136 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:17.973113    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht_94a6d9f5-cd03-4a79-bd1c-a902fd30178b/util/0.log"
Jul 06 13:03:17.980468 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:17.980442    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht_94a6d9f5-cd03-4a79-bd1c-a902fd30178b/pull/0.log"
Jul 06 13:03:18.093865 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.093834    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h_c4b8438e-4e45-4a64-bee3-7144fc6189c4/util/0.log"
Jul 06 13:03:18.101521 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.101497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h_c4b8438e-4e45-4a64-bee3-7144fc6189c4/pull/0.log"
Jul 06 13:03:18.107862 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.107843    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h_c4b8438e-4e45-4a64-bee3-7144fc6189c4/extract/0.log"
Jul 06 13:03:18.221736 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.221651    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l_1b04d2ff-2155-4f59-905e-9d1d7fbd877b/util/0.log"
Jul 06 13:03:18.228802 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.228776    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l_1b04d2ff-2155-4f59-905e-9d1d7fbd877b/pull/0.log"
Jul 06 13:03:18.235545 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.235507    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l_1b04d2ff-2155-4f59-905e-9d1d7fbd877b/extract/0.log"
Jul 06 13:03:18.361325 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.361294    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr_4e967cc6-f6f1-47b2-8f07-adf3dcb4e766/extract/0.log"
Jul 06 13:03:18.371438 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.371418    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr_4e967cc6-f6f1-47b2-8f07-adf3dcb4e766/util/0.log"
Jul 06 13:03:18.383369 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:18.383345    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr_4e967cc6-f6f1-47b2-8f07-adf3dcb4e766/pull/0.log"
Jul 06 13:03:19.390164 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:19.390130    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v8dw2_5a6cce54-16a4-46ee-831a-be69e961e98e/manager/0.log"
Jul 06 13:03:19.888211 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:19.888185    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5jkqn_2111cdc2-dbf3-47e9-bdae-bbe7eab033ed/discovery/0.log"
Jul 06 13:03:20.004134 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:20.004106    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d7ff6d984-7lgkt_7a136c3b-4c40-45ff-ba99-fa366c332ac6/kube-auth-proxy/0.log"
Jul 06 13:03:20.388703 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:20.388668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tfj2d_cbbe8764-71a0-4ae2-a381-6db142d2f39f/payload-pre-processing/0.log"
Jul 06 13:03:20.522640 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:20.522588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-8l9th_239d71a3-22fd-42a7-aeda-c125158e23fc/payload-processing/0.log"
Jul 06 13:03:21.013354 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:21.013327    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-f5pvw_217427e1-937d-4495-90e2-3e8c7671a454/main/0.log"
Jul 06 13:03:21.242064 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:21.242033    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8q97w_74e68241-0fc6-4bad-b07b-ee0391865ba6/main/0.log"
Jul 06 13:03:29.190302 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:29.190268    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7tw8w_8a7d9d83-783d-437f-af6b-b106c737db98/global-pull-secret-syncer/0.log"
Jul 06 13:03:29.420217 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:29.420189    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hpcwq_bde49520-4d90-4f17-b377-29fd0557e530/konnectivity-agent/0.log"
Jul 06 13:03:29.551595 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:29.551500    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-192.ec2.internal_486559a7564074f1c285c00b4aee521d/haproxy/0.log"
Jul 06 13:03:34.266106 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.266076    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht_94a6d9f5-cd03-4a79-bd1c-a902fd30178b/extract/0.log"
Jul 06 13:03:34.299903 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.299878    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht_94a6d9f5-cd03-4a79-bd1c-a902fd30178b/util/0.log"
Jul 06 13:03:34.350866 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.350775    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592hlht_94a6d9f5-cd03-4a79-bd1c-a902fd30178b/pull/0.log"
Jul 06 13:03:34.381435 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.381403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h_c4b8438e-4e45-4a64-bee3-7144fc6189c4/extract/0.log"
Jul 06 13:03:34.408019 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.407996    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h_c4b8438e-4e45-4a64-bee3-7144fc6189c4/util/0.log"
Jul 06 13:03:34.434219 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.434187    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04445h_c4b8438e-4e45-4a64-bee3-7144fc6189c4/pull/0.log"
Jul 06 13:03:34.466290 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.466270    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l_1b04d2ff-2155-4f59-905e-9d1d7fbd877b/extract/0.log"
Jul 06 13:03:34.494937 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.494918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l_1b04d2ff-2155-4f59-905e-9d1d7fbd877b/util/0.log"
Jul 06 13:03:34.523516 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.523485    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739fb6l_1b04d2ff-2155-4f59-905e-9d1d7fbd877b/pull/0.log"
Jul 06 13:03:34.572756 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.572729    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr_4e967cc6-f6f1-47b2-8f07-adf3dcb4e766/extract/0.log"
Jul 06 13:03:34.601675 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.601607    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr_4e967cc6-f6f1-47b2-8f07-adf3dcb4e766/util/0.log"
Jul 06 13:03:34.626325 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:34.626279    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ppjrr_4e967cc6-f6f1-47b2-8f07-adf3dcb4e766/pull/0.log"
Jul 06 13:03:35.570691 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:35.570661    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v8dw2_5a6cce54-16a4-46ee-831a-be69e961e98e/manager/0.log"
Jul 06 13:03:37.179205 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.179176    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d2518c5-4a9a-49d4-a0d4-610fa76781ff/alertmanager/0.log"
Jul 06 13:03:37.220744 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.220715    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d2518c5-4a9a-49d4-a0d4-610fa76781ff/config-reloader/0.log"
Jul 06 13:03:37.252298 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.252274    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d2518c5-4a9a-49d4-a0d4-610fa76781ff/kube-rbac-proxy-web/0.log"
Jul 06 13:03:37.276170 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.276150    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d2518c5-4a9a-49d4-a0d4-610fa76781ff/kube-rbac-proxy/0.log"
Jul 06 13:03:37.305410 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.305388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d2518c5-4a9a-49d4-a0d4-610fa76781ff/kube-rbac-proxy-metric/0.log"
Jul 06 13:03:37.334312 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.334296    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d2518c5-4a9a-49d4-a0d4-610fa76781ff/prom-label-proxy/0.log"
Jul 06 13:03:37.361587 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.361571    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d2518c5-4a9a-49d4-a0d4-610fa76781ff/init-config-reloader/0.log"
Jul 06 13:03:37.633798 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.633767    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-jgz92_c7febc4c-0e29-447e-ae90-c755a88fbfe9/monitoring-plugin/0.log"
Jul 06 13:03:37.845656 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.845629    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fxv5k_dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7/node-exporter/0.log"
Jul 06 13:03:37.898738 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.898712    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fxv5k_dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7/kube-rbac-proxy/0.log"
Jul 06 13:03:37.953205 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:37.953183    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fxv5k_dcd3c9c7-cc4a-4575-90b9-3c65efa36ff7/init-textfile/0.log"
Jul 06 13:03:38.575308 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.575279    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-vlmwd_1dc49ed8-92a9-4107-ae45-3275f303c9fe/prometheus-operator/0.log"
Jul 06 13:03:38.606320 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.606296    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-vlmwd_1dc49ed8-92a9-4107-ae45-3275f303c9fe/kube-rbac-proxy/0.log"
Jul 06 13:03:38.633242 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.633219    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-45jwq_55b0a3f7-24c3-4711-9f67-36b662425421/prometheus-operator-admission-webhook/0.log"
Jul 06 13:03:38.769022 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.768995    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5bd9f4df-kh4lq_59287d82-f04f-4516-85e8-36c8a53ed3bd/thanos-query/0.log"
Jul 06 13:03:38.799464 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.799439    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5bd9f4df-kh4lq_59287d82-f04f-4516-85e8-36c8a53ed3bd/kube-rbac-proxy-web/0.log"
Jul 06 13:03:38.827064 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.827008    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5bd9f4df-kh4lq_59287d82-f04f-4516-85e8-36c8a53ed3bd/kube-rbac-proxy/0.log"
Jul 06 13:03:38.852426 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.852407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5bd9f4df-kh4lq_59287d82-f04f-4516-85e8-36c8a53ed3bd/prom-label-proxy/0.log"
Jul 06 13:03:38.877790 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.877773    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5bd9f4df-kh4lq_59287d82-f04f-4516-85e8-36c8a53ed3bd/kube-rbac-proxy-rules/0.log"
Jul 06 13:03:38.936661 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:38.936638    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d5bd9f4df-kh4lq_59287d82-f04f-4516-85e8-36c8a53ed3bd/kube-rbac-proxy-metrics/0.log"
Jul 06 13:03:39.076217 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076189    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"]
Jul 06 13:03:39.076628 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076614    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88636dfd-6830-4d89-b987-38b6a5d334a2" containerName="maas-api"
Jul 06 13:03:39.076684 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076629    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="88636dfd-6830-4d89-b987-38b6a5d334a2" containerName="maas-api"
Jul 06 13:03:39.076684 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076637    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" containerName="maas-api"
Jul 06 13:03:39.076684 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076642    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" containerName="maas-api"
Jul 06 13:03:39.076684 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076652    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be3c2b87-0ef6-45ec-a302-386e0809ae90" containerName="cleanup"
Jul 06 13:03:39.076684 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076658    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="be3c2b87-0ef6-45ec-a302-386e0809ae90" containerName="cleanup"
Jul 06 13:03:39.076684 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076669    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6baa87fe-2bd1-4c8c-96bb-38965e63c8fa" containerName="cleanup"
Jul 06 13:03:39.076684 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076674    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6baa87fe-2bd1-4c8c-96bb-38965e63c8fa" containerName="cleanup"
Jul 06 13:03:39.076930 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076734    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6baa87fe-2bd1-4c8c-96bb-38965e63c8fa" containerName="cleanup"
Jul 06 13:03:39.076930 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076743    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf2b63c-9318-427b-aa8a-ee0f5f850bb1" containerName="maas-api"
Jul 06 13:03:39.076930 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076748    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="be3c2b87-0ef6-45ec-a302-386e0809ae90" containerName="cleanup"
Jul 06 13:03:39.076930 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.076755    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="88636dfd-6830-4d89-b987-38b6a5d334a2" containerName="maas-api"
Jul 06 13:03:39.081354 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.081312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.083916 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.083895    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfwcs\"/\"default-dockercfg-h759v\""
Jul 06 13:03:39.094967 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.094945    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfwcs\"/\"kube-root-ca.crt\""
Jul 06 13:03:39.096124 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.096102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"]
Jul 06 13:03:39.101816 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.101799    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfwcs\"/\"openshift-service-ca.crt\""
Jul 06 13:03:39.262150 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.262124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-lib-modules\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.262150 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.262156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-sys\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.262344 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.262199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-proc\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.262344 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.262271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-podres\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.262344 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.262300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9bq5\" (UniqueName: \"kubernetes.io/projected/50e633da-adac-4acf-9483-ab51e41e3074-kube-api-access-b9bq5\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.362915 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.362836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-lib-modules\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.362915 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.362875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-sys\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.363126 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.362933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-proc\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.363126 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.362978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-podres\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.363126 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.363003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9bq5\" (UniqueName: \"kubernetes.io/projected/50e633da-adac-4acf-9483-ab51e41e3074-kube-api-access-b9bq5\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.363126 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.363028    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-lib-modules\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.363126 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.363033    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-sys\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.363126 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.363049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-proc\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.363126 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.363091    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50e633da-adac-4acf-9483-ab51e41e3074-podres\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.372457 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.372434    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9bq5\" (UniqueName: \"kubernetes.io/projected/50e633da-adac-4acf-9483-ab51e41e3074-kube-api-access-b9bq5\") pod \"perf-node-gather-daemonset-n77cn\" (UID: \"50e633da-adac-4acf-9483-ab51e41e3074\") " pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.390361 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.390337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.533665 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.533639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"]
Jul 06 13:03:39.536187 ip-10-0-138-192 kubenswrapper[2565]: W0706 13:03:39.536160    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod50e633da_adac_4acf_9483_ab51e41e3074.slice/crio-6d17100f0b13e9228b7467428ee026dda48f90b10fdae042782de341be6e03b6 WatchSource:0}: Error finding container 6d17100f0b13e9228b7467428ee026dda48f90b10fdae042782de341be6e03b6: Status 404 returned error can't find the container with id 6d17100f0b13e9228b7467428ee026dda48f90b10fdae042782de341be6e03b6
Jul 06 13:03:39.668026 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.667953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn" event={"ID":"50e633da-adac-4acf-9483-ab51e41e3074","Type":"ContainerStarted","Data":"d261bdf3a9816d0ac436a7bf48fcbffc8c0bf053d605ff03248740acfa28c94e"}
Jul 06 13:03:39.668026 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.668011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn" event={"ID":"50e633da-adac-4acf-9483-ab51e41e3074","Type":"ContainerStarted","Data":"6d17100f0b13e9228b7467428ee026dda48f90b10fdae042782de341be6e03b6"}
Jul 06 13:03:39.668418 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.668045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:39.686735 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:39.686691    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn" podStartSLOduration=0.686676912 podStartE2EDuration="686.676912ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:03:39.686207129 +0000 UTC m=+2466.426398476" watchObservedRunningTime="2026-07-06 13:03:39.686676912 +0000 UTC m=+2466.426868245"
Jul 06 13:03:40.105552 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:40.105496    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-xnfpf_015b4ac3-23e7-48af-9f33-223162c4ad59/networking-console-plugin/0.log"
Jul 06 13:03:40.678959 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:40.678933    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/1.log"
Jul 06 13:03:40.690992 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:40.690940    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-p8p64_92582abc-17fa-4f2e-aa1a-e92959fa532f/console-operator/2.log"
Jul 06 13:03:41.322903 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:41.322871    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-l96pm_a8942a48-0a6c-4804-9d3d-e34f114cb4db/download-server/0.log"
Jul 06 13:03:43.023019 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:43.022993    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4scf5_d4a8f589-6dd7-40eb-92dd-d6b3759304bb/dns/0.log"
Jul 06 13:03:43.047204 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:43.047177    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4scf5_d4a8f589-6dd7-40eb-92dd-d6b3759304bb/kube-rbac-proxy/0.log"
Jul 06 13:03:43.239940 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:43.239915    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vf7t7_d2f4be8f-111b-4ed0-84f0-cab27cc699dc/dns-node-resolver/0.log"
Jul 06 13:03:43.988557 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:43.988511    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smk6w_784247d6-8be2-490b-9c8b-8e14663c342a/node-ca/0.log"
Jul 06 13:03:45.197370 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:45.197336    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5jkqn_2111cdc2-dbf3-47e9-bdae-bbe7eab033ed/discovery/0.log"
Jul 06 13:03:45.219917 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:45.219886    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d7ff6d984-7lgkt_7a136c3b-4c40-45ff-ba99-fa366c332ac6/kube-auth-proxy/0.log"
Jul 06 13:03:45.354136 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:45.354107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tfj2d_cbbe8764-71a0-4ae2-a381-6db142d2f39f/payload-pre-processing/0.log"
Jul 06 13:03:45.431663 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:45.431630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-8l9th_239d71a3-22fd-42a7-aeda-c125158e23fc/payload-processing/0.log"
Jul 06 13:03:45.684395 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:45.684368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfwcs/perf-node-gather-daemonset-n77cn"
Jul 06 13:03:46.211458 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:46.211428    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwv4g_52264f9c-4bb1-48ee-86e5-13c5533cf69e/serve-healthcheck-canary/0.log"
Jul 06 13:03:46.998033 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:46.998003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pj9dl_9c56a172-8612-4ca8-9f5f-a13e8bfd3941/kube-rbac-proxy/0.log"
Jul 06 13:03:47.027414 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:47.027387    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pj9dl_9c56a172-8612-4ca8-9f5f-a13e8bfd3941/exporter/0.log"
Jul 06 13:03:47.076240 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:47.076202    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pj9dl_9c56a172-8612-4ca8-9f5f-a13e8bfd3941/extractor/0.log"
Jul 06 13:03:49.594924 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:49.594890    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5jkqn_2111cdc2-dbf3-47e9-bdae-bbe7eab033ed/discovery/0.log"
Jul 06 13:03:49.610936 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:49.610909    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d7ff6d984-7lgkt_7a136c3b-4c40-45ff-ba99-fa366c332ac6/kube-auth-proxy/0.log"
Jul 06 13:03:49.612125 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:49.612106    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-klpq9_18ff3487-07b6-4450-b0bd-4b20b134a39a/manager/0.log"
Jul 06 13:03:49.730456 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:49.730375    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tfj2d_cbbe8764-71a0-4ae2-a381-6db142d2f39f/payload-pre-processing/0.log"
Jul 06 13:03:49.843104 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:49.843072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-8l9th_239d71a3-22fd-42a7-aeda-c125158e23fc/payload-processing/0.log"
Jul 06 13:03:49.880097 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:49.880072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dpm7f_6a2fc5bc-2f42-4a78-9c34-a4fbb5cd3cef/manager/0.log"
Jul 06 13:03:50.033071 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:50.032983    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79f4fc5cc-mvg4t_f4cc69bc-8ee8-4aa4-b665-dfd1ad2e95ab/manager/0.log"
Jul 06 13:03:50.357692 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:50.357668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zmrgq_5ae2bf7e-583d-4406-9424-927f9b94047f/manager/0.log"
Jul 06 13:03:50.379805 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:50.379780    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67cf9968b4-zmrgq_5ae2bf7e-583d-4406-9424-927f9b94047f/copy-manifests/0.log"
Jul 06 13:03:51.306336 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:51.306253    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5jkqn_2111cdc2-dbf3-47e9-bdae-bbe7eab033ed/discovery/0.log"
Jul 06 13:03:51.321922 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:51.321899    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d7ff6d984-7lgkt_7a136c3b-4c40-45ff-ba99-fa366c332ac6/kube-auth-proxy/0.log"
Jul 06 13:03:51.440901 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:51.440873    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tfj2d_cbbe8764-71a0-4ae2-a381-6db142d2f39f/payload-pre-processing/0.log"
Jul 06 13:03:51.507541 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:51.507507    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-8l9th_239d71a3-22fd-42a7-aeda-c125158e23fc/payload-processing/0.log"
Jul 06 13:03:51.677720 ip-10-0-138-192 kubenswrapper[2565]: I0706 13:03:51.677695    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xhn55_790ede7d-840f-4833-a109-6630c58a51b1/openshift-lws-operator/0.log"