Jul 08 21:30:50.102768 ip-10-0-131-2 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 21:30:50.102780 ip-10-0-131-2 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 21:30:50.102790 ip-10-0-131-2 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 21:30:50.103103 ip-10-0-131-2 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 21:31:00.256138 ip-10-0-131-2 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 21:31:00.256154 ip-10-0-131-2 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5de5a1824de04ebbad6c9b89a14f09e9 --
Jul 08 21:32:34.012696 ip-10-0-131-2 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.412675    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419570    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419582    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419586    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419590    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419594    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419598    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419602    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:34.420691 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419606    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419610    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419614    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419617    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419620    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419624    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419627    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419630    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419633    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419636    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419640    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419643    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419646    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419649    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419653    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419657    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419663    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419678    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419682    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:34.423381 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419687    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419691    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419695    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419699    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419703    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419707    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419712    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419716    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419720    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419724    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419727    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419731    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419735    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419738    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419742    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419747    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419751    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419755    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419759    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419763    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:34.485979 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419767    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419771    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419774    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419778    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419783    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419787    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419790    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419794    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419798    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419802    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419806    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419810    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419813    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419817    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419821    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419825    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419828    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419832    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419836    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419841    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:34.495641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419845    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:34.492826 ip-10-0-131-2 systemd[1]: Started Kubernetes Kubelet.
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419849    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419852    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419856    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419860    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419864    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419868    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419872    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419876    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419880    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419884    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419888    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419892    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419895    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419899    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419904    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419907    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419913    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419917    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:34.752514 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419922    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419926    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419929    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419933    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419939    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419943    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419946    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419950    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419956    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419961    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419965    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419970    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419973    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.419978    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420862    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420869    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420873    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420877    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420880    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:34.760847 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420884    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420887    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420890    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420893    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420895    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420898    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420901    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420903    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420906    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420908    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420912    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420916    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420919    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420921    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420925    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420927    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420930    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420933    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420935    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420937    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:34.761934 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420940    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420942    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420945    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420948    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420950    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420953    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420957    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420960    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420963    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420966    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420969    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420971    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420974    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420979    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420983    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420986    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420988    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420991    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:34.763015 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420993    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420996    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.420999    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421001    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421004    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421006    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421009    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421012    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421014    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421017    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421020    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421022    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421025    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421028    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421030    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421032    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421035    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421038    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421040    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421044    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:34.763901 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421046    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421049    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421051    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421053    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421056    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421059    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421061    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421064    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421066    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421069    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421071    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421074    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421076    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421079    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421081    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421084    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421087    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421089    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421092    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421094    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:34.765027 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421097    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421100    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421103    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421105    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421108    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421111    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421113    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421116    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421118    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421121    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421123    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421126    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421129    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421131    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421134    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421136    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421504    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421510    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421513    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421515    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:34.766129 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421518    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421523    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421526    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421529    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421533    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421536    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421539    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421542    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421545    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421549    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421553    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421558    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421562    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421566    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421569    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421572    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421576    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421580    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421583    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:34.767234 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421586    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421589    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421592    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421595    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421599    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421602    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421605    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421608    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421612    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421615    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421619    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421622    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421626    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421629    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421634    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421637    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421640    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421643    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421646    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421651    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:34.768122 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421655    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421658    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421661    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421664    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421667    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421671    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421674    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421676    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421679    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421683    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421686    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421689    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421692    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421698    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421701    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421706    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421709    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421712    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421715    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421718    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:34.769470 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421721    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421724    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421727    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421731    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421735    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421738    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421743    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421752    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421756    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421760    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421764    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421768    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421772    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421777    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421782    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421785    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421789    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421793    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421796    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:34.770367 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421800    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421804    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421808    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421812    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421815    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421819    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421824    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421828    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421832    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421836    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421839    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421843    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421846    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421850    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421854    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421858    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.421862    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.421951    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.421969    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.421978    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.421986    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 21:32:34.771298 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422001    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422007    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422017    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422023    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422028    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422033    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422038    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422042    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422047    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422051    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422055    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422060    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422064    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422068    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422074    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422078    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422083    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422089    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422094    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422099    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422104    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422108    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422112    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422117    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 21:32:34.772196 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422121    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422126    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422130    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422134    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422140    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422144    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422148    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422153    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422158    2568 flags.go:64] FLAG: --enable-server="true"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422163    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422170    2568 flags.go:64] FLAG: --event-burst="100"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422174    2568 flags.go:64] FLAG: --event-qps="50"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422178    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422182    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422186    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422192    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422196    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422201    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422205    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422209    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422214    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422218    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422222    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422226    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422230    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 21:32:34.773307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422236    2568 flags.go:64] FLAG: --feature-gates=""
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422242    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422246    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422250    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422255    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422259    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422263    2568 flags.go:64] FLAG: --help="false"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422268    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422273    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422277    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422281    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422286    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422291    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422295    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422300    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422305    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422309    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422315    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422320    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422324    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422328    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422332    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422337    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422340    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 21:32:34.774488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422345    2568 flags.go:64] FLAG: --lock-file=""
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422348    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422352    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422357    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422364    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422368    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422372    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422376    2568 flags.go:64] FLAG: --logging-format="text"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422381    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422386    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422391    2568 flags.go:64] FLAG: --manifest-url=""
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422395    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422401    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422405    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422428    2568 flags.go:64] FLAG: --max-pods="110"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422432    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422436    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422440    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422445    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422449    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422453    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422457    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422469    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422474    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422479    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 21:32:34.775691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422483    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422488    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422496    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422500    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422505    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422509    2568 flags.go:64] FLAG: --port="10250"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422513    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422518    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ada31c3922f1c46a"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422522    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422527    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422531    2568 flags.go:64] FLAG: --register-node="true"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422535    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422540    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422544    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422548    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422553    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422558    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422563    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422567    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422571    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422575    2568 flags.go:64] FLAG: --runonce="false"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422579    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422584    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422588    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422593    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 21:32:34.776799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422597    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422601    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422605    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422610    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422614    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422619    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422623    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422627    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422632    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422637    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422640    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422648    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422652    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422655    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422661    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422665    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422669    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422673    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422678    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422682    2568 flags.go:64] FLAG: --v="2"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422687    2568 flags.go:64] FLAG: --version="false"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422693    2568 flags.go:64] FLAG: --vmodule=""
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422699    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.422704    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 21:32:34.778356 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422861    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422868    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422873    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422879    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422884    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422888    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422893    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422897    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422902    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422905    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422909    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422913    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422916    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422922    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422926    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422929    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422933    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422937    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422941    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:34.779669 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422945    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422949    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422953    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422956    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422960    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422964    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422967    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422971    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422975    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422978    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422982    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422987    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422990    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422993    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.422997    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423001    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423005    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423008    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423012    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423016    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:34.780553 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423019    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423023    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423027    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423031    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423034    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423038    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423043    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423047    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423051    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423055    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423059    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423062    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423067    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423071    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423076    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423082    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423085    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423090    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423093    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:34.783641 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423097    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423100    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423104    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423108    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423114    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423118    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423122    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423126    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423130    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423133    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423137    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423142    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423146    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423150    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423153    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423157    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423161    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423165    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423169    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423174    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:34.784511 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423177    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423181    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423185    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423189    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423192    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423196    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423201    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423204    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423208    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423212    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423216    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423220    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423223    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423227    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423231    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423235    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423240    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423244    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423248    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423251    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:34.791822 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.423255    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.423266    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.430595    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.430610    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.430628    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.430635    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430691    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430696    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430699    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430703    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430706    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430709    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430712    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430715    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430719    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:34.792704 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430721    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430724    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430727    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430729    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430732    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430734    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430737    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430739    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430742    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430745    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430747    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430750    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430753    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430756    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430760    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430764    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430767    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430769    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430772    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430774    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:34.793357 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430779    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430783    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430786    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430790    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430793    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430796    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430798    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430801    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430804    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430806    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430809    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430811    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430814    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430816    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430819    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430821    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430824    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430827    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430830    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430832    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:34.794238 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430835    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430837    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430840    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430842    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430845    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430848    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430853    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430856    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430859    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430862    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430864    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430867    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430869    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430873    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430876    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430878    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430881    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430883    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430886    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:34.795114 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430888    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430891    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430893    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430896    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430898    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430901    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430904    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430907    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430909    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430912    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430915    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430917    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430920    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430923    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430925    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430929    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430932    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430935    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430938    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:34.795987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430942    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430944    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430947    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430949    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430952    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430954    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430957    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430959    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430963    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430965    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430968    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.430970    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.430975    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431102    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431107    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:34.796855 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431111    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431114    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431117    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431119    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431122    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431124    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431127    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431130    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431133    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431136    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431139    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431141    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431144    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431147    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431150    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431152    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431155    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431157    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431161    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431164    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:34.797722 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431167    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431171    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431175    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431178    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431181    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431183    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431186    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431189    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431191    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431194    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431196    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431199    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431202    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431204    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431207    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431209    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431212    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431214    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431217    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431219    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:34.798618 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431222    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431225    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431227    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431230    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431233    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431237    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431239    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431242    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431244    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431247    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431250    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431253    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431255    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431259    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431263    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431267    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431270    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431273    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431276    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:34.799507 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431279    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431282    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431285    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431287    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431290    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431292    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431295    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431297    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431300    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431302    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431305    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431307    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431310    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431312    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431314    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431317    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431320    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431322    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431326    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431329    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:34.860079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431331    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431333    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431336    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431340    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431342    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431345    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431347    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431350    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431352    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431355    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431358    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431360    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431363    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431366    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431368    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431370    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431373    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:34.861118 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:34.431375    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.431380    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.431499    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.433840    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.435616    2568 server.go:1019] "Starting client certificate rotation"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.435719    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.435755    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.440863    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.442026    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.454744    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.457233    2568 log.go:25] "Validated CRI v1 image API"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.458974    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 21:32:34.862008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.464024    2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81e7cbba-b9b6-402c-966e-618a4e723682:/dev/nvme0n1p4 e5b57783-7f2e-4a19-a580-55ebe72d0111:/dev/nvme0n1p3]
Jul 08 21:32:34.862664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.464038    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 21:32:34.862889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.469088    2568 manager.go:216] Machine: {Timestamp:2026-07-08 21:32:34.468480779 +0000 UTC m=+0.358261806 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099439 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c398ebe620a332e822fe173d79c3f SystemUUID:ec2c398e-be62-0a33-2e82-2fe173d79c3f BootID:5de5a182-4de0-4ebb-ad6c-9b89a14f09e9 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:1f:f4:70:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:1f:f4:70:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:72:7e:87:78:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 21:32:34.862889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.469198    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 21:32:34.862889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.469283    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 21:32:34.862889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.469814    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:32:34.862889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.470498    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 21:32:34.862889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.470521    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-2.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 21:32:34.862889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.471421    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.471431    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.471438    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.472288    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.474170    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.477624    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.477734    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.477760    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.477769    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.477783    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.477793    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.477800    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.478203    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.478223    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.482395    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.484863    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.484890    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487064    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487081    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487088    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487093    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487101    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487107    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487115    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487119    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487126    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487132    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487141    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.487146    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.488793    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.488814    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.491394    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.491395    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.491976    2568 server.go:1268] "Started kubelet"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.492050    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.492113    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.492215    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.494090    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.494217    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.497633    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 21:32:34.863334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.499717    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-2.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.499808    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-2.ec2.internal.18c06df5b3ef7641  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-2.ec2.internal,UID:ip-10-0-131-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-2.ec2.internal,},FirstTimestamp:2026-07-08 21:32:34.491946561 +0000 UTC m=+0.381727577,LastTimestamp:2026-07-08 21:32:34.491946561 +0000 UTC m=+0.381727577,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-2.ec2.internal,}"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.503020    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.503107    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.503165    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504218    2568 factory.go:55] Registering systemd factory
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504233    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504455    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504457    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504489    2568 factory.go:153] Registering CRI-O factory
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504498    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504500    2568 factory.go:223] Registration of the crio container factory successfully
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504605    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504629    2568 factory.go:103] Registering Raw factory
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504643    2568 manager.go:1196] Started watching for new ooms in manager
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504671    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.504685    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.505039    2568 manager.go:349] Starting recovery of all containers
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.506699    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.506798    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.514026    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fw6wk"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.516174    2568 manager.go:354] Recovery completed
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.520386    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.521552    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fw6wk"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.522124    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.522149    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.522160    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.522630    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.522632    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.522644    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.522659    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.523340    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.523362    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:34.865108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.523372    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.523562    2568 policy_none.go:49] "None policy: Start"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.523576    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.523586    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.524039    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-2.ec2.internal.18c06df5b5bc1642  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-2.ec2.internal,UID:ip-10-0-131-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-2.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-2.ec2.internal,},FirstTimestamp:2026-07-08 21:32:34.522134082 +0000 UTC m=+0.411915100,LastTimestamp:2026-07-08 21:32:34.522134082 +0000 UTC m=+0.411915100,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-2.ec2.internal,}"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.524641    2568 policy_none.go:47] "Start"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.584934    2568 manager.go:337] "Starting Device Plugin manager"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.584966    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.584974    2568 server.go:87] "Starting device plugin registration server"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.585181    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.585193    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.585279    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.585356    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.585366    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.585908    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.585970    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.621804    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.623060    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.623096    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.623118    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.623152    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.625815    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.685938    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.688108    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.688134    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.688146    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.688173    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.697317    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.697333    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-2.ec2.internal\": node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.724060    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"]
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.724116    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.725429    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.725453    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:34.866667 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.725463    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.726231    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.726647    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.726759    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.726788    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.727308    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.727333    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.727336    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.727347    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.727357    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.727378    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.728338    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.728358    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.728972    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.729005    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.729016    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.751032    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-2.ec2.internal\" not found" node="ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.754993    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-2.ec2.internal\" not found" node="ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.806129    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf3ea5c4b67941a39a18d70904f17e2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal\" (UID: \"bf3ea5c4b67941a39a18d70904f17e2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.806150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3ea5c4b67941a39a18d70904f17e2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal\" (UID: \"bf3ea5c4b67941a39a18d70904f17e2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:34.806539    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b879b5091a7ea1cbfad7b9a13d6cbe14-config\") pod \"kube-apiserver-proxy-ip-10-0-131-2.ec2.internal\" (UID: \"b879b5091a7ea1cbfad7b9a13d6cbe14\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:34.868006 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:34.826564    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.123164 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.086021    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.123164 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.086104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b879b5091a7ea1cbfad7b9a13d6cbe14-config\") pod \"kube-apiserver-proxy-ip-10-0-131-2.ec2.internal\" (UID: \"b879b5091a7ea1cbfad7b9a13d6cbe14\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.123164 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.086137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf3ea5c4b67941a39a18d70904f17e2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal\" (UID: \"bf3ea5c4b67941a39a18d70904f17e2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.123164 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.086156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3ea5c4b67941a39a18d70904f17e2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal\" (UID: \"bf3ea5c4b67941a39a18d70904f17e2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.123164 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.086198    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b879b5091a7ea1cbfad7b9a13d6cbe14-config\") pod \"kube-apiserver-proxy-ip-10-0-131-2.ec2.internal\" (UID: \"b879b5091a7ea1cbfad7b9a13d6cbe14\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.123164 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.086251    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf3ea5c4b67941a39a18d70904f17e2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal\" (UID: \"bf3ea5c4b67941a39a18d70904f17e2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.123164 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.086273    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3ea5c4b67941a39a18d70904f17e2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal\" (UID: \"bf3ea5c4b67941a39a18d70904f17e2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.193466 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.186472    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.350668 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.286875    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.357197 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.354305    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.358880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.358441    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.420369 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.387163    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.509195 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.434528    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 21:32:35.509195 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.434649    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 21:32:35.509195 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.477634    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:35.509195 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.487377    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.523614 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.523586    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 21:27:34 +0000 UTC" deadline="2028-04-09 09:59:02.451732694 +0000 UTC"
Jul 08 21:32:35.523691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.523615    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15372h26m26.928121459s"
Jul 08 21:32:35.587940 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.587910    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.599433 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.599400    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:35.689062 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.689029    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.789454 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:35.789373    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-2.ec2.internal\" not found"
Jul 08 21:32:35.810284 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.810263    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:35.903527 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.903504    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.913245 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.913227    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:32:35.914053 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.914043    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal"
Jul 08 21:32:35.926397 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:35.926383    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:32:36.147591 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:36.147545    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3ea5c4b67941a39a18d70904f17e2a.slice/crio-ccdef85494c2e5bf322f6b43ac456b2c594ceb5002c119237dfe2b41e7ce0d41 WatchSource:0}: Error finding container ccdef85494c2e5bf322f6b43ac456b2c594ceb5002c119237dfe2b41e7ce0d41: Status 404 returned error can't find the container with id ccdef85494c2e5bf322f6b43ac456b2c594ceb5002c119237dfe2b41e7ce0d41
Jul 08 21:32:36.147987 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:36.147969    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb879b5091a7ea1cbfad7b9a13d6cbe14.slice/crio-94583e6f712418cd36478291a5ad7883012126a8df8f7a6e5bde6fe484501236 WatchSource:0}: Error finding container 94583e6f712418cd36478291a5ad7883012126a8df8f7a6e5bde6fe484501236: Status 404 returned error can't find the container with id 94583e6f712418cd36478291a5ad7883012126a8df8f7a6e5bde6fe484501236
Jul 08 21:32:36.153475 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.153447    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:32:36.478313 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.478233    2568 apiserver.go:52] "Watching apiserver"
Jul 08 21:32:36.486184 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.486165    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 21:32:36.488251 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.488231    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5sdsh","openshift-multus/multus-additional-cni-plugins-frtjk","openshift-ovn-kubernetes/ovnkube-node-p4psz","kube-system/global-pull-secret-syncer-gpv9z","kube-system/konnectivity-agent-dswsm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal","openshift-multus/multus-vw77r","openshift-multus/network-metrics-daemon-sk6pm","openshift-network-diagnostics/network-check-target-7phf6","openshift-network-operator/iptables-alerter-87gx4","kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal","openshift-cluster-node-tuning-operator/tuned-st4pz","openshift-dns/node-resolver-jhhpd"]
Jul 08 21:32:36.491975 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.491958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:36.492063 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.492041    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:36.493994 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.493978    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.496222 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.496174    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.496330 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.496286    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 21:32:36.496392 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.496329    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 21:32:36.496392 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.496346    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 21:32:36.496392 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.496286    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 21:32:36.496551 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.496292    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 21:32:36.496595 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.496561    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m498v\""
Jul 08 21:32:36.498363 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.498343    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5dg8n\""
Jul 08 21:32:36.498495 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.498374    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 21:32:36.498653 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.498640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.499012 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.498997    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 21:32:36.500915 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.500830    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.501185 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.501164    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 21:32:36.501325 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.501307    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 21:32:36.501395 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.501307    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 21:32:36.501395 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.501383    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dv2jj\""
Jul 08 21:32:36.502928 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.502907    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:32:36.503019 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.502928    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:36.503019 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.502988    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:36.504080 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.503902    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m6kjl\""
Jul 08 21:32:36.505357 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.504219    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 21:32:36.505530 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.505512    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.505623 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.505602    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:36.508090 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.508074    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.510303 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.510282    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 21:32:36.510782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.510324    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6z56\""
Jul 08 21:32:36.510782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.510346    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.512648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.512632    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.512843 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.512824    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 21:32:36.513010 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.512990    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 21:32:36.513094 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.512994    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5s4m9\""
Jul 08 21:32:36.513254 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.513237    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 21:32:36.513304 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.513276    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 21:32:36.515009 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.514995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.515393 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.515375    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:32:36.515393 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.515388    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 21:32:36.515614 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.515601    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxhlp\""
Jul 08 21:32:36.515651 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.515619    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 21:32:36.517286 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.517271    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 21:32:36.517359 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.517272    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.517792 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.517775    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f6mpv\""
Jul 08 21:32:36.517868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.517827    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 21:32:36.518832 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.518817    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:36.519775 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.519757    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 21:32:36.520280 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.520263    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 21:32:36.520826 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.520810    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g9drp\""
Jul 08 21:32:36.520923 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.520905    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 21:32:36.521010 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.520996    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 21:32:36.521070 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.521031    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 21:32:36.521505 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.521485    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 21:32:36.526766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.526747    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:32:36.559299 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.559279    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-svsmc"
Jul 08 21:32:36.567161 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.567147    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-svsmc"
Jul 08 21:32:36.593954 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.593934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f6b1f15-6513-4c37-b92a-389ab8198f22-kubelet-config\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.594018 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.593957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysctl-d\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594018 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.593980    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-modprobe-d\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594018 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.593996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:36.594148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-tmp-dir\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.594148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-cni-binary-copy\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594076    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-host\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.594357 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594187    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-kubernetes\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594357 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594250    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw4bs\" (UniqueName: \"kubernetes.io/projected/5497da6c-6934-4f30-8490-c51167543559-kube-api-access-sw4bs\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594357 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.594357 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-os-release\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594369    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysconfig\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594387    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-systemd\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-host\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594440    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9n25\" (UniqueName: \"kubernetes.io/projected/9c9da1d0-5747-477e-9869-055395a27963-kube-api-access-s9n25\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594487    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysctl-conf\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594503    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sc6v\" (UniqueName: \"kubernetes.io/projected/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-kube-api-access-9sc6v\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594518    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-serviceca\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-lib-modules\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5497da6c-6934-4f30-8490-c51167543559-tmp\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-system-cni-dir\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-hosts-file\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594671    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-var-lib-kubelet\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594686    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g6k6\" (UniqueName: \"kubernetes.io/projected/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-kube-api-access-4g6k6\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594705    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-sys\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5497da6c-6934-4f30-8490-c51167543559-etc-tuned\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594756    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g7th\" (UniqueName: \"kubernetes.io/projected/00d98c92-dae5-494f-90e1-151bad0345c3-kube-api-access-4g7th\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-cnibin\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594802    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-tuning-conf-dir\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594839    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-run\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.594934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.594863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f6b1f15-6513-4c37-b92a-389ab8198f22-dbus\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.605834 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.605813    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 21:32:36.626611 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.626572    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal" event={"ID":"bf3ea5c4b67941a39a18d70904f17e2a","Type":"ContainerStarted","Data":"ccdef85494c2e5bf322f6b43ac456b2c594ceb5002c119237dfe2b41e7ce0d41"}
Jul 08 21:32:36.627513 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.627485    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal" event={"ID":"b879b5091a7ea1cbfad7b9a13d6cbe14","Type":"ContainerStarted","Data":"94583e6f712418cd36478291a5ad7883012126a8df8f7a6e5bde6fe484501236"}
Jul 08 21:32:36.695679 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g6k6\" (UniqueName: \"kubernetes.io/projected/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-kube-api-access-4g6k6\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.695679 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-sys\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-cnibin\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-var-lib-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695764    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695778    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-sys\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-ovnkube-config\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-netns\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-run\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.695858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysctl-d\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695856    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-cnibin\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-socket-dir-parent\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-tmp-dir\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695949    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695922    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-run\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.695971    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-cni-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-kubelet\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696050    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysctl-d\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-hostroot\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696090    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-multus-certs\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-host\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.696175 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-kubernetes\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw4bs\" (UniqueName: \"kubernetes.io/projected/5497da6c-6934-4f30-8490-c51167543559-kube-api-access-sw4bs\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696179    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-host\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-sys-fs\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696237    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-kubernetes\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696240    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-tmp-dir\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696248    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-cnibin\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysconfig\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-systemd\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.696310    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-host\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696333    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysconfig\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696362    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9n25\" (UniqueName: \"kubernetes.io/projected/9c9da1d0-5747-477e-9869-055395a27963-kube-api-access-s9n25\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.696788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696396    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-systemd\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.696401    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret podName:7f6b1f15-6513-4c37-b92a-389ab8198f22 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:37.196356668 +0000 UTC m=+3.086137693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret") pod "global-pull-secret-syncer-gpv9z" (UID: "7f6b1f15-6513-4c37-b92a-389ab8198f22") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696441    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-host\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-socket-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysctl-conf\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-serviceca\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696528    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-lib-modules\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-system-cni-dir\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.696587    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-os-release\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696628    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-system-cni-dir\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.697377 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.696649    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs podName:00d98c92-dae5-494f-90e1-151bad0345c3 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:37.196631672 +0000 UTC m=+3.086412684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs") pod "network-metrics-daemon-sk6pm" (UID: "00d98c92-dae5-494f-90e1-151bad0345c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-cni-bin\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696675    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-sysctl-conf\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696690    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-conf-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696681    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-lib-modules\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696732    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-hosts-file\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-device-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696806    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-hosts-file\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zd59\" (UniqueName: \"kubernetes.io/projected/abc80018-e818-42b5-8543-8287439abfec-kube-api-access-6zd59\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696846    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-kubelet\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afc4937a-3189-4a88-a51f-021bc1d7087f-ovn-node-metrics-cert\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5941eeef-b113-457c-97b8-dda635e45fda-cni-binary-copy\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696902    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-serviceca\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5497da6c-6934-4f30-8490-c51167543559-etc-tuned\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.697956 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.696947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g7th\" (UniqueName: \"kubernetes.io/projected/00d98c92-dae5-494f-90e1-151bad0345c3-kube-api-access-4g7th\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-tuning-conf-dir\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697049    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-slash\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-run-netns\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-ovn\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-log-socket\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697180    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-tuning-conf-dir\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-cni-bin\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697225    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f6b1f15-6513-4c37-b92a-389ab8198f22-dbus\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697249    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnb8f\" (UniqueName: \"kubernetes.io/projected/0dc406ef-3e0c-425e-b064-6d8788356116-kube-api-access-vnb8f\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697266    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-etc-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697224    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697281    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-cni-netd\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-env-overrides\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-ovnkube-script-lib\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697352    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-system-cni-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-etc-kubernetes\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697384    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f6b1f15-6513-4c37-b92a-389ab8198f22-dbus\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697400    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f6b1f15-6513-4c37-b92a-389ab8198f22-kubelet-config\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697436    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f6b1f15-6513-4c37-b92a-389ab8198f22-kubelet-config\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697454    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-modprobe-d\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abc80018-e818-42b5-8543-8287439abfec-host-slash\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-systemd-units\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d5qt\" (UniqueName: \"kubernetes.io/projected/5941eeef-b113-457c-97b8-dda635e45fda-kube-api-access-9d5qt\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-cni-binary-copy\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697602    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-etc-modprobe-d\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.698902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697680    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abc80018-e818-42b5-8543-8287439abfec-iptables-alerter-script\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697709    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-systemd\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697734    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-os-release\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eec9af02-8e2b-445c-b2e6-c30490033dca-konnectivity-ca\") pod \"konnectivity-agent-dswsm\" (UID: \"eec9af02-8e2b-445c-b2e6-c30490033dca\") " pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-cni-multus\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5941eeef-b113-457c-97b8-dda635e45fda-multus-daemon-config\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-node-log\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697839    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c9da1d0-5747-477e-9869-055395a27963-os-release\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc6v\" (UniqueName: \"kubernetes.io/projected/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-kube-api-access-9sc6v\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5497da6c-6934-4f30-8490-c51167543559-tmp\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.697962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-registration-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698037    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-k8s-cni-cncf-io\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.699279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698088    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c9da1d0-5747-477e-9869-055395a27963-cni-binary-copy\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.699700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-var-lib-kubelet\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.699700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eec9af02-8e2b-445c-b2e6-c30490033dca-agent-certs\") pod \"konnectivity-agent-dswsm\" (UID: \"eec9af02-8e2b-445c-b2e6-c30490033dca\") " pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.699700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.699700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698187    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5497da6c-6934-4f30-8490-c51167543559-var-lib-kubelet\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.699700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.698196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtlfg\" (UniqueName: \"kubernetes.io/projected/afc4937a-3189-4a88-a51f-021bc1d7087f-kube-api-access-mtlfg\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.700577 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.700559    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5497da6c-6934-4f30-8490-c51167543559-tmp\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.700644 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.700594    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5497da6c-6934-4f30-8490-c51167543559-etc-tuned\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.703569 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.703549    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:36.703569 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.703570    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:36.703710 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.703579    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjdgp for pod openshift-network-diagnostics/network-check-target-7phf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:36.703710 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:36.703625    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp podName:14697219-9ef6-4c89-8a45-9b4f278a69c7 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:37.203613739 +0000 UTC m=+3.093394772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rjdgp" (UniqueName: "kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp") pod "network-check-target-7phf6" (UID: "14697219-9ef6-4c89-8a45-9b4f278a69c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:36.705379 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.705352    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g6k6\" (UniqueName: \"kubernetes.io/projected/8e2e803b-d842-42c3-93a7-2f8a6482bbd5-kube-api-access-4g6k6\") pod \"node-ca-5sdsh\" (UID: \"8e2e803b-d842-42c3-93a7-2f8a6482bbd5\") " pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.705493 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.705397    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw4bs\" (UniqueName: \"kubernetes.io/projected/5497da6c-6934-4f30-8490-c51167543559-kube-api-access-sw4bs\") pod \"tuned-st4pz\" (UID: \"5497da6c-6934-4f30-8490-c51167543559\") " pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.705586 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.705566    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g7th\" (UniqueName: \"kubernetes.io/projected/00d98c92-dae5-494f-90e1-151bad0345c3-kube-api-access-4g7th\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:36.706290 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.706272    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9n25\" (UniqueName: \"kubernetes.io/projected/9c9da1d0-5747-477e-9869-055395a27963-kube-api-access-s9n25\") pod \"multus-additional-cni-plugins-frtjk\" (UID: \"9c9da1d0-5747-477e-9869-055395a27963\") " pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.706352 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.706322    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc6v\" (UniqueName: \"kubernetes.io/projected/73d3a9cf-cb53-47d7-96f1-0d108e3d3370-kube-api-access-9sc6v\") pod \"node-resolver-jhhpd\" (UID: \"73d3a9cf-cb53-47d7-96f1-0d108e3d3370\") " pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.798563 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-var-lib-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.798563 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.798563 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-ovnkube-config\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-netns\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-socket-dir-parent\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798701    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-cni-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-kubelet\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-hostroot\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-multus-certs\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.798814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-sys-fs\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-cnibin\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-socket-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-os-release\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-cni-bin\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798945    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-conf-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.798973    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-device-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zd59\" (UniqueName: \"kubernetes.io/projected/abc80018-e818-42b5-8543-8287439abfec-kube-api-access-6zd59\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-kubelet\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afc4937a-3189-4a88-a51f-021bc1d7087f-ovn-node-metrics-cert\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799095 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799080    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5941eeef-b113-457c-97b8-dda635e45fda-cni-binary-copy\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-slash\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-run-netns\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799210    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-sys-fs\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799221    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-run-netns\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799279    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-var-lib-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799334    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-cnibin\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799370    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-kubelet\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799389    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-socket-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799424    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799475    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-cni-bin\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799480    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-os-release\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799502    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-cni-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799534    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-netns\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.799545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-ovn\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799560    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-conf-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799585    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799600    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-hostroot\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799614    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-ovn\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799602    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-multus-certs\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799625    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-kubelet\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-log-socket\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799667    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-log-socket\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799670    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-multus-socket-dir-parent\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-cni-bin\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnb8f\" (UniqueName: \"kubernetes.io/projected/0dc406ef-3e0c-425e-b064-6d8788356116-kube-api-access-vnb8f\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799765    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-etc-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-cni-netd\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799809    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-env-overrides\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-ovnkube-script-lib\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-system-cni-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-etc-kubernetes\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799921    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abc80018-e818-42b5-8543-8287439abfec-host-slash\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.799994    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-cni-netd\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800003    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-systemd-units\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d5qt\" (UniqueName: \"kubernetes.io/projected/5941eeef-b113-457c-97b8-dda635e45fda-kube-api-access-9d5qt\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800044    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-cni-bin\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abc80018-e818-42b5-8543-8287439abfec-iptables-alerter-script\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800209    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-ovnkube-config\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-systemd\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eec9af02-8e2b-445c-b2e6-c30490033dca-konnectivity-ca\") pod \"konnectivity-agent-dswsm\" (UID: \"eec9af02-8e2b-445c-b2e6-c30490033dca\") " pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-cni-multus\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800331    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5941eeef-b113-457c-97b8-dda635e45fda-multus-daemon-config\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.800997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800339    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800359    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-node-log\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800430    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800449    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-slash\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-registration-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800450    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-system-cni-dir\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800479    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-systemd-units\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-k8s-cni-cncf-io\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800508    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abc80018-e818-42b5-8543-8287439abfec-host-slash\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800560    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-run-systemd\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800576    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-etc-openvswitch\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eec9af02-8e2b-445c-b2e6-c30490033dca-agent-certs\") pod \"konnectivity-agent-dswsm\" (UID: \"eec9af02-8e2b-445c-b2e6-c30490033dca\") " pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800669    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800383    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5941eeef-b113-457c-97b8-dda635e45fda-cni-binary-copy\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.801716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800725    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-var-lib-cni-multus\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800769    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-env-overrides\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800912    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-device-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.800964    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-etc-kubernetes\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801013    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0dc406ef-3e0c-425e-b064-6d8788356116-registration-dir\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801054    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afc4937a-3189-4a88-a51f-021bc1d7087f-ovnkube-script-lib\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801059    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801098    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afc4937a-3189-4a88-a51f-021bc1d7087f-node-log\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801106    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eec9af02-8e2b-445c-b2e6-c30490033dca-konnectivity-ca\") pod \"konnectivity-agent-dswsm\" (UID: \"eec9af02-8e2b-445c-b2e6-c30490033dca\") " pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801136    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5941eeef-b113-457c-97b8-dda635e45fda-host-run-k8s-cni-cncf-io\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801187    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtlfg\" (UniqueName: \"kubernetes.io/projected/afc4937a-3189-4a88-a51f-021bc1d7087f-kube-api-access-mtlfg\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801313    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5941eeef-b113-457c-97b8-dda635e45fda-multus-daemon-config\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.802347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.801463    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abc80018-e818-42b5-8543-8287439abfec-iptables-alerter-script\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.803448 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.803428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-frtjk"
Jul 08 21:32:36.803653 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.803635    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afc4937a-3189-4a88-a51f-021bc1d7087f-ovn-node-metrics-cert\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.803721 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.803679    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eec9af02-8e2b-445c-b2e6-c30490033dca-agent-certs\") pod \"konnectivity-agent-dswsm\" (UID: \"eec9af02-8e2b-445c-b2e6-c30490033dca\") " pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.808742 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.808092    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zd59\" (UniqueName: \"kubernetes.io/projected/abc80018-e818-42b5-8543-8287439abfec-kube-api-access-6zd59\") pod \"iptables-alerter-87gx4\" (UID: \"abc80018-e818-42b5-8543-8287439abfec\") " pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.808808 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.808784    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d5qt\" (UniqueName: \"kubernetes.io/projected/5941eeef-b113-457c-97b8-dda635e45fda-kube-api-access-9d5qt\") pod \"multus-vw77r\" (UID: \"5941eeef-b113-457c-97b8-dda635e45fda\") " pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.808862 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.808810    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnb8f\" (UniqueName: \"kubernetes.io/projected/0dc406ef-3e0c-425e-b064-6d8788356116-kube-api-access-vnb8f\") pod \"aws-ebs-csi-driver-node-dfgts\" (UID: \"0dc406ef-3e0c-425e-b064-6d8788356116\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.809172 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.809126    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtlfg\" (UniqueName: \"kubernetes.io/projected/afc4937a-3189-4a88-a51f-021bc1d7087f-kube-api-access-mtlfg\") pod \"ovnkube-node-p4psz\" (UID: \"afc4937a-3189-4a88-a51f-021bc1d7087f\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.810959 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.810939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jhhpd"
Jul 08 21:32:36.816196 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:36.815673    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9da1d0_5747_477e_9869_055395a27963.slice/crio-9ffca77586792d8b9c3137a54a41bda45701612d1a89c416b003c185cbcfc295 WatchSource:0}: Error finding container 9ffca77586792d8b9c3137a54a41bda45701612d1a89c416b003c185cbcfc295: Status 404 returned error can't find the container with id 9ffca77586792d8b9c3137a54a41bda45701612d1a89c416b003c185cbcfc295
Jul 08 21:32:36.817925 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.817904    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5sdsh"
Jul 08 21:32:36.821857 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:36.821833    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d3a9cf_cb53_47d7_96f1_0d108e3d3370.slice/crio-a2a2798ab0949acc559e849c453e5d744b64ac0f8c0e9facaea6900f8c93330b WatchSource:0}: Error finding container a2a2798ab0949acc559e849c453e5d744b64ac0f8c0e9facaea6900f8c93330b: Status 404 returned error can't find the container with id a2a2798ab0949acc559e849c453e5d744b64ac0f8c0e9facaea6900f8c93330b
Jul 08 21:32:36.822637 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.822618    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st4pz"
Jul 08 21:32:36.828240 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.828221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vw77r"
Jul 08 21:32:36.833020 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.833000    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts"
Jul 08 21:32:36.841930 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:36.841672    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5941eeef_b113_457c_97b8_dda635e45fda.slice/crio-0fcce75a0889e3970c6158d10ad3d9fadb7111575fd069b05f00babbf86af2d5 WatchSource:0}: Error finding container 0fcce75a0889e3970c6158d10ad3d9fadb7111575fd069b05f00babbf86af2d5: Status 404 returned error can't find the container with id 0fcce75a0889e3970c6158d10ad3d9fadb7111575fd069b05f00babbf86af2d5
Jul 08 21:32:36.841930 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.841737    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-87gx4"
Jul 08 21:32:36.846245 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.845936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:36.850139 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:36.850121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:32:36.859852 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:36.859821    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc80018_e818_42b5_8543_8287439abfec.slice/crio-ef9c96acbc6d714e2a05cdd4d9442c941163ef7ed79123726c0d6515e030e61c WatchSource:0}: Error finding container ef9c96acbc6d714e2a05cdd4d9442c941163ef7ed79123726c0d6515e030e61c: Status 404 returned error can't find the container with id ef9c96acbc6d714e2a05cdd4d9442c941163ef7ed79123726c0d6515e030e61c
Jul 08 21:32:36.864213 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:32:36.864188    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec9af02_8e2b_445c_b2e6_c30490033dca.slice/crio-e17b58980625a2252b2f212c419af61b09c3d153f650df118c5c9ad82590c34e WatchSource:0}: Error finding container e17b58980625a2252b2f212c419af61b09c3d153f650df118c5c9ad82590c34e: Status 404 returned error can't find the container with id e17b58980625a2252b2f212c419af61b09c3d153f650df118c5c9ad82590c34e
Jul 08 21:32:37.203868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.203779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:37.203868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.203825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:37.203868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.203844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:37.204104 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.203951    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:37.204104 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.203975    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:37.204104 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.204002    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:37.204104 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.204014    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjdgp for pod openshift-network-diagnostics/network-check-target-7phf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:37.204104 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.203951    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:37.204104 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.204014    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret podName:7f6b1f15-6513-4c37-b92a-389ab8198f22 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:38.203999581 +0000 UTC m=+4.093780589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret") pod "global-pull-secret-syncer-gpv9z" (UID: "7f6b1f15-6513-4c37-b92a-389ab8198f22") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:37.204104 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.204092    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp podName:14697219-9ef6-4c89-8a45-9b4f278a69c7 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:38.204070185 +0000 UTC m=+4.093851191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjdgp" (UniqueName: "kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp") pod "network-check-target-7phf6" (UID: "14697219-9ef6-4c89-8a45-9b4f278a69c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:37.204323 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.204111    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs podName:00d98c92-dae5-494f-90e1-151bad0345c3 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:38.204103036 +0000 UTC m=+4.093884042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs") pod "network-metrics-daemon-sk6pm" (UID: "00d98c92-dae5-494f-90e1-151bad0345c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:37.570518 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.570377    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:27:36 +0000 UTC" deadline="2028-03-18 07:56:06.431899028 +0000 UTC"
Jul 08 21:32:37.570518 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.570474    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14842h23m28.861439934s"
Jul 08 21:32:37.623637 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.623368    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:37.623637 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:37.623511    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:37.630484 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.630352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"53ed43f8caa41668732184a89385903cbc8f8c51e61b48dddb5db1504753af52"}
Jul 08 21:32:37.631705 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.631654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dswsm" event={"ID":"eec9af02-8e2b-445c-b2e6-c30490033dca","Type":"ContainerStarted","Data":"e17b58980625a2252b2f212c419af61b09c3d153f650df118c5c9ad82590c34e"}
Jul 08 21:32:37.633059 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.633011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts" event={"ID":"0dc406ef-3e0c-425e-b064-6d8788356116","Type":"ContainerStarted","Data":"a52cabb6ee84dce915f9716cdc4d3f99f4893c2571c440b3f01ad4d86fe3dde4"}
Jul 08 21:32:37.634265 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.634242    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st4pz" event={"ID":"5497da6c-6934-4f30-8490-c51167543559","Type":"ContainerStarted","Data":"9ad117ea48e088664f2d965c08fa2cfe5fdfed4fa9e5191715bdb0a70a84d37a"}
Jul 08 21:32:37.635600 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.635554    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5sdsh" event={"ID":"8e2e803b-d842-42c3-93a7-2f8a6482bbd5","Type":"ContainerStarted","Data":"a108b330b5089558b71b817f67781f0de0ad7509384f84ab08d6882a2b8cd488"}
Jul 08 21:32:37.636911 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.636886    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jhhpd" event={"ID":"73d3a9cf-cb53-47d7-96f1-0d108e3d3370","Type":"ContainerStarted","Data":"a2a2798ab0949acc559e849c453e5d744b64ac0f8c0e9facaea6900f8c93330b"}
Jul 08 21:32:37.638560 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.638508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerStarted","Data":"9ffca77586792d8b9c3137a54a41bda45701612d1a89c416b003c185cbcfc295"}
Jul 08 21:32:37.640380 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.640357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-87gx4" event={"ID":"abc80018-e818-42b5-8543-8287439abfec","Type":"ContainerStarted","Data":"ef9c96acbc6d714e2a05cdd4d9442c941163ef7ed79123726c0d6515e030e61c"}
Jul 08 21:32:37.641866 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:37.641827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vw77r" event={"ID":"5941eeef-b113-457c-97b8-dda635e45fda","Type":"ContainerStarted","Data":"0fcce75a0889e3970c6158d10ad3d9fadb7111575fd069b05f00babbf86af2d5"}
Jul 08 21:32:38.213030 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:38.212986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:38.213206 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:38.213051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:38.213206 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:38.213085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:38.213316 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213227    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:38.213316 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213290    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs podName:00d98c92-dae5-494f-90e1-151bad0345c3 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:40.213271168 +0000 UTC m=+6.103052174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs") pod "network-metrics-daemon-sk6pm" (UID: "00d98c92-dae5-494f-90e1-151bad0345c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:38.213780 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213758    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:38.213867 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213787    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:38.213867 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213801    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjdgp for pod openshift-network-diagnostics/network-check-target-7phf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:38.213867 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213846    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp podName:14697219-9ef6-4c89-8a45-9b4f278a69c7 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:40.213831689 +0000 UTC m=+6.103612710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjdgp" (UniqueName: "kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp") pod "network-check-target-7phf6" (UID: "14697219-9ef6-4c89-8a45-9b4f278a69c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:38.214035 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213903    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:38.214035 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.213935    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret podName:7f6b1f15-6513-4c37-b92a-389ab8198f22 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:40.213923357 +0000 UTC m=+6.103704366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret") pod "global-pull-secret-syncer-gpv9z" (UID: "7f6b1f15-6513-4c37-b92a-389ab8198f22") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:38.571740 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:38.571654    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:27:36 +0000 UTC" deadline="2028-03-11 05:49:19.787702459 +0000 UTC"
Jul 08 21:32:38.571740 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:38.571693    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14672h16m41.216013934s"
Jul 08 21:32:38.628666 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:38.627993    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:38.628666 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.628122    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:38.628666 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:38.628504    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:38.628666 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:38.628628    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:39.624379 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:39.623907    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:39.624379 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:39.624040    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:40.233379 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:40.233341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:40.233584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:40.233404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:40.233584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:40.233451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:40.233697 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233590    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:40.233697 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233649    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs podName:00d98c92-dae5-494f-90e1-151bad0345c3 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:44.233630951 +0000 UTC m=+10.123411959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs") pod "network-metrics-daemon-sk6pm" (UID: "00d98c92-dae5-494f-90e1-151bad0345c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:40.233815 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233736    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:40.233815 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233780    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret podName:7f6b1f15-6513-4c37-b92a-389ab8198f22 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:44.233767774 +0000 UTC m=+10.123548792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret") pod "global-pull-secret-syncer-gpv9z" (UID: "7f6b1f15-6513-4c37-b92a-389ab8198f22") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:40.233923 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233852    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:40.233923 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233867    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:40.233923 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233879    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjdgp for pod openshift-network-diagnostics/network-check-target-7phf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:40.234065 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.233926    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp podName:14697219-9ef6-4c89-8a45-9b4f278a69c7 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:44.233914407 +0000 UTC m=+10.123695417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjdgp" (UniqueName: "kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp") pod "network-check-target-7phf6" (UID: "14697219-9ef6-4c89-8a45-9b4f278a69c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:40.624200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:40.623632    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:40.624200 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.623756    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:40.624200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:40.623631    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:40.624200 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:40.624107    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:41.623859 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:41.623324    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:41.623859 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:41.623462    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:42.623659 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:42.623626    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:42.624092 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:42.623748    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:42.624168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:42.624121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:42.624270 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:42.624247    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:43.624292 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:43.624258    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:43.624799 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:43.624392    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:44.264386 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:44.264354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:44.264584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:44.264404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:44.264584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:44.264449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:44.264584 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264506    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:44.264584 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264534    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:44.264584 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264545    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjdgp for pod openshift-network-diagnostics/network-check-target-7phf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:44.264584 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264545    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:44.264791 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264584    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:44.264791 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264601    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp podName:14697219-9ef6-4c89-8a45-9b4f278a69c7 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:52.264581158 +0000 UTC m=+18.154362175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjdgp" (UniqueName: "kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp") pod "network-check-target-7phf6" (UID: "14697219-9ef6-4c89-8a45-9b4f278a69c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:44.264791 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264623    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs podName:00d98c92-dae5-494f-90e1-151bad0345c3 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:52.264612966 +0000 UTC m=+18.154393969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs") pod "network-metrics-daemon-sk6pm" (UID: "00d98c92-dae5-494f-90e1-151bad0345c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:44.264791 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.264637    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret podName:7f6b1f15-6513-4c37-b92a-389ab8198f22 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:52.264630066 +0000 UTC m=+18.154411068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret") pod "global-pull-secret-syncer-gpv9z" (UID: "7f6b1f15-6513-4c37-b92a-389ab8198f22") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:44.625806 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:44.625090    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:44.625806 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.625195    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:44.625806 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:44.625607    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:44.625806 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:44.625712    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:45.623644 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:45.623611    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:45.623876 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:45.623729    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:46.625102 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:46.624855    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:46.625548 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:46.625019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:46.625548 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:46.625218    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:46.625548 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:46.625284    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:47.624087 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.623841    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:47.624087 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:47.623976    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:47.664594 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.664556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal" event={"ID":"b879b5091a7ea1cbfad7b9a13d6cbe14","Type":"ContainerStarted","Data":"b5c982d689c73675e52bab742bdcb28e60cb7c345d4c5774d71a7e0271b68b23"}
Jul 08 21:32:47.666602 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.666574    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dswsm" event={"ID":"eec9af02-8e2b-445c-b2e6-c30490033dca","Type":"ContainerStarted","Data":"a8d802865b986101518701100bf29995ffc38c5291b382e6c9e4e33d0d359d17"}
Jul 08 21:32:47.668156 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.668128    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts" event={"ID":"0dc406ef-3e0c-425e-b064-6d8788356116","Type":"ContainerStarted","Data":"03cc9dd00752e1f4110dc4a7b678af4784808046343d5272138e4024bcd8ec8a"}
Jul 08 21:32:47.669685 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.669661    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st4pz" event={"ID":"5497da6c-6934-4f30-8490-c51167543559","Type":"ContainerStarted","Data":"e405d470a8d6e4a721eafd09e1cf4bdc0759034711e35c5358c4c311113b5e85"}
Jul 08 21:32:47.671113 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.671084    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5sdsh" event={"ID":"8e2e803b-d842-42c3-93a7-2f8a6482bbd5","Type":"ContainerStarted","Data":"451d745c2b7c1a3bc1532f14f7840154f1709c818e3348b92512da86dbc79f59"}
Jul 08 21:32:47.675466 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.675441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jhhpd" event={"ID":"73d3a9cf-cb53-47d7-96f1-0d108e3d3370","Type":"ContainerStarted","Data":"69c05b4fa6452fdd25249f8f17da33d081d6faa023c887645d311c20c8682b5d"}
Jul 08 21:32:47.676904 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.676883    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c9da1d0-5747-477e-9869-055395a27963" containerID="f134abba520567d2f648e145a93338f380833b07aa783a5aead9515103b47d5e" exitCode=0
Jul 08 21:32:47.676990 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.676934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerDied","Data":"f134abba520567d2f648e145a93338f380833b07aa783a5aead9515103b47d5e"}
Jul 08 21:32:47.678644 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.678619    2568 generic.go:356] "Generic (PLEG): container finished" podID="bf3ea5c4b67941a39a18d70904f17e2a" containerID="3e1076d050cb44e85e0a4544e30c30288e69b4f1f8a77466dab35adae54db96f" exitCode=0
Jul 08 21:32:47.678737 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.678654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal" event={"ID":"bf3ea5c4b67941a39a18d70904f17e2a","Type":"ContainerDied","Data":"3e1076d050cb44e85e0a4544e30c30288e69b4f1f8a77466dab35adae54db96f"}
Jul 08 21:32:47.698356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.698184    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-2.ec2.internal" podStartSLOduration=12.69817187 podStartE2EDuration="12.69817187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:47.682175328 +0000 UTC m=+13.571956354" watchObservedRunningTime="2026-07-08 21:32:47.69817187 +0000 UTC m=+13.587952928"
Jul 08 21:32:47.698905 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.698864    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dswsm" podStartSLOduration=2.59055142 podStartE2EDuration="12.698853366s" totalImagesPullingTime="10.108301946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:47.697887388 +0000 UTC m=+13.587668414" watchObservedRunningTime="2026-07-08 21:32:47.698853366 +0000 UTC m=+13.588634389"
Jul 08 21:32:47.789612 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.789562    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jhhpd" podStartSLOduration=3.657279037 podStartE2EDuration="13.789541867s" totalImagesPullingTime="10.13226283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:47.773996013 +0000 UTC m=+13.663777040" watchObservedRunningTime="2026-07-08 21:32:47.789541867 +0000 UTC m=+13.679322893"
Jul 08 21:32:47.789749 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.789712    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5sdsh" podStartSLOduration=3.65707915 podStartE2EDuration="13.789701605s" totalImagesPullingTime="10.132622455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:47.788927242 +0000 UTC m=+13.678708268" watchObservedRunningTime="2026-07-08 21:32:47.789701605 +0000 UTC m=+13.679482630"
Jul 08 21:32:47.810325 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:47.810274    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-st4pz" podStartSLOduration=3.654762259 podStartE2EDuration="13.8102547s" totalImagesPullingTime="10.155492441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:47.81020963 +0000 UTC m=+13.699990657" watchObservedRunningTime="2026-07-08 21:32:47.8102547 +0000 UTC m=+13.700035728"
Jul 08 21:32:48.624817 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:48.624331    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:48.624817 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:48.624335    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:48.624817 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:48.624481    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:48.624817 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:48.624570    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:48.683317 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:48.683274    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal" event={"ID":"bf3ea5c4b67941a39a18d70904f17e2a","Type":"ContainerStarted","Data":"c4760cdc253196d896eb6ff23d452c89886e4b6bc26e0df4e837455ad443fb9d"}
Jul 08 21:32:48.685202 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:48.685173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-87gx4" event={"ID":"abc80018-e818-42b5-8543-8287439abfec","Type":"ContainerStarted","Data":"63af7a22cf7c81c0eca82d8469988ab295ad6dfca9e898f644a1d32b4e0be25f"}
Jul 08 21:32:48.742487 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:48.742128    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-2.ec2.internal" podStartSLOduration=13.742109644 podStartE2EDuration="13.742109644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:48.707871351 +0000 UTC m=+14.597652387" watchObservedRunningTime="2026-07-08 21:32:48.742109644 +0000 UTC m=+14.631890670"
Jul 08 21:32:49.624396 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:49.624355    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:49.624597 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:49.624506    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:50.046895 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:50.046805    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:50.047744 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:50.047709    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:50.067765 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:50.067718    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-87gx4" podStartSLOduration=5.956709097 podStartE2EDuration="15.06770427s" totalImagesPullingTime="9.110995173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:48.743249471 +0000 UTC m=+14.633030478" watchObservedRunningTime="2026-07-08 21:32:50.06770427 +0000 UTC m=+15.957485294"
Jul 08 21:32:50.623999 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:50.623965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:50.624185 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:50.624095    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:50.624185 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:50.624143    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:50.624335 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:50.624264    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:50.690218 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:50.690162    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:50.690698 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:50.690677    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dswsm"
Jul 08 21:32:51.624304 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:51.624266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:51.624972 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:51.624390    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:52.327794 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:52.327753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:52.328008 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:52.327802    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:52.328008 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.327910    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:52.328008 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.327932    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:52.328008 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.327955    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:52.328008 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.327970    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjdgp for pod openshift-network-diagnostics/network-check-target-7phf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:52.328264 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.328022    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp podName:14697219-9ef6-4c89-8a45-9b4f278a69c7 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:08.328004061 +0000 UTC m=+34.217785074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjdgp" (UniqueName: "kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp") pod "network-check-target-7phf6" (UID: "14697219-9ef6-4c89-8a45-9b4f278a69c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:52.328264 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:52.328051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:52.328264 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.328188    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:52.328264 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.328215    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs podName:00d98c92-dae5-494f-90e1-151bad0345c3 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:08.32820724 +0000 UTC m=+34.217988246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs") pod "network-metrics-daemon-sk6pm" (UID: "00d98c92-dae5-494f-90e1-151bad0345c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:52.328545 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.328519    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret podName:7f6b1f15-6513-4c37-b92a-389ab8198f22 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:08.328495597 +0000 UTC m=+34.218276619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret") pod "global-pull-secret-syncer-gpv9z" (UID: "7f6b1f15-6513-4c37-b92a-389ab8198f22") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:52.623572 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:52.623496    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:52.623711 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.623633    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:52.623711 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:52.623684    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:52.623821 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:52.623791    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:53.624133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:53.624106    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:53.624733 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:53.624219    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:54.624455 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:54.624426    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:54.624889 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:54.624536    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:54.624889 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:54.624605    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:54.624889 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:54.624705    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:55.624268 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:55.624229    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:55.624483 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:55.624347    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:56.623678 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:56.623635    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:56.623862 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:56.623772    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:56.623862 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:56.623821    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:56.623960 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:56.623942    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:57.624382 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:57.624347    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:57.624903 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:57.624468    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:58.623813 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:58.623783    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:32:58.624136 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:58.623913    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:32:58.624207 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:58.623959    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:32:58.624281 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:58.624255    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:32:59.239342 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.239315    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 21:32:59.599078 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.598878    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T21:32:59.239338611Z","UUID":"a5c862ce-3fd2-4904-bc7b-f3d1e65fbf99","Handler":null,"Name":"","Endpoint":""}
Jul 08 21:32:59.600130 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.600112    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 21:32:59.600221 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.600144    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 21:32:59.623919 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.623901    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:32:59.623999 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:32:59.623981    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:32:59.709577 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.709552    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts" event={"ID":"0dc406ef-3e0c-425e-b064-6d8788356116","Type":"ContainerStarted","Data":"be9322b549493459a33f77c0bd4e3fcf28acc67620156585531656e9d98f86b8"}
Jul 08 21:32:59.711168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.711144    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c9da1d0-5747-477e-9869-055395a27963" containerID="d104c1ff8e63e7a019b609ad7f18da28e801863f0084971320d5ae25904c6a0f" exitCode=0
Jul 08 21:32:59.711249 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.711224    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerDied","Data":"d104c1ff8e63e7a019b609ad7f18da28e801863f0084971320d5ae25904c6a0f"}
Jul 08 21:32:59.712575 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.712547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vw77r" event={"ID":"5941eeef-b113-457c-97b8-dda635e45fda","Type":"ContainerStarted","Data":"f759207a4a31c38b8b184e49f88b6e16bf5a8034fa2f2d3e26943dc53086f4b3"}
Jul 08 21:32:59.715141 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715124    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:32:59.715488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715471    2568 generic.go:356] "Generic (PLEG): container finished" podID="afc4937a-3189-4a88-a51f-021bc1d7087f" containerID="eb255570e72e62bc34c4d482a79870eafad8a3a5df0ad62806ef4598ecdd56f8" exitCode=1
Jul 08 21:32:59.715544 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715496    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"0d19a162b166f2fdc95cb1299ace8d19994e47b475a8137c4ef469d19510d32d"}
Jul 08 21:32:59.715577 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715546    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"bbc5ef46d05173ba41e939b0695ccd6f36b8b6447f7b22b7455b50138a4c6c72"}
Jul 08 21:32:59.715606 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715576    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"6c4d5d0f4a224a64d698b425ed4ef09258c226b834aad432c31668beb2b75175"}
Jul 08 21:32:59.715606 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715603    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"8bc69b21df6030db20febb33b98638f2ff688566b0cb18d5187fc2f785ae5077"}
Jul 08 21:32:59.715669 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715631    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerDied","Data":"eb255570e72e62bc34c4d482a79870eafad8a3a5df0ad62806ef4598ecdd56f8"}
Jul 08 21:32:59.715669 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.715658    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"a6419ca0a605f21f8f75f39d0ee8a70d1df573815de89b0a28968af557645053"}
Jul 08 21:32:59.751228 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:32:59.751189    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vw77r" podStartSLOduration=2.514400246 podStartE2EDuration="24.751175619s" totalImagesPullingTime="22.236775373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:32:59.751083005 +0000 UTC m=+25.640864030" watchObservedRunningTime="2026-07-08 21:32:59.751175619 +0000 UTC m=+25.640956644"
Jul 08 21:33:00.623653 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:00.623624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:00.624136 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:00.623668    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:00.624136 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:00.623764    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:33:00.624136 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:00.623871    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:33:01.623549 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:01.623522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:01.623682 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:01.623615    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:33:01.721036 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:01.720962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts" event={"ID":"0dc406ef-3e0c-425e-b064-6d8788356116","Type":"ContainerStarted","Data":"43637e9eb58751816c6fb285be83447329156533aca692bf23526b7be94e48d9"}
Jul 08 21:33:01.723004 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:01.722981    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c9da1d0-5747-477e-9869-055395a27963" containerID="e33aa1dd6b076da321ba9903ff4e12728d54228489e724504a9ba0659a43fe75" exitCode=0
Jul 08 21:33:01.723137 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:01.723015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerDied","Data":"e33aa1dd6b076da321ba9903ff4e12728d54228489e724504a9ba0659a43fe75"}
Jul 08 21:33:01.767603 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:01.767562    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfgts" podStartSLOduration=3.551855216 podStartE2EDuration="26.767548144s" totalImagesPullingTime="23.215692928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:01.739158342 +0000 UTC m=+27.628939377" watchObservedRunningTime="2026-07-08 21:33:01.767548144 +0000 UTC m=+27.657329179"
Jul 08 21:33:02.623830 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:02.623797    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:02.624245 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:02.623797    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:02.624245 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:02.623932    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:33:02.624245 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:02.623974    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:33:02.728045 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:02.728018    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:33:02.728396 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:02.728375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"c81eaa377ef09d01b7fcde6823aa849d971e33aa100a4f34820cb1bb4155afe8"}
Jul 08 21:33:03.623672 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:03.623639    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:03.623844 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:03.623746    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:33:03.732331 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:03.732299    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c9da1d0-5747-477e-9869-055395a27963" containerID="ff5c018a9149836c442aa292ad1cc5d7bb44b3407279fa13520ab1ab79914099" exitCode=0
Jul 08 21:33:03.732507 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:03.732355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerDied","Data":"ff5c018a9149836c442aa292ad1cc5d7bb44b3407279fa13520ab1ab79914099"}
Jul 08 21:33:04.626565 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.626298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:04.627132 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:04.626685    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:33:04.627543 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.627512    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:04.628099 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:04.628066    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:33:04.737091 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.737065    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:33:04.737445 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.737422    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"1d54578c073be1f04e70be6c944be082f9070177c0afd51fca01df1db056b938"}
Jul 08 21:33:04.737707 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.737685    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:33:04.737786 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.737774    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:33:04.737864 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.737849    2568 scope.go:117] "RemoveContainer" containerID="eb255570e72e62bc34c4d482a79870eafad8a3a5df0ad62806ef4598ecdd56f8"
Jul 08 21:33:04.753758 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:04.753737    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:33:05.623733 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:05.623708    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:05.623891 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:05.623812    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:33:05.745961 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:05.745934    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:33:05.746388 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:05.746362    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" event={"ID":"afc4937a-3189-4a88-a51f-021bc1d7087f","Type":"ContainerStarted","Data":"247ac1cfdc233c22ce10bce887264600a222f0f0ef43aa2c39cb5dd7e82aeff3"}
Jul 08 21:33:05.746930 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:05.746877    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:33:05.766301 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:05.766270    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:33:05.774387 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:05.774246    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz" podStartSLOduration=8.527046374 podStartE2EDuration="30.774227137s" totalImagesPullingTime="22.247180763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:05.772158162 +0000 UTC m=+31.661939189" watchObservedRunningTime="2026-07-08 21:33:05.774227137 +0000 UTC m=+31.664008163"
Jul 08 21:33:06.005759 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:06.005673    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gpv9z"]
Jul 08 21:33:06.005917 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:06.005825    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:06.005960 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:06.005909    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:33:06.009322 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:06.009087    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7phf6"]
Jul 08 21:33:06.009322 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:06.009189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:06.009322 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:06.009283    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:33:06.009805 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:06.009781    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sk6pm"]
Jul 08 21:33:06.009914 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:06.009884    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:06.009985 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:06.009967    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:33:07.623996 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:07.623964    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:07.624500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:07.624002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:07.624500 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:07.624002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:07.624500 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:07.624099    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:33:07.624500 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:07.624192    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:33:07.624500 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:07.624262    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:33:08.342256 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:08.342226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:08.342376 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:08.342274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:08.342376 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:08.342297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:08.342376 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342348    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:33:08.342376 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342374    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:33:08.342601 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342387    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjdgp for pod openshift-network-diagnostics/network-check-target-7phf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:08.342601 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342353    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:08.342601 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342429    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:08.342601 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342464    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp podName:14697219-9ef6-4c89-8a45-9b4f278a69c7 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:40.342432156 +0000 UTC m=+66.232213176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjdgp" (UniqueName: "kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp") pod "network-check-target-7phf6" (UID: "14697219-9ef6-4c89-8a45-9b4f278a69c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:08.342601 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342484    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret podName:7f6b1f15-6513-4c37-b92a-389ab8198f22 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:40.342472165 +0000 UTC m=+66.232253181 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret") pod "global-pull-secret-syncer-gpv9z" (UID: "7f6b1f15-6513-4c37-b92a-389ab8198f22") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:08.342601 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:08.342499    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs podName:00d98c92-dae5-494f-90e1-151bad0345c3 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:40.342491787 +0000 UTC m=+66.232272797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs") pod "network-metrics-daemon-sk6pm" (UID: "00d98c92-dae5-494f-90e1-151bad0345c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:08.755574 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:08.755375    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c9da1d0-5747-477e-9869-055395a27963" containerID="0c07350cd705e306bc5b0bb233f1841484e615128bee779532636a0203bde916" exitCode=0
Jul 08 21:33:08.755574 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:08.755459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerDied","Data":"0c07350cd705e306bc5b0bb233f1841484e615128bee779532636a0203bde916"}
Jul 08 21:33:09.624239 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:09.624209    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:09.624239 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:09.624224    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:09.624470 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:09.624213    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:09.624470 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:09.624312    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:33:09.624470 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:09.624371    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:33:09.624470 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:09.624460    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:33:09.761961 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:09.761924    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c9da1d0-5747-477e-9869-055395a27963" containerID="614590b07c84e0ef897609b5be7271a9d0b22e71c39c16c1aad3c5c1d920698b" exitCode=0
Jul 08 21:33:09.762620 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:09.761980    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerDied","Data":"614590b07c84e0ef897609b5be7271a9d0b22e71c39c16c1aad3c5c1d920698b"}
Jul 08 21:33:10.767216 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:10.767186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frtjk" event={"ID":"9c9da1d0-5747-477e-9869-055395a27963","Type":"ContainerStarted","Data":"46b76eca5070700f8dab6aacc886aacdb65376f98d9bc2360818d1e2395d66c6"}
Jul 08 21:33:10.792332 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:10.792287    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-frtjk" podStartSLOduration=7.814079479 podStartE2EDuration="36.792274862s" totalImagesPullingTime="28.978195383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:10.791885951 +0000 UTC m=+36.681666995" watchObservedRunningTime="2026-07-08 21:33:10.792274862 +0000 UTC m=+36.682055887"
Jul 08 21:33:11.624240 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.624205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:11.624389 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.624205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:11.624389 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:11.624303    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gpv9z" podUID="7f6b1f15-6513-4c37-b92a-389ab8198f22"
Jul 08 21:33:11.624526 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:11.624405    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk6pm" podUID="00d98c92-dae5-494f-90e1-151bad0345c3"
Jul 08 21:33:11.624526 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.624215    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:11.624526 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:11.624500    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7phf6" podUID="14697219-9ef6-4c89-8a45-9b4f278a69c7"
Jul 08 21:33:11.892499 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.892427    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-2.ec2.internal" event="NodeReady"
Jul 08 21:33:11.892934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.892538    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 21:33:11.930490 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.930459    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b79667f8c-hbzfc"]
Jul 08 21:33:11.943186 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.943159    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"]
Jul 08 21:33:11.943317 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.943279    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:11.945633 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.945606    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 21:33:11.945777 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.945671    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-psx4j\""
Jul 08 21:33:11.945777 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.945692    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 21:33:11.945777 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.945724    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 21:33:11.951199 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.951174    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 21:33:11.956645 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.956617    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"]
Jul 08 21:33:11.956750 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.956734    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:11.959807 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.959790    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gptr6\""
Jul 08 21:33:11.959925 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.959794    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 08 21:33:11.960148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.960133    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 08 21:33:11.960558 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.960544    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:33:11.968799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.968760    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"]
Jul 08 21:33:11.968904 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.968809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:11.971199 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.971179    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 08 21:33:11.972220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.971815    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xd2xj\""
Jul 08 21:33:11.972220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.972036    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 21:33:11.972371 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.972363    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 21:33:11.973307 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.973281    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 08 21:33:11.981425 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.981395    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-666f696759-zrbhg"]
Jul 08 21:33:11.981546 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.981528    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:11.984051 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.984031    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 08 21:33:11.984147 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.984099    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-blbt6\""
Jul 08 21:33:11.984226 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.984207    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 08 21:33:11.984343 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.984326    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:33:11.984404 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.984380    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 08 21:33:11.997739 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.997718    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tctgf"]
Jul 08 21:33:11.997854 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.997839    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:11.999935 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:11.999916    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 08 21:33:12.000187 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.000162    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 08 21:33:12.000484 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.000463    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 21:33:12.000598 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.000505    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 08 21:33:12.000598 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.000537    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 21:33:12.000598 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.000566    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 08 21:33:12.000753 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.000677    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rznh6\""
Jul 08 21:33:12.016293 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.016267    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.016293 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.016280    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"]
Jul 08 21:33:12.018936 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.018909    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 08 21:33:12.019040 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.018933    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 08 21:33:12.019040 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.018940    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g2qt6\""
Jul 08 21:33:12.019040 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.019002    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:33:12.019213 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.019202    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 08 21:33:12.023549 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.023532    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 08 21:33:12.028111 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.028095    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"]
Jul 08 21:33:12.028222 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.028210    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"
Jul 08 21:33:12.030511 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.030486    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:33:12.030603 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.030565    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 21:33:12.030666 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.030651    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tw975\""
Jul 08 21:33:12.044520 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.044505    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gqh2c"]
Jul 08 21:33:12.044624 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.044607    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.048006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.047949    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 08 21:33:12.048169 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.047969    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 08 21:33:12.049274 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.048230    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:33:12.049274 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.048289    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 08 21:33:12.049274 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.048233    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-czjnr\""
Jul 08 21:33:12.061121 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.061105    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b79667f8c-hbzfc"]
Jul 08 21:33:12.061220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.061129    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"]
Jul 08 21:33:12.061220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.061157    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wc4xn"]
Jul 08 21:33:12.061435 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.061236    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.063789 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.063772    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 08 21:33:12.064465 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.064449    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 21:33:12.064553 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.064526    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 08 21:33:12.064611 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.064579    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f6tbs\""
Jul 08 21:33:12.064727 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.064710    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 21:33:12.069570 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069549    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-default-certificate\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.069659 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069592    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8bt2\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-kube-api-access-t8bt2\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.069659 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.069746 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069667    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-trusted-ca\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.069746 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069691    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/910bb007-8fa4-41af-9dd0-02e4907460f5-trusted-ca\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.069746 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltr5c\" (UniqueName: \"kubernetes.io/projected/910bb007-8fa4-41af-9dd0-02e4907460f5-kube-api-access-ltr5c\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.069746 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069736    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:12.069898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.069898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq87x\" (UniqueName: \"kubernetes.io/projected/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-kube-api-access-mq87x\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.069898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/910bb007-8fa4-41af-9dd0-02e4907460f5-serving-cert\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.069898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069816    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.069898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069830    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-certificates\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.069898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069848    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-bound-sa-token\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.069898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p49r5\" (UniqueName: \"kubernetes.io/projected/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-kube-api-access-p49r5\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069912    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qhtr\" (UniqueName: \"kubernetes.io/projected/2ca1c862-0bb7-4a32-8029-178e63da5bde-kube-api-access-8qhtr\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-image-registry-private-configuration\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.069990    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-installation-pull-secrets\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.070011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-stats-auth\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.070028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br74r\" (UniqueName: \"kubernetes.io/projected/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-kube-api-access-br74r\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.070058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ca1c862-0bb7-4a32-8029-178e63da5bde-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.070133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.070125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.070393 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.070147    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcfdccbd-422e-49d1-b979-2a5893a07140-ca-trust-extracted\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.070393 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.070165    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/910bb007-8fa4-41af-9dd0-02e4907460f5-config\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.070605 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.070589    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 08 21:33:12.071120 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.071106    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"]
Jul 08 21:33:12.071234 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.071222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.073634 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.073617    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 21:33:12.073634 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.073627    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 21:33:12.073774 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.073652    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 21:33:12.073913 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.073899    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kngpn\""
Jul 08 21:33:12.085801 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.085784    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d67sg"]
Jul 08 21:33:12.085898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.085886    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"
Jul 08 21:33:12.089153 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.089138    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:33:12.089558 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.089545    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:33:12.090176 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.090162    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wr49t\""
Jul 08 21:33:12.093831 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093815    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"]
Jul 08 21:33:12.093905 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093841    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"]
Jul 08 21:33:12.093905 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093856    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-666f696759-zrbhg"]
Jul 08 21:33:12.093905 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093868    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gqh2c"]
Jul 08 21:33:12.093997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093922    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.093997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093951    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tctgf"]
Jul 08 21:33:12.093997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wc4xn"]
Jul 08 21:33:12.093997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093975    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"]
Jul 08 21:33:12.093997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093985    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d67sg"]
Jul 08 21:33:12.093997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.093998    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"]
Jul 08 21:33:12.094172 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.094013    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"]
Jul 08 21:33:12.096696 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.096680    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 21:33:12.096766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.096688    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfpxn\""
Jul 08 21:33:12.096874 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.096859    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 21:33:12.171236 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-default-certificate\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.171236 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-trusted-ca\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.171236 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d592cb17-8a58-4916-b7e8-c67fc17c57d3-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-config-volume\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kj5s\" (UniqueName: \"kubernetes.io/projected/64b1542c-e26f-4e5c-97c8-67287f0229f6-kube-api-access-7kj5s\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171295    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v9hw\" (UniqueName: \"kubernetes.io/projected/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-kube-api-access-5v9hw\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b1542c-e26f-4e5c-97c8-67287f0229f6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.171404    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:12.671389141 +0000 UTC m=+38.561170174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : configmap references non-existent config key: service-ca.crt
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171457    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-certificates\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.171529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qhtr\" (UniqueName: \"kubernetes.io/projected/2ca1c862-0bb7-4a32-8029-178e63da5bde-kube-api-access-8qhtr\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d592cb17-8a58-4916-b7e8-c67fc17c57d3-config\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.171596    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171602    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b1542c-e26f-4e5c-97c8-67287f0229f6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171639    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br74r\" (UniqueName: \"kubernetes.io/projected/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-kube-api-access-br74r\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.171659    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:12.671639525 +0000 UTC m=+38.561420547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : secret "router-metrics-certs-default" not found
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bcd5bd-d55d-4a13-86f2-a85f45855f0d-cert\") pod \"ingress-canary-wc4xn\" (UID: \"95bcd5bd-d55d-4a13-86f2-a85f45855f0d\") " pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcfdccbd-422e-49d1-b979-2a5893a07140-ca-trust-extracted\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpwgt\" (UniqueName: \"kubernetes.io/projected/d592cb17-8a58-4916-b7e8-c67fc17c57d3-kube-api-access-lpwgt\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64b1542c-e26f-4e5c-97c8-67287f0229f6-tmp\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171882    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltr5c\" (UniqueName: \"kubernetes.io/projected/910bb007-8fa4-41af-9dd0-02e4907460f5-kube-api-access-ltr5c\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.171948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171930    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171955    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64b1542c-e26f-4e5c-97c8-67287f0229f6-serving-cert\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.171984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8bt2\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-kube-api-access-t8bt2\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/910bb007-8fa4-41af-9dd0-02e4907460f5-trusted-ca\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172015    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-certificates\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172035    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88s67\" (UniqueName: \"kubernetes.io/projected/95bcd5bd-d55d-4a13-86f2-a85f45855f0d-kube-api-access-88s67\") pod \"ingress-canary-wc4xn\" (UID: \"95bcd5bd-d55d-4a13-86f2-a85f45855f0d\") " pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/64b1542c-e26f-4e5c-97c8-67287f0229f6-snapshots\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172088    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.172099    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq87x\" (UniqueName: \"kubernetes.io/projected/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-kube-api-access-mq87x\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172118    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcfdccbd-422e-49d1-b979-2a5893a07140-ca-trust-extracted\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/910bb007-8fa4-41af-9dd0-02e4907460f5-serving-cert\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.172656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172176    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.172194    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls podName:2ca1c862-0bb7-4a32-8029-178e63da5bde nodeName:}" failed. No retries permitted until 2026-07-08 21:33:12.672179026 +0000 UTC m=+38.561960047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mxn6k" (UID: "2ca1c862-0bb7-4a32-8029-178e63da5bde") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172209    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-trusted-ca\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172222    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-bound-sa-token\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172360    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p49r5\" (UniqueName: \"kubernetes.io/projected/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-kube-api-access-p49r5\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172363    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.172444    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.172486    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls podName:04a6af8c-e28a-4879-b0d3-5dd9f88e7004 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:12.672472747 +0000 UTC m=+38.562253750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l9wgx" (UID: "04a6af8c-e28a-4879-b0d3-5dd9f88e7004") : secret "samples-operator-tls" not found
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-image-registry-private-configuration\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-tmp-dir\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-installation-pull-secrets\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.173124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-stats-auth\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172768    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45f22\" (UniqueName: \"kubernetes.io/projected/ef4b704b-7986-43eb-a909-5640bef2b64c-kube-api-access-45f22\") pod \"network-check-source-989f8b8dc-48ttc\" (UID: \"ef4b704b-7986-43eb-a909-5640bef2b64c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ca1c862-0bb7-4a32-8029-178e63da5bde-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/910bb007-8fa4-41af-9dd0-02e4907460f5-config\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.172878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjgfz\" (UniqueName: \"kubernetes.io/projected/276d05e1-a1f8-4271-be95-6e5e0532be97-kube-api-access-zjgfz\") pod \"volume-data-source-validator-5d456fdbcd-gf2c5\" (UID: \"276d05e1-a1f8-4271-be95-6e5e0532be97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.172697    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.172969    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b79667f8c-hbzfc: secret "image-registry-tls" not found
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.173004    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls podName:dcfdccbd-422e-49d1-b979-2a5893a07140 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:12.672992935 +0000 UTC m=+38.562773957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls") pod "image-registry-5b79667f8c-hbzfc" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140") : secret "image-registry-tls" not found
Jul 08 21:33:12.173639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.173344    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/910bb007-8fa4-41af-9dd0-02e4907460f5-trusted-ca\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.174122 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.174080    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ca1c862-0bb7-4a32-8029-178e63da5bde-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.174425 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.174383    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/910bb007-8fa4-41af-9dd0-02e4907460f5-config\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.176189 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.176162    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.176354 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.176325    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/910bb007-8fa4-41af-9dd0-02e4907460f5-serving-cert\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.176537 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.176517    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-stats-auth\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.176605 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.176573    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-image-registry-private-configuration\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.176656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.176633    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-default-certificate\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.177006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.176987    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-installation-pull-secrets\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.180503 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.180483    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qhtr\" (UniqueName: \"kubernetes.io/projected/2ca1c862-0bb7-4a32-8029-178e63da5bde-kube-api-access-8qhtr\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.180782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.180755    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br74r\" (UniqueName: \"kubernetes.io/projected/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-kube-api-access-br74r\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.181773 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.181743    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p49r5\" (UniqueName: \"kubernetes.io/projected/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-kube-api-access-p49r5\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:12.181908 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.181890    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8bt2\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-kube-api-access-t8bt2\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.182088 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.182070    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-bound-sa-token\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.182237 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.182220    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltr5c\" (UniqueName: \"kubernetes.io/projected/910bb007-8fa4-41af-9dd0-02e4907460f5-kube-api-access-ltr5c\") pod \"console-operator-68b757fb67-tctgf\" (UID: \"910bb007-8fa4-41af-9dd0-02e4907460f5\") " pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.186508 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.186486    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq87x\" (UniqueName: \"kubernetes.io/projected/1a85ea56-a77c-44f3-bef6-0ed26f0354ab-kube-api-access-mq87x\") pod \"kube-storage-version-migrator-operator-846bf668f7-pmglp\" (UID: \"1a85ea56-a77c-44f3-bef6-0ed26f0354ab\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.273209 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpwgt\" (UniqueName: \"kubernetes.io/projected/d592cb17-8a58-4916-b7e8-c67fc17c57d3-kube-api-access-lpwgt\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.273209 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64b1542c-e26f-4e5c-97c8-67287f0229f6-tmp\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.273515 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64b1542c-e26f-4e5c-97c8-67287f0229f6-serving-cert\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.273515 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273407    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88s67\" (UniqueName: \"kubernetes.io/projected/95bcd5bd-d55d-4a13-86f2-a85f45855f0d-kube-api-access-88s67\") pod \"ingress-canary-wc4xn\" (UID: \"95bcd5bd-d55d-4a13-86f2-a85f45855f0d\") " pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.273515 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273452    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/64b1542c-e26f-4e5c-97c8-67287f0229f6-snapshots\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.273515 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-tmp-dir\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.273712 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45f22\" (UniqueName: \"kubernetes.io/projected/ef4b704b-7986-43eb-a909-5640bef2b64c-kube-api-access-45f22\") pod \"network-check-source-989f8b8dc-48ttc\" (UID: \"ef4b704b-7986-43eb-a909-5640bef2b64c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"
Jul 08 21:33:12.273712 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjgfz\" (UniqueName: \"kubernetes.io/projected/276d05e1-a1f8-4271-be95-6e5e0532be97-kube-api-access-zjgfz\") pod \"volume-data-source-validator-5d456fdbcd-gf2c5\" (UID: \"276d05e1-a1f8-4271-be95-6e5e0532be97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"
Jul 08 21:33:12.273712 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273616    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64b1542c-e26f-4e5c-97c8-67287f0229f6-tmp\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.273712 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d592cb17-8a58-4916-b7e8-c67fc17c57d3-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.273712 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273703    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-config-volume\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273732    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kj5s\" (UniqueName: \"kubernetes.io/projected/64b1542c-e26f-4e5c-97c8-67287f0229f6-kube-api-access-7kj5s\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9hw\" (UniqueName: \"kubernetes.io/projected/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-kube-api-access-5v9hw\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273800    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b1542c-e26f-4e5c-97c8-67287f0229f6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273828    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-tmp-dir\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d592cb17-8a58-4916-b7e8-c67fc17c57d3-config\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b1542c-e26f-4e5c-97c8-67287f0229f6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273898    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bcd5bd-d55d-4a13-86f2-a85f45855f0d-cert\") pod \"ingress-canary-wc4xn\" (UID: \"95bcd5bd-d55d-4a13-86f2-a85f45855f0d\") " pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.273953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.273921    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.274338 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.274040    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:12.274338 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.274078    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/64b1542c-e26f-4e5c-97c8-67287f0229f6-snapshots\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.274338 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.274092    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls podName:31ce4acd-44c3-45bf-bc7c-b334075b0a6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:12.774074903 +0000 UTC m=+38.663855913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls") pod "dns-default-d67sg" (UID: "31ce4acd-44c3-45bf-bc7c-b334075b0a6d") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:12.274338 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.274289    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-config-volume\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.274548 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.274382    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d592cb17-8a58-4916-b7e8-c67fc17c57d3-config\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.274608 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.274587    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b1542c-e26f-4e5c-97c8-67287f0229f6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.274953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.274934    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b1542c-e26f-4e5c-97c8-67287f0229f6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.275935 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.275912    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d592cb17-8a58-4916-b7e8-c67fc17c57d3-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.276022 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.275945    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64b1542c-e26f-4e5c-97c8-67287f0229f6-serving-cert\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.276329 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.276311    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bcd5bd-d55d-4a13-86f2-a85f45855f0d-cert\") pod \"ingress-canary-wc4xn\" (UID: \"95bcd5bd-d55d-4a13-86f2-a85f45855f0d\") " pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.283357 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.283332    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpwgt\" (UniqueName: \"kubernetes.io/projected/d592cb17-8a58-4916-b7e8-c67fc17c57d3-kube-api-access-lpwgt\") pod \"service-ca-operator-5d46d9ffd4-4vp9q\" (UID: \"d592cb17-8a58-4916-b7e8-c67fc17c57d3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.284173 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.284153    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88s67\" (UniqueName: \"kubernetes.io/projected/95bcd5bd-d55d-4a13-86f2-a85f45855f0d-kube-api-access-88s67\") pod \"ingress-canary-wc4xn\" (UID: \"95bcd5bd-d55d-4a13-86f2-a85f45855f0d\") " pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.284897 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.284876    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v9hw\" (UniqueName: \"kubernetes.io/projected/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-kube-api-access-5v9hw\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.285090 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.285076    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kj5s\" (UniqueName: \"kubernetes.io/projected/64b1542c-e26f-4e5c-97c8-67287f0229f6-kube-api-access-7kj5s\") pod \"insights-operator-5c847dcfc4-gqh2c\" (UID: \"64b1542c-e26f-4e5c-97c8-67287f0229f6\") " pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.285852 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.285831    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45f22\" (UniqueName: \"kubernetes.io/projected/ef4b704b-7986-43eb-a909-5640bef2b64c-kube-api-access-45f22\") pod \"network-check-source-989f8b8dc-48ttc\" (UID: \"ef4b704b-7986-43eb-a909-5640bef2b64c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"
Jul 08 21:33:12.285910 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.285838    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjgfz\" (UniqueName: \"kubernetes.io/projected/276d05e1-a1f8-4271-be95-6e5e0532be97-kube-api-access-zjgfz\") pod \"volume-data-source-validator-5d456fdbcd-gf2c5\" (UID: \"276d05e1-a1f8-4271-be95-6e5e0532be97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"
Jul 08 21:33:12.289192 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.289166    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"]
Jul 08 21:33:12.290883 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.290861    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"
Jul 08 21:33:12.323262 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.323239    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"]
Jul 08 21:33:12.323357 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.323328    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:12.325647 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.325632    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:12.326300 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.326277    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 08 21:33:12.326454 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.326309    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 08 21:33:12.326454 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.326423    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kjc7h\""
Jul 08 21:33:12.336010 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.335993    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"
Jul 08 21:33:12.355058 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.355031    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"
Jul 08 21:33:12.369531 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.369507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c"
Jul 08 21:33:12.378801 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.378755    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wc4xn"
Jul 08 21:33:12.398837 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.398638    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"
Jul 08 21:33:12.460806 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.460216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dswsm_eec9af02-8e2b-445c-b2e6-c30490033dca/konnectivity-agent/0.log" limit=1024
Jul 08 21:33:12.476807 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.476485    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09037241-09bb-44ca-9589-9784ab6f3aa5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:12.476807 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.476556    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:12.547081 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.546995    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tctgf"]
Jul 08 21:33:12.553544 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.551964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp"]
Jul 08 21:33:12.572222 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.571044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dswsm_eec9af02-8e2b-445c-b2e6-c30490033dca/konnectivity-agent/0.log" limit=1024
Jul 08 21:33:12.577921 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.577518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09037241-09bb-44ca-9589-9784ab6f3aa5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:12.577921 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.577579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:12.577921 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.577809    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 21:33:12.577921 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.577870    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert podName:09037241-09bb-44ca-9589-9784ab6f3aa5 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:13.077850366 +0000 UTC m=+38.967631389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-vcqcs" (UID: "09037241-09bb-44ca-9589-9784ab6f3aa5") : secret "networking-console-plugin-cert" not found
Jul 08 21:33:12.578700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.578652    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09037241-09bb-44ca-9589-9784ab6f3aa5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:12.589043 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.588972    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5"]
Jul 08 21:33:12.593264 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:12.593237    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276d05e1_a1f8_4271_be95_6e5e0532be97.slice/crio-17aa23663af7522c7860144513f1c6955c60dd99afb12a3122f8e981725656e8 WatchSource:0}: Error finding container 17aa23663af7522c7860144513f1c6955c60dd99afb12a3122f8e981725656e8: Status 404 returned error can't find the container with id 17aa23663af7522c7860144513f1c6955c60dd99afb12a3122f8e981725656e8
Jul 08 21:33:12.598301 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.598267    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q"]
Jul 08 21:33:12.603273 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:12.603240    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd592cb17_8a58_4916_b7e8_c67fc17c57d3.slice/crio-e06f69ff43ac0fe15a5dfa766fe73c7518ab27fddbdbb943fda8fc173152ffd3 WatchSource:0}: Error finding container e06f69ff43ac0fe15a5dfa766fe73c7518ab27fddbdbb943fda8fc173152ffd3: Status 404 returned error can't find the container with id e06f69ff43ac0fe15a5dfa766fe73c7518ab27fddbdbb943fda8fc173152ffd3
Jul 08 21:33:12.644324 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.644294    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc"]
Jul 08 21:33:12.647992 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:12.647956    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4b704b_7986_43eb_a909_5640bef2b64c.slice/crio-9e0968085edd67e99357915caab3b6e2b479435cab22e8707b9ef7cf4086a52f WatchSource:0}: Error finding container 9e0968085edd67e99357915caab3b6e2b479435cab22e8707b9ef7cf4086a52f: Status 404 returned error can't find the container with id 9e0968085edd67e99357915caab3b6e2b479435cab22e8707b9ef7cf4086a52f
Jul 08 21:33:12.648631 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.648611    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gqh2c"]
Jul 08 21:33:12.651562 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:12.651541    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b1542c_e26f_4e5c_97c8_67287f0229f6.slice/crio-7a2da0e002684b54236dff0fe815088243ba8e867c5f82a7485ebf147af9846b WatchSource:0}: Error finding container 7a2da0e002684b54236dff0fe815088243ba8e867c5f82a7485ebf147af9846b: Status 404 returned error can't find the container with id 7a2da0e002684b54236dff0fe815088243ba8e867c5f82a7485ebf147af9846b
Jul 08 21:33:12.652249 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.652221    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dswsm_eec9af02-8e2b-445c-b2e6-c30490033dca/konnectivity-agent/0.log" limit=1024
Jul 08 21:33:12.660643 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.660623    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wc4xn"]
Jul 08 21:33:12.664701 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:12.664680    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bcd5bd_d55d_4a13_86f2_a85f45855f0d.slice/crio-581e02300433020ac2c336e575f4c9d019588b084b3ca0c1f06414e0fd9683e5 WatchSource:0}: Error finding container 581e02300433020ac2c336e575f4c9d019588b084b3ca0c1f06414e0fd9683e5: Status 404 returned error can't find the container with id 581e02300433020ac2c336e575f4c9d019588b084b3ca0c1f06414e0fd9683e5
Jul 08 21:33:12.678257 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.678239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.678344 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.678287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:12.678344 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.678310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:12.678344 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.678330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:12.678463 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678381    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:33:12.678463 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.678388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:12.678463 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678404    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:12.678463 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678404    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 21:33:12.678579 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678468    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:13.67844602 +0000 UTC m=+39.568227040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : secret "router-metrics-certs-default" not found
Jul 08 21:33:12.678579 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678491    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls podName:04a6af8c-e28a-4879-b0d3-5dd9f88e7004 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:13.67847739 +0000 UTC m=+39.568258393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l9wgx" (UID: "04a6af8c-e28a-4879-b0d3-5dd9f88e7004") : secret "samples-operator-tls" not found
Jul 08 21:33:12.678579 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678495    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:12.678579 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678513    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b79667f8c-hbzfc: secret "image-registry-tls" not found
Jul 08 21:33:12.678579 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678516    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls podName:2ca1c862-0bb7-4a32-8029-178e63da5bde nodeName:}" failed. No retries permitted until 2026-07-08 21:33:13.678505582 +0000 UTC m=+39.568286585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mxn6k" (UID: "2ca1c862-0bb7-4a32-8029-178e63da5bde") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:12.678579 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678537    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:13.678528474 +0000 UTC m=+39.568309480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : configmap references non-existent config key: service-ca.crt
Jul 08 21:33:12.678579 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.678549    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls podName:dcfdccbd-422e-49d1-b979-2a5893a07140 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:13.678543839 +0000 UTC m=+39.568324842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls") pod "image-registry-5b79667f8c-hbzfc" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140") : secret "image-registry-tls" not found
Jul 08 21:33:12.773016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.772936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5" event={"ID":"276d05e1-a1f8-4271-be95-6e5e0532be97","Type":"ContainerStarted","Data":"17aa23663af7522c7860144513f1c6955c60dd99afb12a3122f8e981725656e8"}
Jul 08 21:33:12.774026 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.773999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp" event={"ID":"1a85ea56-a77c-44f3-bef6-0ed26f0354ab","Type":"ContainerStarted","Data":"1ac6a64fee049e81e0a8ebddd820ea2f2cfb24e2d69a3dc4211c6c077a5d9b3f"}
Jul 08 21:33:12.775092 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.775073    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wc4xn" event={"ID":"95bcd5bd-d55d-4a13-86f2-a85f45855f0d","Type":"ContainerStarted","Data":"581e02300433020ac2c336e575f4c9d019588b084b3ca0c1f06414e0fd9683e5"}
Jul 08 21:33:12.776163 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.776137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc" event={"ID":"ef4b704b-7986-43eb-a909-5640bef2b64c","Type":"ContainerStarted","Data":"9e0968085edd67e99357915caab3b6e2b479435cab22e8707b9ef7cf4086a52f"}
Jul 08 21:33:12.777081 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.777061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q" event={"ID":"d592cb17-8a58-4916-b7e8-c67fc17c57d3","Type":"ContainerStarted","Data":"e06f69ff43ac0fe15a5dfa766fe73c7518ab27fddbdbb943fda8fc173152ffd3"}
Jul 08 21:33:12.778069 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.778051    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c" event={"ID":"64b1542c-e26f-4e5c-97c8-67287f0229f6","Type":"ContainerStarted","Data":"7a2da0e002684b54236dff0fe815088243ba8e867c5f82a7485ebf147af9846b"}
Jul 08 21:33:12.778805 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.778782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:12.778897 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.778887    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:12.778960 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:12.778949    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls podName:31ce4acd-44c3-45bf-bc7c-b334075b0a6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:13.778935042 +0000 UTC m=+39.668716061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls") pod "dns-default-d67sg" (UID: "31ce4acd-44c3-45bf-bc7c-b334075b0a6d") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:12.779050 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:12.779029    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" event={"ID":"910bb007-8fa4-41af-9dd0-02e4907460f5","Type":"ContainerStarted","Data":"6ee1ba5e0c9fe7a2ca3a7d7a704baa07dd0603c8ba95fe1126787fe7ef216068"}
Jul 08 21:33:13.081191 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.081110    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:13.081823 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.081286    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 21:33:13.081823 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.081369    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert podName:09037241-09bb-44ca-9589-9784ab6f3aa5 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:14.081351394 +0000 UTC m=+39.971132396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-vcqcs" (UID: "09037241-09bb-44ca-9589-9784ab6f3aa5") : secret "networking-console-plugin-cert" not found
Jul 08 21:33:13.625482 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.624032    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:13.625482 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.624523    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:13.625482 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.624921    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:13.631738 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.630524    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:33:13.631738 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.630786    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4v6kt\""
Jul 08 21:33:13.631738 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.630950    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:33:13.631738 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.631118    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wsbgf\""
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.687118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.687166    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.687230    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.687267    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.687305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.687524    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.687542    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b79667f8c-hbzfc: secret "image-registry-tls" not found
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.687600    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls podName:dcfdccbd-422e-49d1-b979-2a5893a07140 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:15.68758107 +0000 UTC m=+41.577362096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls") pod "image-registry-5b79667f8c-hbzfc" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140") : secret "image-registry-tls" not found
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.688038    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:15.688021147 +0000 UTC m=+41.577802159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : configmap references non-existent config key: service-ca.crt
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.688119    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.688156    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:15.688144884 +0000 UTC m=+41.577925889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : secret "router-metrics-certs-default" not found
Jul 08 21:33:13.688367 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.688212    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:13.689053 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.688243    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls podName:2ca1c862-0bb7-4a32-8029-178e63da5bde nodeName:}" failed. No retries permitted until 2026-07-08 21:33:15.68823346 +0000 UTC m=+41.578014468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mxn6k" (UID: "2ca1c862-0bb7-4a32-8029-178e63da5bde") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:13.689053 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.688294    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 21:33:13.689053 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.688325    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls podName:04a6af8c-e28a-4879-b0d3-5dd9f88e7004 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:15.688315666 +0000 UTC m=+41.578096668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l9wgx" (UID: "04a6af8c-e28a-4879-b0d3-5dd9f88e7004") : secret "samples-operator-tls" not found
Jul 08 21:33:13.789459 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:13.788447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:13.789459 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.788596    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:13.789459 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:13.788651    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls podName:31ce4acd-44c3-45bf-bc7c-b334075b0a6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:15.788634471 +0000 UTC m=+41.678415488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls") pod "dns-default-d67sg" (UID: "31ce4acd-44c3-45bf-bc7c-b334075b0a6d") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:14.092105 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:14.092063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:14.092573 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:14.092266    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 21:33:14.092573 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:14.092345    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert podName:09037241-09bb-44ca-9589-9784ab6f3aa5 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:16.092323776 +0000 UTC m=+41.982104794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-vcqcs" (UID: "09037241-09bb-44ca-9589-9784ab6f3aa5") : secret "networking-console-plugin-cert" not found
Jul 08 21:33:15.708749 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:15.708711    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:15.708825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:15.708856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.708892    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.708919    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b79667f8c-hbzfc: secret "image-registry-tls" not found
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:15.708902    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.708973    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.708981    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls podName:dcfdccbd-422e-49d1-b979-2a5893a07140 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.708960734 +0000 UTC m=+45.598741759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls") pod "image-registry-5b79667f8c-hbzfc" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140") : secret "image-registry-tls" not found
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.709017    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.709001861 +0000 UTC m=+45.598782864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : configmap references non-existent config key: service-ca.crt
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.709034    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls podName:2ca1c862-0bb7-4a32-8029-178e63da5bde nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.709027786 +0000 UTC m=+45.598808789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mxn6k" (UID: "2ca1c862-0bb7-4a32-8029-178e63da5bde") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.709045    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:15.709057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.709083    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.709070275 +0000 UTC m=+45.598851296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : secret "router-metrics-certs-default" not found
Jul 08 21:33:15.709155 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.709126    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 21:33:15.709712 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.709165    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls podName:04a6af8c-e28a-4879-b0d3-5dd9f88e7004 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.709153435 +0000 UTC m=+45.598934440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l9wgx" (UID: "04a6af8c-e28a-4879-b0d3-5dd9f88e7004") : secret "samples-operator-tls" not found
Jul 08 21:33:15.809788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:15.809710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:15.809966 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.809872    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:15.809966 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:15.809947    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls podName:31ce4acd-44c3-45bf-bc7c-b334075b0a6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.809928258 +0000 UTC m=+45.699709275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls") pod "dns-default-d67sg" (UID: "31ce4acd-44c3-45bf-bc7c-b334075b0a6d") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:16.112690 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:16.112603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:16.112856 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:16.112766    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 21:33:16.112856 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:16.112847    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert podName:09037241-09bb-44ca-9589-9784ab6f3aa5 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:20.112824636 +0000 UTC m=+46.002605658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-vcqcs" (UID: "09037241-09bb-44ca-9589-9784ab6f3aa5") : secret "networking-console-plugin-cert" not found
Jul 08 21:33:19.748197 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:19.748149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748345    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748374    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b79667f8c-hbzfc: secret "image-registry-tls" not found
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:19.748377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:19.748431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748474    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls podName:dcfdccbd-422e-49d1-b979-2a5893a07140 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:27.748450351 +0000 UTC m=+53.638231357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls") pod "image-registry-5b79667f8c-hbzfc" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140") : secret "image-registry-tls" not found
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748530    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748538    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:27.748523435 +0000 UTC m=+53.638304442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : configmap references non-existent config key: service-ca.crt
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748585    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:27.748566618 +0000 UTC m=+53.638347633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : secret "router-metrics-certs-default" not found
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:19.748608    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:19.748653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:19.748727 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748726    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:19.749167 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748773    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls podName:2ca1c862-0bb7-4a32-8029-178e63da5bde nodeName:}" failed. No retries permitted until 2026-07-08 21:33:27.748759885 +0000 UTC m=+53.638540905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mxn6k" (UID: "2ca1c862-0bb7-4a32-8029-178e63da5bde") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:19.749167 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748775    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 21:33:19.749167 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.748811    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls podName:04a6af8c-e28a-4879-b0d3-5dd9f88e7004 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:27.748800428 +0000 UTC m=+53.638581437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-l9wgx" (UID: "04a6af8c-e28a-4879-b0d3-5dd9f88e7004") : secret "samples-operator-tls" not found
Jul 08 21:33:19.849716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:19.849686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:19.849862 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.849822    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:19.849905 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:19.849880    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls podName:31ce4acd-44c3-45bf-bc7c-b334075b0a6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:27.849865995 +0000 UTC m=+53.739647001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls") pod "dns-default-d67sg" (UID: "31ce4acd-44c3-45bf-bc7c-b334075b0a6d") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:20.153572 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.153491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:20.153710 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:20.153636    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 21:33:20.153710 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:20.153700    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert podName:09037241-09bb-44ca-9589-9784ab6f3aa5 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:28.153684661 +0000 UTC m=+54.043465666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-vcqcs" (UID: "09037241-09bb-44ca-9589-9784ab6f3aa5") : secret "networking-console-plugin-cert" not found
Jul 08 21:33:20.804832 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.804586    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc" event={"ID":"ef4b704b-7986-43eb-a909-5640bef2b64c","Type":"ContainerStarted","Data":"c6203096a5a5e60aca91043631019fba57fb0fb2768fd5db13742f74c0a8e06e"}
Jul 08 21:33:20.806470 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.806394    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q" event={"ID":"d592cb17-8a58-4916-b7e8-c67fc17c57d3","Type":"ContainerStarted","Data":"a1b789c3b6b002e2db1f8ea07fe218057180abef6a2f8f1a5fd3f4bad91a1c92"}
Jul 08 21:33:20.808230 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.808204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c" event={"ID":"64b1542c-e26f-4e5c-97c8-67287f0229f6","Type":"ContainerStarted","Data":"f8f6131d7da36dcad06ecdb712287f937d2a8d1ce6d116a1e7858a91c10cfa2b"}
Jul 08 21:33:20.809968 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.809949    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/0.log"
Jul 08 21:33:20.810055 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.809985    2568 generic.go:356] "Generic (PLEG): container finished" podID="910bb007-8fa4-41af-9dd0-02e4907460f5" containerID="1b79c55d23b2c0535128c12027047ac99d40e4e5702998b7e80319f0e8d9885e" exitCode=255
Jul 08 21:33:20.810104 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.810088    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" event={"ID":"910bb007-8fa4-41af-9dd0-02e4907460f5","Type":"ContainerDied","Data":"1b79c55d23b2c0535128c12027047ac99d40e4e5702998b7e80319f0e8d9885e"}
Jul 08 21:33:20.810494 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.810215    2568 scope.go:117] "RemoveContainer" containerID="1b79c55d23b2c0535128c12027047ac99d40e4e5702998b7e80319f0e8d9885e"
Jul 08 21:33:20.812348 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.811759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5" event={"ID":"276d05e1-a1f8-4271-be95-6e5e0532be97","Type":"ContainerStarted","Data":"e0e5f32a165b77afd3e828113c48f7b480153946cb57a754e4ec6996172663a0"}
Jul 08 21:33:20.813362 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.813340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp" event={"ID":"1a85ea56-a77c-44f3-bef6-0ed26f0354ab","Type":"ContainerStarted","Data":"ff547cc37d5031d91fec24741ea5d5d63a403344d709bf78d9c65556dfc4f90b"}
Jul 08 21:33:20.815014 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.814993    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wc4xn" event={"ID":"95bcd5bd-d55d-4a13-86f2-a85f45855f0d","Type":"ContainerStarted","Data":"c78fc0cd469445e13b9d59ce5457f186ad9b9e00ff2d5724c4247dc5f0d71743"}
Jul 08 21:33:20.824994 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.824949    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-48ttc" podStartSLOduration=16.18663368 podStartE2EDuration="23.824936264s" totalImagesPullingTime="7.638302584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.824056802 +0000 UTC m=+46.713837850" watchObservedRunningTime="2026-07-08 21:33:20.824936264 +0000 UTC m=+46.714717267"
Jul 08 21:33:20.861934 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.861851    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q" podStartSLOduration=16.189225369 podStartE2EDuration="23.861831471s" totalImagesPullingTime="7.672606102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.861474039 +0000 UTC m=+46.751255082" watchObservedRunningTime="2026-07-08 21:33:20.861831471 +0000 UTC m=+46.751612480"
Jul 08 21:33:20.885607 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.885529    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c" podStartSLOduration=17.26182915 podStartE2EDuration="24.88550911s" totalImagesPullingTime="7.62367996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.885103181 +0000 UTC m=+46.774884207" watchObservedRunningTime="2026-07-08 21:33:20.88550911 +0000 UTC m=+46.775290136"
Jul 08 21:33:20.907959 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.906780    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp" podStartSLOduration=16.201104397 podStartE2EDuration="23.906761723s" totalImagesPullingTime="7.705657326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.906010923 +0000 UTC m=+46.795791975" watchObservedRunningTime="2026-07-08 21:33:20.906761723 +0000 UTC m=+46.796542749"
Jul 08 21:33:20.930550 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:20.930313    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wc4xn" podStartSLOduration=2.319579914 podStartE2EDuration="9.9302909s" totalImagesPullingTime="7.610710986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.927986402 +0000 UTC m=+46.817767426" watchObservedRunningTime="2026-07-08 21:33:20.9302909 +0000 UTC m=+46.820071929"
Jul 08 21:33:21.823431 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.823380    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:33:21.823920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.823883    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/0.log"
Jul 08 21:33:21.823992 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.823920    2568 generic.go:356] "Generic (PLEG): container finished" podID="910bb007-8fa4-41af-9dd0-02e4907460f5" containerID="fea5b38dca6f6e0ec70528b63fbefec98ae2f8f6b28aaeda124ba910ebe36b8e" exitCode=255
Jul 08 21:33:21.824227 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.824199    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" event={"ID":"910bb007-8fa4-41af-9dd0-02e4907460f5","Type":"ContainerDied","Data":"fea5b38dca6f6e0ec70528b63fbefec98ae2f8f6b28aaeda124ba910ebe36b8e"}
Jul 08 21:33:21.824488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.824464    2568 scope.go:117] "RemoveContainer" containerID="1b79c55d23b2c0535128c12027047ac99d40e4e5702998b7e80319f0e8d9885e"
Jul 08 21:33:21.824824 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.824809    2568 scope.go:117] "RemoveContainer" containerID="fea5b38dca6f6e0ec70528b63fbefec98ae2f8f6b28aaeda124ba910ebe36b8e"
Jul 08 21:33:21.824994 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:21.824972    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tctgf_openshift-console-operator(910bb007-8fa4-41af-9dd0-02e4907460f5)\"" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" podUID="910bb007-8fa4-41af-9dd0-02e4907460f5"
Jul 08 21:33:21.851919 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.851863    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-gf2c5" podStartSLOduration=18.223798172 podStartE2EDuration="25.851840536s" totalImagesPullingTime="7.628042364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.949686985 +0000 UTC m=+46.839468011" watchObservedRunningTime="2026-07-08 21:33:21.851840536 +0000 UTC m=+47.741621564"
Jul 08 21:33:21.861933 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.861907    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xlfz5"]
Jul 08 21:33:21.881715 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.881688    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xlfz5"]
Jul 08 21:33:21.881868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.881825    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:21.884345 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.884321    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 21:33:21.884487 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.884358    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 21:33:21.884487 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.884370    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-65cm9\""
Jul 08 21:33:21.972786 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.972751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06487288-b864-4886-8928-5b19e82a1153-data-volume\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:21.973049 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.973026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:21.973276 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.973256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06487288-b864-4886-8928-5b19e82a1153-crio-socket\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:21.973489 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.973470    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2ktf\" (UniqueName: \"kubernetes.io/projected/06487288-b864-4886-8928-5b19e82a1153-kube-api-access-l2ktf\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:21.973651 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:21.973632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.074725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.074636    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06487288-b864-4886-8928-5b19e82a1153-crio-socket\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.074725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.074692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2ktf\" (UniqueName: \"kubernetes.io/projected/06487288-b864-4886-8928-5b19e82a1153-kube-api-access-l2ktf\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.074920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.074734    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.074920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.074774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06487288-b864-4886-8928-5b19e82a1153-data-volume\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.074920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.074870    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06487288-b864-4886-8928-5b19e82a1153-crio-socket\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.074920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.074883    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.074920 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.074906    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:22.075200 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.074966    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:22.075200 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.074972    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:22.574952712 +0000 UTC m=+48.464733721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:22.075200 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.075015    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:22.575000155 +0000 UTC m=+48.464781173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:22.075373 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.075207    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06487288-b864-4886-8928-5b19e82a1153-data-volume\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.085678 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.085655    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2ktf\" (UniqueName: \"kubernetes.io/projected/06487288-b864-4886-8928-5b19e82a1153-kube-api-access-l2ktf\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.326108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.326021    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:22.326108 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.326079    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:22.578886 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.578795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.579048 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.578919    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:22.579048 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.578922    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:22.579146 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.578999    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:22.579146 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.579067    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:23.579049875 +0000 UTC m=+49.468830877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:22.579230 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.579148    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:23.579126977 +0000 UTC m=+49.468907997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:22.828805 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.828777    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:33:22.829167 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:22.829080    2568 scope.go:117] "RemoveContainer" containerID="fea5b38dca6f6e0ec70528b63fbefec98ae2f8f6b28aaeda124ba910ebe36b8e"
Jul 08 21:33:22.829257 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:22.829238    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tctgf_openshift-console-operator(910bb007-8fa4-41af-9dd0-02e4907460f5)\"" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" podUID="910bb007-8fa4-41af-9dd0-02e4907460f5"
Jul 08 21:33:23.056494 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.056462    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"]
Jul 08 21:33:23.091805 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.091732    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"]
Jul 08 21:33:23.091923 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.091830    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"
Jul 08 21:33:23.094685 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.094659    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 21:33:23.094815 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.094671    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hrr9h\""
Jul 08 21:33:23.094815 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.094671    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 21:33:23.184309 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.184276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksl76\" (UniqueName: \"kubernetes.io/projected/fb97e13a-f4bc-498a-8ab2-c10fcb069f36-kube-api-access-ksl76\") pod \"migrator-d57d58cc9-752gl\" (UID: \"fb97e13a-f4bc-498a-8ab2-c10fcb069f36\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"
Jul 08 21:33:23.248927 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.248900    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jhhpd_73d3a9cf-cb53-47d7-96f1-0d108e3d3370/dns-node-resolver/0.log"
Jul 08 21:33:23.285637 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.285599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksl76\" (UniqueName: \"kubernetes.io/projected/fb97e13a-f4bc-498a-8ab2-c10fcb069f36-kube-api-access-ksl76\") pod \"migrator-d57d58cc9-752gl\" (UID: \"fb97e13a-f4bc-498a-8ab2-c10fcb069f36\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"
Jul 08 21:33:23.293085 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.293061    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksl76\" (UniqueName: \"kubernetes.io/projected/fb97e13a-f4bc-498a-8ab2-c10fcb069f36-kube-api-access-ksl76\") pod \"migrator-d57d58cc9-752gl\" (UID: \"fb97e13a-f4bc-498a-8ab2-c10fcb069f36\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"
Jul 08 21:33:23.400875 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.400795    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"
Jul 08 21:33:23.544714 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.544687    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl"]
Jul 08 21:33:23.547718 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:23.547689    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb97e13a_f4bc_498a_8ab2_c10fcb069f36.slice/crio-56886f3c28e4015756595c1b15e869eeb91f226abd1b71cc03599da8045921b3 WatchSource:0}: Error finding container 56886f3c28e4015756595c1b15e869eeb91f226abd1b71cc03599da8045921b3: Status 404 returned error can't find the container with id 56886f3c28e4015756595c1b15e869eeb91f226abd1b71cc03599da8045921b3
Jul 08 21:33:23.588885 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.588860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:23.589005 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.588962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:23.589056 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:23.589035    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:23.589089 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:23.589052    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:23.589117 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:23.589107    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:25.589090546 +0000 UTC m=+51.478871569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:23.589158 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:23.589125    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:25.589117626 +0000 UTC m=+51.478898644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:23.832738 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.832705    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl" event={"ID":"fb97e13a-f4bc-498a-8ab2-c10fcb069f36","Type":"ContainerStarted","Data":"56886f3c28e4015756595c1b15e869eeb91f226abd1b71cc03599da8045921b3"}
Jul 08 21:33:23.833110 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:23.832987    2568 scope.go:117] "RemoveContainer" containerID="fea5b38dca6f6e0ec70528b63fbefec98ae2f8f6b28aaeda124ba910ebe36b8e"
Jul 08 21:33:23.833147 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:23.833127    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tctgf_openshift-console-operator(910bb007-8fa4-41af-9dd0-02e4907460f5)\"" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" podUID="910bb007-8fa4-41af-9dd0-02e4907460f5"
Jul 08 21:33:24.046881 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.046854    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5sdsh_8e2e803b-d842-42c3-93a7-2f8a6482bbd5/node-ca/0.log"
Jul 08 21:33:24.516270 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.516236    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pzdfq"]
Jul 08 21:33:24.538791 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.538764    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pzdfq"]
Jul 08 21:33:24.538980 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.538878    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.541619 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.541593    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 21:33:24.542757 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.542735    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 21:33:24.542846 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.542784    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 21:33:24.542846 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.542735    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 21:33:24.542953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.542860    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pfn2n\""
Jul 08 21:33:24.647540 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.647512    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wc4xn_95bcd5bd-d55d-4a13-86f2-a85f45855f0d/serve-healthcheck-canary/0.log"
Jul 08 21:33:24.700176 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.700147    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6399e5c4-8b20-47f5-9252-df645d62cce0-signing-cabundle\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.700329 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.700313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8vqn\" (UniqueName: \"kubernetes.io/projected/6399e5c4-8b20-47f5-9252-df645d62cce0-kube-api-access-b8vqn\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.700378 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.700349    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6399e5c4-8b20-47f5-9252-df645d62cce0-signing-key\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.801468 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.801388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6399e5c4-8b20-47f5-9252-df645d62cce0-signing-key\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.801468 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.801458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6399e5c4-8b20-47f5-9252-df645d62cce0-signing-cabundle\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.801755 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.801734    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8vqn\" (UniqueName: \"kubernetes.io/projected/6399e5c4-8b20-47f5-9252-df645d62cce0-kube-api-access-b8vqn\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.802310 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.802285    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6399e5c4-8b20-47f5-9252-df645d62cce0-signing-cabundle\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.803958 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.803938    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6399e5c4-8b20-47f5-9252-df645d62cce0-signing-key\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.811044 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.811018    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8vqn\" (UniqueName: \"kubernetes.io/projected/6399e5c4-8b20-47f5-9252-df645d62cce0-kube-api-access-b8vqn\") pod \"service-ca-758f599c5-pzdfq\" (UID: \"6399e5c4-8b20-47f5-9252-df645d62cce0\") " pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.848764 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.848735    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-pzdfq"
Jul 08 21:33:24.986084 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:24.986021    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pzdfq"]
Jul 08 21:33:24.988498 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:24.988448    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6399e5c4_8b20_47f5_9252_df645d62cce0.slice/crio-928d7821573543c3840b2625be006e793af20bd8ec89b666d09d7327ebbabc59 WatchSource:0}: Error finding container 928d7821573543c3840b2625be006e793af20bd8ec89b666d09d7327ebbabc59: Status 404 returned error can't find the container with id 928d7821573543c3840b2625be006e793af20bd8ec89b666d09d7327ebbabc59
Jul 08 21:33:25.607382 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.607357    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:25.607544 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:25.607525    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:25.607602 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:25.607592    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:29.607573642 +0000 UTC m=+55.497354660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:25.607665 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.607615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:25.607767 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:25.607750    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:25.607819 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:25.607799    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:29.607787834 +0000 UTC m=+55.497568837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:25.840097 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.840063    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-pzdfq" event={"ID":"6399e5c4-8b20-47f5-9252-df645d62cce0","Type":"ContainerStarted","Data":"82f253f8ff2962c6ffb3d972920d44ff91860d08c20e6727ad0f92c1ceb9e216"}
Jul 08 21:33:25.840301 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.840151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-pzdfq" event={"ID":"6399e5c4-8b20-47f5-9252-df645d62cce0","Type":"ContainerStarted","Data":"928d7821573543c3840b2625be006e793af20bd8ec89b666d09d7327ebbabc59"}
Jul 08 21:33:25.841932 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.841904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl" event={"ID":"fb97e13a-f4bc-498a-8ab2-c10fcb069f36","Type":"ContainerStarted","Data":"8870a0ca83c685dc8a2294266a3b37fdc5e78d5e3fbc4a776cff2ab42da54843"}
Jul 08 21:33:25.842021 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.841950    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl" event={"ID":"fb97e13a-f4bc-498a-8ab2-c10fcb069f36","Type":"ContainerStarted","Data":"158480d7cbb2ddefdd4728e27b7551ed878ae333f6b7c7630ad01b52e7ef2ca3"}
Jul 08 21:33:25.863622 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.863543    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-pzdfq" podStartSLOduration=1.863529533 podStartE2EDuration="1.863529533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:25.862068984 +0000 UTC m=+51.751850009" watchObservedRunningTime="2026-07-08 21:33:25.863529533 +0000 UTC m=+51.753310597"
Jul 08 21:33:25.889920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:25.889875    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-752gl" podStartSLOduration=0.839027304 podStartE2EDuration="2.889859399s" totalImagesPullingTime="2.050832095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:25.889743925 +0000 UTC m=+51.779524946" watchObservedRunningTime="2026-07-08 21:33:25.889859399 +0000 UTC m=+51.779640424"
Jul 08 21:33:27.827793 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.827752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.827817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.827944    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.827951    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.827974    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b79667f8c-hbzfc: secret "image-registry-tls" not found
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.827977    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.828022    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls podName:dcfdccbd-422e-49d1-b979-2a5893a07140 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:43.828007984 +0000 UTC m=+69.717788988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls") pod "image-registry-5b79667f8c-hbzfc" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140") : secret "image-registry-tls" not found
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.828074    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.828084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.828103    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:43.828084741 +0000 UTC m=+69.717865759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : configmap references non-existent config key: service-ca.crt
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.828144    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs podName:02e159d6-5bd4-49e5-b5a3-da70dea42bb6 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:43.828133869 +0000 UTC m=+69.717914871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs") pod "router-default-666f696759-zrbhg" (UID: "02e159d6-5bd4-49e5-b5a3-da70dea42bb6") : secret "router-metrics-certs-default" not found
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.828146    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:27.828229 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.828183    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls podName:2ca1c862-0bb7-4a32-8029-178e63da5bde nodeName:}" failed. No retries permitted until 2026-07-08 21:33:43.828172549 +0000 UTC m=+69.717953554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mxn6k" (UID: "2ca1c862-0bb7-4a32-8029-178e63da5bde") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:33:27.830302 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.830278    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04a6af8c-e28a-4879-b0d3-5dd9f88e7004-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-l9wgx\" (UID: \"04a6af8c-e28a-4879-b0d3-5dd9f88e7004\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:27.865687 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.865660    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"
Jul 08 21:33:27.930370 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.929506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:27.930370 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.929721    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:27.930370 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:27.929782    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls podName:31ce4acd-44c3-45bf-bc7c-b334075b0a6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:43.929764178 +0000 UTC m=+69.819545185 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls") pod "dns-default-d67sg" (UID: "31ce4acd-44c3-45bf-bc7c-b334075b0a6d") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:27.998258 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:27.998224    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx"]
Jul 08 21:33:28.232965 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:28.232886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:28.233183 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:28.233041    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 21:33:28.233183 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:28.233103    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert podName:09037241-09bb-44ca-9589-9784ab6f3aa5 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:44.233088004 +0000 UTC m=+70.122869008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-vcqcs" (UID: "09037241-09bb-44ca-9589-9784ab6f3aa5") : secret "networking-console-plugin-cert" not found
Jul 08 21:33:28.853903 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:28.853864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx" event={"ID":"04a6af8c-e28a-4879-b0d3-5dd9f88e7004","Type":"ContainerStarted","Data":"a60ec3fed9e93145e1244c3baa857a15c5ad327b886647fe26f97d00ff3dc415"}
Jul 08 21:33:29.648607 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:29.648572    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:29.648792 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:29.648689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:29.648792 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:29.648707    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:29.648792 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:29.648784    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:37.648762613 +0000 UTC m=+63.538543637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:29.648950 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:29.648858    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:29.648950 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:33:29.648903    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls podName:06487288-b864-4886-8928-5b19e82a1153 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:37.648892159 +0000 UTC m=+63.538673162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlfz5" (UID: "06487288-b864-4886-8928-5b19e82a1153") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:30.862651 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:30.862612    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx" event={"ID":"04a6af8c-e28a-4879-b0d3-5dd9f88e7004","Type":"ContainerStarted","Data":"ea2f3c5f377fc914d336ded3a696d617176b7e51bff1dc1fc24396a145439108"}
Jul 08 21:33:30.863038 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:30.862676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx" event={"ID":"04a6af8c-e28a-4879-b0d3-5dd9f88e7004","Type":"ContainerStarted","Data":"2626371f3f9b6d98cc814e2ffe020a7d0949b4aaaa961fe29fb695b4a1829750"}
Jul 08 21:33:30.883382 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:30.883328    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-l9wgx" podStartSLOduration=32.951765105 podStartE2EDuration="34.883309815s" totalImagesPullingTime="1.93154471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:30.881861375 +0000 UTC m=+56.771642401" watchObservedRunningTime="2026-07-08 21:33:30.883309815 +0000 UTC m=+56.773090841"
Jul 08 21:33:35.624524 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:35.624488    2568 scope.go:117] "RemoveContainer" containerID="fea5b38dca6f6e0ec70528b63fbefec98ae2f8f6b28aaeda124ba910ebe36b8e"
Jul 08 21:33:35.880968 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:35.880895    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:33:35.881114 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:35.880981    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" event={"ID":"910bb007-8fa4-41af-9dd0-02e4907460f5","Type":"ContainerStarted","Data":"86cf039823434460c52feeeed9f50ebce3edc75381f723404b40db2ac85caff8"}
Jul 08 21:33:35.881358 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:35.881289    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:35.904579 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:35.904527    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-tctgf" podStartSLOduration=31.193658928 podStartE2EDuration="38.904511532s" totalImagesPullingTime="7.710852604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:35.904223988 +0000 UTC m=+61.794005013" watchObservedRunningTime="2026-07-08 21:33:35.904511532 +0000 UTC m=+61.794292558"
Jul 08 21:33:36.075322 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:36.075291    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-tctgf"
Jul 08 21:33:37.720304 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.720265    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:37.720748 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.720472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:37.720857 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.720837    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06487288-b864-4886-8928-5b19e82a1153-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:37.722743 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.722721    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06487288-b864-4886-8928-5b19e82a1153-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlfz5\" (UID: \"06487288-b864-4886-8928-5b19e82a1153\") " pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:37.760381 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.760358    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4psz"
Jul 08 21:33:37.795233 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.795203    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-65cm9\""
Jul 08 21:33:37.802960 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.802939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xlfz5"
Jul 08 21:33:37.939438 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:37.939321    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xlfz5"]
Jul 08 21:33:37.942045 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:37.942005    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06487288_b864_4886_8928_5b19e82a1153.slice/crio-cc63efd02b1b54f6145237371b6c63e97bfb636ef3d34f584f88acc052265d00 WatchSource:0}: Error finding container cc63efd02b1b54f6145237371b6c63e97bfb636ef3d34f584f88acc052265d00: Status 404 returned error can't find the container with id cc63efd02b1b54f6145237371b6c63e97bfb636ef3d34f584f88acc052265d00
Jul 08 21:33:38.895009 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:38.894974    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlfz5" event={"ID":"06487288-b864-4886-8928-5b19e82a1153","Type":"ContainerStarted","Data":"cc63efd02b1b54f6145237371b6c63e97bfb636ef3d34f584f88acc052265d00"}
Jul 08 21:33:40.349116 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.349079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:40.349116 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.349125    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:40.349677 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.349150    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:40.352351 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.352298    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjdgp\" (UniqueName: \"kubernetes.io/projected/14697219-9ef6-4c89-8a45-9b4f278a69c7-kube-api-access-rjdgp\") pod \"network-check-target-7phf6\" (UID: \"14697219-9ef6-4c89-8a45-9b4f278a69c7\") " pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:40.353019 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.352996    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:33:40.353336 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.353314    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:33:40.362841 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.362811    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f6b1f15-6513-4c37-b92a-389ab8198f22-original-pull-secret\") pod \"global-pull-secret-syncer-gpv9z\" (UID: \"7f6b1f15-6513-4c37-b92a-389ab8198f22\") " pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:40.362964 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.362871    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00d98c92-dae5-494f-90e1-151bad0345c3-metrics-certs\") pod \"network-metrics-daemon-sk6pm\" (UID: \"00d98c92-dae5-494f-90e1-151bad0345c3\") " pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:40.366285 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.366247    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wsbgf\""
Jul 08 21:33:40.366481 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.366247    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gpv9z"
Jul 08 21:33:40.367375 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.367307    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:40.647245 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.647167    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4v6kt\""
Jul 08 21:33:40.654659 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:40.654635    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk6pm"
Jul 08 21:33:42.337791 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.337766    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7phf6"]
Jul 08 21:33:42.340498 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:42.340466    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14697219_9ef6_4c89_8a45_9b4f278a69c7.slice/crio-7522faed267fbe2a340848c8b83db39a2161e8a2d2055b91e4a1188b9d5c3345 WatchSource:0}: Error finding container 7522faed267fbe2a340848c8b83db39a2161e8a2d2055b91e4a1188b9d5c3345: Status 404 returned error can't find the container with id 7522faed267fbe2a340848c8b83db39a2161e8a2d2055b91e4a1188b9d5c3345
Jul 08 21:33:42.359392 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.359317    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sk6pm"]
Jul 08 21:33:42.362270 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:42.362081    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d98c92_dae5_494f_90e1_151bad0345c3.slice/crio-e5cbcb70b177ca01398a5c605ff5b7415e16daad52f76f288329a814ec40f252 WatchSource:0}: Error finding container e5cbcb70b177ca01398a5c605ff5b7415e16daad52f76f288329a814ec40f252: Status 404 returned error can't find the container with id e5cbcb70b177ca01398a5c605ff5b7415e16daad52f76f288329a814ec40f252
Jul 08 21:33:42.383356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.383327    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gpv9z"]
Jul 08 21:33:42.386339 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:42.386298    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6b1f15_6513_4c37_b92a_389ab8198f22.slice/crio-91d9e0a9a300ddf00f95958eb1f51329bacd6dac82aca71f9cdbdb2d1c14415a WatchSource:0}: Error finding container 91d9e0a9a300ddf00f95958eb1f51329bacd6dac82aca71f9cdbdb2d1c14415a: Status 404 returned error can't find the container with id 91d9e0a9a300ddf00f95958eb1f51329bacd6dac82aca71f9cdbdb2d1c14415a
Jul 08 21:33:42.912227 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.912182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sk6pm" event={"ID":"00d98c92-dae5-494f-90e1-151bad0345c3","Type":"ContainerStarted","Data":"e5cbcb70b177ca01398a5c605ff5b7415e16daad52f76f288329a814ec40f252"}
Jul 08 21:33:42.914967 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.914935    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlfz5" event={"ID":"06487288-b864-4886-8928-5b19e82a1153","Type":"ContainerStarted","Data":"52c2f74375f82ae261afe28930a645ab95ddd1cab9c0452416050882e8167fa2"}
Jul 08 21:33:42.917012 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.916972    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gpv9z" event={"ID":"7f6b1f15-6513-4c37-b92a-389ab8198f22","Type":"ContainerStarted","Data":"91d9e0a9a300ddf00f95958eb1f51329bacd6dac82aca71f9cdbdb2d1c14415a"}
Jul 08 21:33:42.918891 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.918864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7phf6" event={"ID":"14697219-9ef6-4c89-8a45-9b4f278a69c7","Type":"ContainerStarted","Data":"9a1c53e0f45b8ab580eeed05d7d286f213ac730c75ffb8034fea9cf45ac92197"}
Jul 08 21:33:42.919005 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.918912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7phf6" event={"ID":"14697219-9ef6-4c89-8a45-9b4f278a69c7","Type":"ContainerStarted","Data":"7522faed267fbe2a340848c8b83db39a2161e8a2d2055b91e4a1188b9d5c3345"}
Jul 08 21:33:42.919290 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.919223    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:33:42.935519 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:42.935459    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7phf6" podStartSLOduration=68.93543476 podStartE2EDuration="1m8.93543476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:42.934639554 +0000 UTC m=+68.824420644" watchObservedRunningTime="2026-07-08 21:33:42.93543476 +0000 UTC m=+68.825215786"
Jul 08 21:33:43.883023 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.882981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:43.883557 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.883057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:43.883557 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.883125    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:43.883557 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.883156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:43.884073 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.883995    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-service-ca-bundle\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:43.887168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.886719    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"image-registry-5b79667f8c-hbzfc\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") " pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:43.887168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.886729    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02e159d6-5bd4-49e5-b5a3-da70dea42bb6-metrics-certs\") pod \"router-default-666f696759-zrbhg\" (UID: \"02e159d6-5bd4-49e5-b5a3-da70dea42bb6\") " pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:43.887168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.887129    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ca1c862-0bb7-4a32-8029-178e63da5bde-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mxn6k\" (UID: \"2ca1c862-0bb7-4a32-8029-178e63da5bde\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:43.925814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.925763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sk6pm" event={"ID":"00d98c92-dae5-494f-90e1-151bad0345c3","Type":"ContainerStarted","Data":"709963b8f51382a8411bb347ab9fbe7ceeeb7db8a44a68bd8ac9fad470b34010"}
Jul 08 21:33:43.925994 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.925832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sk6pm" event={"ID":"00d98c92-dae5-494f-90e1-151bad0345c3","Type":"ContainerStarted","Data":"2b96bbad42c008a84ec815b8f8808f67a4df58d9b46b9b14b6c9e9bdb9405b67"}
Jul 08 21:33:43.928788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.928359    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlfz5" event={"ID":"06487288-b864-4886-8928-5b19e82a1153","Type":"ContainerStarted","Data":"625eae3515f18df312d1255bef8e5b2b772ee71dd2164645c6cd44ee92a2db2a"}
Jul 08 21:33:43.948427 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.948310    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sk6pm" podStartSLOduration=68.839543938 podStartE2EDuration="1m9.948286622s" totalImagesPullingTime="1.108742684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:43.946780015 +0000 UTC m=+69.836561042" watchObservedRunningTime="2026-07-08 21:33:43.948286622 +0000 UTC m=+69.838067707"
Jul 08 21:33:43.983835 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.983793    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:43.986335 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:43.986303    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ce4acd-44c3-45bf-bc7c-b334075b0a6d-metrics-tls\") pod \"dns-default-d67sg\" (UID: \"31ce4acd-44c3-45bf-bc7c-b334075b0a6d\") " pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:44.055404 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.055368    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-psx4j\""
Jul 08 21:33:44.062690 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.062665    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:44.085488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.085465    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xd2xj\""
Jul 08 21:33:44.093996 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.093970    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"
Jul 08 21:33:44.110060 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.110032    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rznh6\""
Jul 08 21:33:44.117844 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.117496    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:44.211032 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.206846    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfpxn\""
Jul 08 21:33:44.214906 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.214563    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:44.237687 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.237658    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b79667f8c-hbzfc"]
Jul 08 21:33:44.245055 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:44.243902    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcfdccbd_422e_49d1_b979_2a5893a07140.slice/crio-2d51807df3f79f8ddb95a09f4ff1f35851c19e4dfd515943f34a0e127318c193 WatchSource:0}: Error finding container 2d51807df3f79f8ddb95a09f4ff1f35851c19e4dfd515943f34a0e127318c193: Status 404 returned error can't find the container with id 2d51807df3f79f8ddb95a09f4ff1f35851c19e4dfd515943f34a0e127318c193
Jul 08 21:33:44.272989 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.272929    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k"]
Jul 08 21:33:44.278554 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:44.277657    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca1c862_0bb7_4a32_8029_178e63da5bde.slice/crio-5c04e669eac71681b5d5a4763cc4365a31579077b2b229df1527ffddca3aea27 WatchSource:0}: Error finding container 5c04e669eac71681b5d5a4763cc4365a31579077b2b229df1527ffddca3aea27: Status 404 returned error can't find the container with id 5c04e669eac71681b5d5a4763cc4365a31579077b2b229df1527ffddca3aea27
Jul 08 21:33:44.286552 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.286461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:44.291573 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.291529    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09037241-09bb-44ca-9589-9784ab6f3aa5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vcqcs\" (UID: \"09037241-09bb-44ca-9589-9784ab6f3aa5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:44.306796 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.306727    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-666f696759-zrbhg"]
Jul 08 21:33:44.311327 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:44.311297    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e159d6_5bd4_49e5_b5a3_da70dea42bb6.slice/crio-3fa10d6b11a85ddbc544b79bd84df37aa9b9cea6a980a64565fa9ca424828b45 WatchSource:0}: Error finding container 3fa10d6b11a85ddbc544b79bd84df37aa9b9cea6a980a64565fa9ca424828b45: Status 404 returned error can't find the container with id 3fa10d6b11a85ddbc544b79bd84df37aa9b9cea6a980a64565fa9ca424828b45
Jul 08 21:33:44.401310 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.401279    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d67sg"]
Jul 08 21:33:44.404770 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:44.404739    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ce4acd_44c3_45bf_bc7c_b334075b0a6d.slice/crio-da80608b9ce3b3ca6d37b8d5c4fbbd332c275156bd0ea8b9e4afbf9743d1c5b7 WatchSource:0}: Error finding container da80608b9ce3b3ca6d37b8d5c4fbbd332c275156bd0ea8b9e4afbf9743d1c5b7: Status 404 returned error can't find the container with id da80608b9ce3b3ca6d37b8d5c4fbbd332c275156bd0ea8b9e4afbf9743d1c5b7
Jul 08 21:33:44.435964 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.435744    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kjc7h\""
Jul 08 21:33:44.443721 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.443652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"
Jul 08 21:33:44.619742 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.619709    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs"]
Jul 08 21:33:44.626277 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:44.626250    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09037241_09bb_44ca_9589_9784ab6f3aa5.slice/crio-9bec86e3495c6bdec0185ec3a4f1988abaf899c4d4bcdf866e795b74e2a8e667 WatchSource:0}: Error finding container 9bec86e3495c6bdec0185ec3a4f1988abaf899c4d4bcdf866e795b74e2a8e667: Status 404 returned error can't find the container with id 9bec86e3495c6bdec0185ec3a4f1988abaf899c4d4bcdf866e795b74e2a8e667
Jul 08 21:33:44.935324 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.935277    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs" event={"ID":"09037241-09bb-44ca-9589-9784ab6f3aa5","Type":"ContainerStarted","Data":"9bec86e3495c6bdec0185ec3a4f1988abaf899c4d4bcdf866e795b74e2a8e667"}
Jul 08 21:33:44.937794 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.937760    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-666f696759-zrbhg" event={"ID":"02e159d6-5bd4-49e5-b5a3-da70dea42bb6","Type":"ContainerStarted","Data":"db516689e31fe1649e938b83bdbb1c1ee4de5012f7ac92f1602bb9b10d652136"}
Jul 08 21:33:44.937924 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.937832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-666f696759-zrbhg" event={"ID":"02e159d6-5bd4-49e5-b5a3-da70dea42bb6","Type":"ContainerStarted","Data":"3fa10d6b11a85ddbc544b79bd84df37aa9b9cea6a980a64565fa9ca424828b45"}
Jul 08 21:33:44.939290 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.939262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d67sg" event={"ID":"31ce4acd-44c3-45bf-bc7c-b334075b0a6d","Type":"ContainerStarted","Data":"da80608b9ce3b3ca6d37b8d5c4fbbd332c275156bd0ea8b9e4afbf9743d1c5b7"}
Jul 08 21:33:44.940642 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.940587    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k" event={"ID":"2ca1c862-0bb7-4a32-8029-178e63da5bde","Type":"ContainerStarted","Data":"5c04e669eac71681b5d5a4763cc4365a31579077b2b229df1527ffddca3aea27"}
Jul 08 21:33:44.943935 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.943647    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc" event={"ID":"dcfdccbd-422e-49d1-b979-2a5893a07140","Type":"ContainerStarted","Data":"6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6"}
Jul 08 21:33:44.943935 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.943692    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc" event={"ID":"dcfdccbd-422e-49d1-b979-2a5893a07140","Type":"ContainerStarted","Data":"2d51807df3f79f8ddb95a09f4ff1f35851c19e4dfd515943f34a0e127318c193"}
Jul 08 21:33:44.943935 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.943816    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:33:44.962873 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.962807    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-666f696759-zrbhg" podStartSLOduration=48.962786097 podStartE2EDuration="48.962786097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:44.960490786 +0000 UTC m=+70.850271837" watchObservedRunningTime="2026-07-08 21:33:44.962786097 +0000 UTC m=+70.852567188"
Jul 08 21:33:44.999699 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:44.999639    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc" podStartSLOduration=69.999622027 podStartE2EDuration="1m9.999622027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:44.997997773 +0000 UTC m=+70.887778799" watchObservedRunningTime="2026-07-08 21:33:44.999622027 +0000 UTC m=+70.889403052"
Jul 08 21:33:45.118589 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:45.118551    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:45.121350 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:45.121325    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:45.949711 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:45.949676    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:45.950995 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:45.950969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-666f696759-zrbhg"
Jul 08 21:33:48.768322 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.768291    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"]
Jul 08 21:33:48.790032 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.789994    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"]
Jul 08 21:33:48.790241 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.790214    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:48.793766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.793097    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 21:33:48.794287 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.794265    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 21:33:48.794287 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.794280    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ggcwn\""
Jul 08 21:33:48.794439 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.794325    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 21:33:48.794524 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.794498    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 21:33:48.804281 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.803895    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"]
Jul 08 21:33:48.804281 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.804262    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:48.815205 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.815176    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 21:33:48.815515 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.815482    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 21:33:48.815675 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.815649    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 21:33:48.819370 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.819349    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 21:33:48.826156 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.826099    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"]
Jul 08 21:33:48.826156 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.826126    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"]
Jul 08 21:33:48.826156 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.826148    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"]
Jul 08 21:33:48.826361 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.826243    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:48.831283 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.831258    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 21:33:48.890571 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.890527    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d844bdd4d-rqpcl"]
Jul 08 21:33:48.912237 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.912206    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:48.915862 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.915834    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-qrphb"]
Jul 08 21:33:48.917330 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.917303    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 21:33:48.917478 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.917306    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 21:33:48.917832 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.917813    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 21:33:48.917832 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.917828    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 21:33:48.918002 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.917840    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8zn5\""
Jul 08 21:33:48.918002 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.917840    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 21:33:48.918002 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.917923    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 21:33:48.918703 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.918553    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 21:33:48.926347 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpwbv\" (UniqueName: \"kubernetes.io/projected/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-kube-api-access-tpwbv\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:48.926476 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e3e2949-3e65-4645-898b-d747420e9412-tmp\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:48.926476 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-hub\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:48.926476 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:48.926610 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8e3e2949-3e65-4645-898b-d747420e9412-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:48.926610 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrsr\" (UniqueName: \"kubernetes.io/projected/8e3e2949-3e65-4645-898b-d747420e9412-kube-api-access-pgrsr\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:48.926708 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926616    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:48.926708 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926667    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppnkd\" (UniqueName: \"kubernetes.io/projected/d7098e08-ef9e-4f7f-8944-d02a81e579d8-kube-api-access-ppnkd\") pod \"managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt\" (UID: \"d7098e08-ef9e-4f7f-8944-d02a81e579d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:48.926802 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:48.926802 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-ca\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:48.926802 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.926773    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7098e08-ef9e-4f7f-8944-d02a81e579d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt\" (UID: \"d7098e08-ef9e-4f7f-8944-d02a81e579d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:48.930085 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.930065    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qrphb"
Jul 08 21:33:48.942855 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.942732    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vhw7g\""
Jul 08 21:33:48.950809 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.950779    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 21:33:48.955655 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.955628    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d844bdd4d-rqpcl"]
Jul 08 21:33:48.962491 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:48.962464    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qrphb"]
Jul 08 21:33:49.027489 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027421    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrsr\" (UniqueName: \"kubernetes.io/projected/8e3e2949-3e65-4645-898b-d747420e9412-kube-api-access-pgrsr\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:49.027489 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027460    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.027736 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbgcs\" (UniqueName: \"kubernetes.io/projected/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-kube-api-access-tbgcs\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.027736 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027681    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppnkd\" (UniqueName: \"kubernetes.io/projected/d7098e08-ef9e-4f7f-8944-d02a81e579d8-kube-api-access-ppnkd\") pod \"managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt\" (UID: \"d7098e08-ef9e-4f7f-8944-d02a81e579d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:49.027736 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.027880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-trusted-ca-bundle\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.027880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-ca\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.027880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7098e08-ef9e-4f7f-8944-d02a81e579d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt\" (UID: \"d7098e08-ef9e-4f7f-8944-d02a81e579d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:49.027880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-serving-cert\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.027880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpwbv\" (UniqueName: \"kubernetes.io/projected/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-kube-api-access-tpwbv\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.028128 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-oauth-serving-cert\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.028128 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e3e2949-3e65-4645-898b-d747420e9412-tmp\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:49.028128 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.027982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-service-ca\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.028128 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028006    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-config\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.028128 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-hub\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.028128 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.028128 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028120    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjck4\" (UniqueName: \"kubernetes.io/projected/e2455135-ba65-4506-91f2-2e11b9bf5015-kube-api-access-pjck4\") pod \"downloads-685bfb5f64-qrphb\" (UID: \"e2455135-ba65-4506-91f2-2e11b9bf5015\") " pod="openshift-console/downloads-685bfb5f64-qrphb"
Jul 08 21:33:49.028672 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028144    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.028672 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028160    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-oauth-config\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.028672 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028235    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8e3e2949-3e65-4645-898b-d747420e9412-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:49.028672 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.028335    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e3e2949-3e65-4645-898b-d747420e9412-tmp\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:49.030901 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.030876    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7098e08-ef9e-4f7f-8944-d02a81e579d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt\" (UID: \"d7098e08-ef9e-4f7f-8944-d02a81e579d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:49.031089 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.031067    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8e3e2949-3e65-4645-898b-d747420e9412-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:49.031167 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.031103    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.031167 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.031124    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-ca\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.031314 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.031294    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.031366 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.031355    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-hub\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.037213 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.037190    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppnkd\" (UniqueName: \"kubernetes.io/projected/d7098e08-ef9e-4f7f-8944-d02a81e579d8-kube-api-access-ppnkd\") pod \"managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt\" (UID: \"d7098e08-ef9e-4f7f-8944-d02a81e579d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:49.038079 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.038054    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrsr\" (UniqueName: \"kubernetes.io/projected/8e3e2949-3e65-4645-898b-d747420e9412-kube-api-access-pgrsr\") pod \"klusterlet-addon-workmgr-6f8bff7b7d-8tc5k\" (UID: \"8e3e2949-3e65-4645-898b-d747420e9412\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:49.039702 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.039676    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpwbv\" (UniqueName: \"kubernetes.io/projected/6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b-kube-api-access-tpwbv\") pod \"cluster-proxy-proxy-agent-fcbf58cb7-4v9hq\" (UID: \"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.110214 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.110181    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"
Jul 08 21:33:49.122529 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.122490    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"
Jul 08 21:33:49.128773 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.128748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-serving-cert\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.128901 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.128786    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-oauth-serving-cert\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.128901 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.128816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-service-ca\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.128989 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.128957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-config\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.129031 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.129009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjck4\" (UniqueName: \"kubernetes.io/projected/e2455135-ba65-4506-91f2-2e11b9bf5015-kube-api-access-pjck4\") pod \"downloads-685bfb5f64-qrphb\" (UID: \"e2455135-ba65-4506-91f2-2e11b9bf5015\") " pod="openshift-console/downloads-685bfb5f64-qrphb"
Jul 08 21:33:49.129072 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.129042    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-oauth-config\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.129123 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.129104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbgcs\" (UniqueName: \"kubernetes.io/projected/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-kube-api-access-tbgcs\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.129359 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.129149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-trusted-ca-bundle\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.129717 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.129577    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-service-ca\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.129717 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.129650    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-oauth-serving-cert\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.129717 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.129691    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-config\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.130947 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.130875    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-trusted-ca-bundle\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.131766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.131741    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-serving-cert\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.131905 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.131884    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-oauth-config\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.140706 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.140679    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjck4\" (UniqueName: \"kubernetes.io/projected/e2455135-ba65-4506-91f2-2e11b9bf5015-kube-api-access-pjck4\") pod \"downloads-685bfb5f64-qrphb\" (UID: \"e2455135-ba65-4506-91f2-2e11b9bf5015\") " pod="openshift-console/downloads-685bfb5f64-qrphb"
Jul 08 21:33:49.141297 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.141276    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbgcs\" (UniqueName: \"kubernetes.io/projected/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-kube-api-access-tbgcs\") pod \"console-7d844bdd4d-rqpcl\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") " pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.145979 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.145960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:33:49.224424 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.224376    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:33:49.240817 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:49.240788    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qrphb"
Jul 08 21:33:50.215881 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.215689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq"]
Jul 08 21:33:50.247817 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.238684    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d844bdd4d-rqpcl"]
Jul 08 21:33:50.247817 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.246343    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"]
Jul 08 21:33:50.262014 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:50.261978    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10afb7b7_4412_4273_bb34_ec87ddf7a0d1.slice/crio-9a6cf80f41fe5d0a66770110e6cf21a84ded0cfa0e63f26881abc26eaff3c320 WatchSource:0}: Error finding container 9a6cf80f41fe5d0a66770110e6cf21a84ded0cfa0e63f26881abc26eaff3c320: Status 404 returned error can't find the container with id 9a6cf80f41fe5d0a66770110e6cf21a84ded0cfa0e63f26881abc26eaff3c320
Jul 08 21:33:50.264197 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:50.263983    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3e2949_3e65_4645_898b_d747420e9412.slice/crio-f2781636116cebbfaa8aff618d8e79428cf2cb6570ee39c7d6aad56da1887e38 WatchSource:0}: Error finding container f2781636116cebbfaa8aff618d8e79428cf2cb6570ee39c7d6aad56da1887e38: Status 404 returned error can't find the container with id f2781636116cebbfaa8aff618d8e79428cf2cb6570ee39c7d6aad56da1887e38
Jul 08 21:33:50.274628 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.274568    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt"]
Jul 08 21:33:50.279079 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:50.279055    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7098e08_ef9e_4f7f_8944_d02a81e579d8.slice/crio-2a6a98a1f14682b548b142308db6fe2777841bdf2cc03e2fda05088f957b67b9 WatchSource:0}: Error finding container 2a6a98a1f14682b548b142308db6fe2777841bdf2cc03e2fda05088f957b67b9: Status 404 returned error can't find the container with id 2a6a98a1f14682b548b142308db6fe2777841bdf2cc03e2fda05088f957b67b9
Jul 08 21:33:50.279442 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.279421    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qrphb"]
Jul 08 21:33:50.284504 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:50.284470    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2455135_ba65_4506_91f2_2e11b9bf5015.slice/crio-8ac638d99f3cc481b2233e82d5d0c2dcf33bb7c4c279139f34d57c24fb294fdd WatchSource:0}: Error finding container 8ac638d99f3cc481b2233e82d5d0c2dcf33bb7c4c279139f34d57c24fb294fdd: Status 404 returned error can't find the container with id 8ac638d99f3cc481b2233e82d5d0c2dcf33bb7c4c279139f34d57c24fb294fdd
Jul 08 21:33:50.661228 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.661197    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"]
Jul 08 21:33:50.683391 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.683366    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"]
Jul 08 21:33:50.683561 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.683470    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"
Jul 08 21:33:50.686189 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.686165    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 08 21:33:50.686327 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.686220    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-whf9m\""
Jul 08 21:33:50.856750 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.856711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67a93060-8513-4f8c-acaa-a08127da781c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-z2gwp\" (UID: \"67a93060-8513-4f8c-acaa-a08127da781c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"
Jul 08 21:33:50.958131 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.958097    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67a93060-8513-4f8c-acaa-a08127da781c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-z2gwp\" (UID: \"67a93060-8513-4f8c-acaa-a08127da781c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"
Jul 08 21:33:50.960788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.960764    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67a93060-8513-4f8c-acaa-a08127da781c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-z2gwp\" (UID: \"67a93060-8513-4f8c-acaa-a08127da781c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"
Jul 08 21:33:50.978663 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.978629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d67sg" event={"ID":"31ce4acd-44c3-45bf-bc7c-b334075b0a6d","Type":"ContainerStarted","Data":"03d325173f17f5583f7f2363a6b6b1f1d6081186b27c08583b078882c7e8d8fe"}
Jul 08 21:33:50.978803 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.978695    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d67sg" event={"ID":"31ce4acd-44c3-45bf-bc7c-b334075b0a6d","Type":"ContainerStarted","Data":"81697e285aced539f4993b51ab13f2f76b9f8cad20f51c3c346331cf9ed172d1"}
Jul 08 21:33:50.978803 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.978746    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d67sg"
Jul 08 21:33:50.980662 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.980635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k" event={"ID":"2ca1c862-0bb7-4a32-8029-178e63da5bde","Type":"ContainerStarted","Data":"424ce922a9cdf3b4027bd938578112a8bdc979d63d1a1dd533f77fbd060b3fdd"}
Jul 08 21:33:50.982320 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.982272    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qrphb" event={"ID":"e2455135-ba65-4506-91f2-2e11b9bf5015","Type":"ContainerStarted","Data":"8ac638d99f3cc481b2233e82d5d0c2dcf33bb7c4c279139f34d57c24fb294fdd"}
Jul 08 21:33:50.983546 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.983521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq" event={"ID":"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b","Type":"ContainerStarted","Data":"bcd9196d0c18fe156fe708a10a2309f9fc21e03f2c6b832cac93c17b55036ff1"}
Jul 08 21:33:50.984991 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.984964    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d844bdd4d-rqpcl" event={"ID":"10afb7b7-4412-4273-bb34-ec87ddf7a0d1","Type":"ContainerStarted","Data":"9a6cf80f41fe5d0a66770110e6cf21a84ded0cfa0e63f26881abc26eaff3c320"}
Jul 08 21:33:50.986400 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.986373    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k" event={"ID":"8e3e2949-3e65-4645-898b-d747420e9412","Type":"ContainerStarted","Data":"f2781636116cebbfaa8aff618d8e79428cf2cb6570ee39c7d6aad56da1887e38"}
Jul 08 21:33:50.988530 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.988066    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gpv9z" event={"ID":"7f6b1f15-6513-4c37-b92a-389ab8198f22","Type":"ContainerStarted","Data":"4a3055d373d1aa2da12fff7b4045d08445e77d3450b0f59313f958faa10c1189"}
Jul 08 21:33:50.991126 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.991102    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlfz5" event={"ID":"06487288-b864-4886-8928-5b19e82a1153","Type":"ContainerStarted","Data":"3a7772ed6a09893177be82c919aff98d42348a753488efda1493e708362fa887"}
Jul 08 21:33:50.992515 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.992492    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"
Jul 08 21:33:50.993219 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.993195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs" event={"ID":"09037241-09bb-44ca-9589-9784ab6f3aa5","Type":"ContainerStarted","Data":"f314e63ce05dabafca7719f2a0fbf713ecb8c28709e74e02a7929670a03a048f"}
Jul 08 21:33:50.995486 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:50.995460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt" event={"ID":"d7098e08-ef9e-4f7f-8944-d02a81e579d8","Type":"ContainerStarted","Data":"2a6a98a1f14682b548b142308db6fe2777841bdf2cc03e2fda05088f957b67b9"}
Jul 08 21:33:51.012531 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:51.012346    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d67sg" podStartSLOduration=34.456507072 podStartE2EDuration="40.012323774s" totalImagesPullingTime="5.555816702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:51.008749236 +0000 UTC m=+76.898530288" watchObservedRunningTime="2026-07-08 21:33:51.012323774 +0000 UTC m=+76.902104800"
Jul 08 21:33:51.039764 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:51.038865    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vcqcs" podStartSLOduration=33.406846459 podStartE2EDuration="39.038843933s" totalImagesPullingTime="5.631997474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:51.037509005 +0000 UTC m=+76.927290035" watchObservedRunningTime="2026-07-08 21:33:51.038843933 +0000 UTC m=+76.928624961"
Jul 08 21:33:51.058119 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:51.057804    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mxn6k" podStartSLOduration=49.374620651 podStartE2EDuration="55.057782965s" totalImagesPullingTime="5.683162314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:51.056160597 +0000 UTC m=+76.945941623" watchObservedRunningTime="2026-07-08 21:33:51.057782965 +0000 UTC m=+76.947563993"
Jul 08 21:33:51.077590 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:51.077000    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xlfz5" podStartSLOduration=18.19800458 podStartE2EDuration="30.076979812s" totalImagesPullingTime="11.878975232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:51.076657483 +0000 UTC m=+76.966438564" watchObservedRunningTime="2026-07-08 21:33:51.076979812 +0000 UTC m=+76.966760839"
Jul 08 21:33:51.185624 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:51.184912    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gpv9z" podStartSLOduration=68.608301387 podStartE2EDuration="1m16.184888919s" totalImagesPullingTime="7.576587532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:51.093342808 +0000 UTC m=+76.983123836" watchObservedRunningTime="2026-07-08 21:33:51.184888919 +0000 UTC m=+77.074669935"
Jul 08 21:33:51.186517 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:51.186440    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"]
Jul 08 21:33:51.191279 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:33:51.191250    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a93060_8513_4f8c_acaa_a08127da781c.slice/crio-8c898903c9ed5d61148c4493d3296af57a4ce43f98ea7cf48970801a565daf56 WatchSource:0}: Error finding container 8c898903c9ed5d61148c4493d3296af57a4ce43f98ea7cf48970801a565daf56: Status 404 returned error can't find the container with id 8c898903c9ed5d61148c4493d3296af57a4ce43f98ea7cf48970801a565daf56
Jul 08 21:33:52.018013 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:33:52.017978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp" event={"ID":"67a93060-8513-4f8c-acaa-a08127da781c","Type":"ContainerStarted","Data":"8c898903c9ed5d61148c4493d3296af57a4ce43f98ea7cf48970801a565daf56"}
Jul 08 21:34:00.081388 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.081342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp" event={"ID":"67a93060-8513-4f8c-acaa-a08127da781c","Type":"ContainerStarted","Data":"6d6309f0710669dfab077a9d0da758222d996170dcc5077d55883ccb4ddeedb4"}
Jul 08 21:34:00.081957 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.081565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"
Jul 08 21:34:00.084873 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.084449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq" event={"ID":"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b","Type":"ContainerStarted","Data":"cb585429441abfa51e6524d8dab827eac0f02517fca328224f778d86492193f7"}
Jul 08 21:34:00.084873 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.084492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq" event={"ID":"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b","Type":"ContainerStarted","Data":"6010465da817603b881e72dfd2be9257c2c5047f7f9d73a4c344005089d7856a"}
Jul 08 21:34:00.084873 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.084511    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq" event={"ID":"6b2fc8af-cc3f-449b-8e23-f4cf07f5cb2b","Type":"ContainerStarted","Data":"f9212a7cd680acec370bbce95831b1e84977a5093b9c25853494a8b01ff26666"}
Jul 08 21:34:00.086316 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.086286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d844bdd4d-rqpcl" event={"ID":"10afb7b7-4412-4273-bb34-ec87ddf7a0d1","Type":"ContainerStarted","Data":"853f1cec15d3dd22fb449a455dad4f7716b09abbf72683dc91d5a632f62b089f"}
Jul 08 21:34:00.087433 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.087390    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp"
Jul 08 21:34:00.088060 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.088035    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k" event={"ID":"8e3e2949-3e65-4645-898b-d747420e9412","Type":"ContainerStarted","Data":"4d79733652b82acdbf43cebac754b8e1b6cbaa3883c175783e007357bb08c04b"}
Jul 08 21:34:00.088208 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.088194    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:34:00.089642 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.089620    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k"
Jul 08 21:34:00.090261 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.090239    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt" event={"ID":"d7098e08-ef9e-4f7f-8944-d02a81e579d8","Type":"ContainerStarted","Data":"85f1782c2beece40ff7bb75fe7dc8c6f0c80133dcba1baced0e3c41b9f95130d"}
Jul 08 21:34:00.098691 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.098649    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z2gwp" podStartSLOduration=2.307998562 podStartE2EDuration="10.098635041s" totalImagesPullingTime="7.790636479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:00.097729679 +0000 UTC m=+85.987510730" watchObservedRunningTime="2026-07-08 21:34:00.098635041 +0000 UTC m=+85.988416067"
Jul 08 21:34:00.117075 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.116990    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcbf58cb7-4v9hq" podStartSLOduration=3.369673216 podStartE2EDuration="12.116973995s" totalImagesPullingTime="8.747300779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:00.116584662 +0000 UTC m=+86.006365679" watchObservedRunningTime="2026-07-08 21:34:00.116973995 +0000 UTC m=+86.006755020"
Jul 08 21:34:00.133777 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.133733    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f9b9bfdc4-zxkvt" podStartSLOduration=3.431393668 podStartE2EDuration="12.133716183s" totalImagesPullingTime="8.702322515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:00.132141566 +0000 UTC m=+86.021922602" watchObservedRunningTime="2026-07-08 21:34:00.133716183 +0000 UTC m=+86.023497209"
Jul 08 21:34:00.152012 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.151968    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f8bff7b7d-8tc5k" podStartSLOduration=3.41522154 podStartE2EDuration="12.151955665s" totalImagesPullingTime="8.736734125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:00.150854162 +0000 UTC m=+86.040635200" watchObservedRunningTime="2026-07-08 21:34:00.151955665 +0000 UTC m=+86.041736728"
Jul 08 21:34:00.170284 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:00.170235    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d844bdd4d-rqpcl" podStartSLOduration=3.449846035 podStartE2EDuration="12.170220205s" totalImagesPullingTime="8.72037417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:00.168771703 +0000 UTC m=+86.058552741" watchObservedRunningTime="2026-07-08 21:34:00.170220205 +0000 UTC m=+86.060001232"
Jul 08 21:34:01.021992 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:01.021957    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d67sg"
Jul 08 21:34:04.067927 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:04.067893    2568 patch_prober.go:28] interesting pod/image-registry-5b79667f8c-hbzfc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:34:04.068369 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:04.067952    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc" podUID="dcfdccbd-422e-49d1-b979-2a5893a07140" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:34:05.954201 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:05.954168    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:34:06.140549 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.140518    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rqjpg"]
Jul 08 21:34:06.293551 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.293517    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.296227 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.295558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-textfile\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.296501 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-root\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.296501 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/795d40e0-faa8-4960-a2b9-5f91c7564410-metrics-client-ca\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296470    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrpsx\" (UniqueName: \"kubernetes.io/projected/795d40e0-faa8-4960-a2b9-5f91c7564410-kube-api-access-mrpsx\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296605    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296637    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-wtmp\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-tls\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296712    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-sys\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.297596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.296783    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 21:34:06.298843 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.298820    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6w4g6\""
Jul 08 21:34:06.298843 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.298835    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 21:34:06.299018 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.298855    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 21:34:06.397835 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.397803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.397847    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.397875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-wtmp\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.397932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-tls\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.397970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-sys\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.398002    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-textfile\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398256 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.398024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-root\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398256 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.398053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/795d40e0-faa8-4960-a2b9-5f91c7564410-metrics-client-ca\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398256 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.398095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrpsx\" (UniqueName: \"kubernetes.io/projected/795d40e0-faa8-4960-a2b9-5f91c7564410-kube-api-access-mrpsx\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398845 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.398579    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-sys\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398845 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.398655    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-root\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.398845 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.398720    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-wtmp\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.399443 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.399396    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.399819 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.399797    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/795d40e0-faa8-4960-a2b9-5f91c7564410-metrics-client-ca\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.399961 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.399942    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-textfile\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.401300 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.401259    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.403248 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.403192    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/795d40e0-faa8-4960-a2b9-5f91c7564410-node-exporter-tls\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.407483 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.407402    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrpsx\" (UniqueName: \"kubernetes.io/projected/795d40e0-faa8-4960-a2b9-5f91c7564410-kube-api-access-mrpsx\") pod \"node-exporter-rqjpg\" (UID: \"795d40e0-faa8-4960-a2b9-5f91c7564410\") " pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:06.609244 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:06.609168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rqjpg"
Jul 08 21:34:09.224852 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:09.224804    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:34:09.225324 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:09.224872    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:34:09.230721 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:09.230461    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:34:10.149921 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:10.149886    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:34:11.702702 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:34:11.702672    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795d40e0_faa8_4960_a2b9_5f91c7564410.slice/crio-b0b74c61f754c30c538c11befd31f4fcea9329f63d4a2df5a7934684f1f7e8a2 WatchSource:0}: Error finding container b0b74c61f754c30c538c11befd31f4fcea9329f63d4a2df5a7934684f1f7e8a2: Status 404 returned error can't find the container with id b0b74c61f754c30c538c11befd31f4fcea9329f63d4a2df5a7934684f1f7e8a2
Jul 08 21:34:12.156834 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:12.156810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqjpg" event={"ID":"795d40e0-faa8-4960-a2b9-5f91c7564410","Type":"ContainerStarted","Data":"b0b74c61f754c30c538c11befd31f4fcea9329f63d4a2df5a7934684f1f7e8a2"}
Jul 08 21:34:13.164135 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:13.164097    2568 generic.go:356] "Generic (PLEG): container finished" podID="795d40e0-faa8-4960-a2b9-5f91c7564410" containerID="3e629f5574017b13d9a333db0f06412ae2f74d9116e7cc451065a15374e1d97b" exitCode=0
Jul 08 21:34:13.164616 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:13.164191    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqjpg" event={"ID":"795d40e0-faa8-4960-a2b9-5f91c7564410","Type":"ContainerDied","Data":"3e629f5574017b13d9a333db0f06412ae2f74d9116e7cc451065a15374e1d97b"}
Jul 08 21:34:13.166159 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:13.166132    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qrphb" event={"ID":"e2455135-ba65-4506-91f2-2e11b9bf5015","Type":"ContainerStarted","Data":"d3c413b31a9b2e452f3b3557e4e1eccee6cb55a875f8724b066d43c2723cd620"}
Jul 08 21:34:13.166309 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:13.166287    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-qrphb"
Jul 08 21:34:13.177443 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:13.177397    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-qrphb"
Jul 08 21:34:13.204434 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:13.204363    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-qrphb" podStartSLOduration=3.383348899 podStartE2EDuration="25.204344803s" totalImagesPullingTime="21.820995904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:13.20335877 +0000 UTC m=+99.093139816" watchObservedRunningTime="2026-07-08 21:34:13.204344803 +0000 UTC m=+99.094125827"
Jul 08 21:34:13.931430 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:13.931392    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7phf6"
Jul 08 21:34:14.174235 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:14.174195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqjpg" event={"ID":"795d40e0-faa8-4960-a2b9-5f91c7564410","Type":"ContainerStarted","Data":"9c8a6f88563a839199a8f6fac42b9e299cc01867c7c7e7f69cd827f2cb22a161"}
Jul 08 21:34:14.174725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:14.174259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqjpg" event={"ID":"795d40e0-faa8-4960-a2b9-5f91c7564410","Type":"ContainerStarted","Data":"f1a1d92e21c05322227edf3476d30cc6a52ca68f4d50a98534d4681218a2358a"}
Jul 08 21:34:14.196295 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:14.196182    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rqjpg" podStartSLOduration=6.917288716 podStartE2EDuration="8.196164904s" totalImagesPullingTime="1.175609359s" totalInitContainerRuntime="103.266829ms" isStatefulPod=true podCreationTimestamp="2026-07-08 21:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:14.194264852 +0000 UTC m=+100.084045931" watchObservedRunningTime="2026-07-08 21:34:14.196164904 +0000 UTC m=+100.085945931"
Jul 08 21:34:15.829942 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:15.829861    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b79667f8c-hbzfc"]
Jul 08 21:34:21.969516 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:21.969485    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d844bdd4d-rqpcl"]
Jul 08 21:34:32.255565 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:32.255531    2568 generic.go:356] "Generic (PLEG): container finished" podID="64b1542c-e26f-4e5c-97c8-67287f0229f6" containerID="f8f6131d7da36dcad06ecdb712287f937d2a8d1ce6d116a1e7858a91c10cfa2b" exitCode=0
Jul 08 21:34:32.256039 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:32.255601    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c" event={"ID":"64b1542c-e26f-4e5c-97c8-67287f0229f6","Type":"ContainerDied","Data":"f8f6131d7da36dcad06ecdb712287f937d2a8d1ce6d116a1e7858a91c10cfa2b"}
Jul 08 21:34:32.256039 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:32.255926    2568 scope.go:117] "RemoveContainer" containerID="f8f6131d7da36dcad06ecdb712287f937d2a8d1ce6d116a1e7858a91c10cfa2b"
Jul 08 21:34:33.261598 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:33.261562    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gqh2c" event={"ID":"64b1542c-e26f-4e5c-97c8-67287f0229f6","Type":"ContainerStarted","Data":"da054b7f8271f52856945720a0573124629d8a2aadc2dcbeb7c943133cc16259"}
Jul 08 21:34:36.276039 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:36.276008    2568 generic.go:356] "Generic (PLEG): container finished" podID="d592cb17-8a58-4916-b7e8-c67fc17c57d3" containerID="a1b789c3b6b002e2db1f8ea07fe218057180abef6a2f8f1a5fd3f4bad91a1c92" exitCode=0
Jul 08 21:34:36.276390 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:36.276076    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q" event={"ID":"d592cb17-8a58-4916-b7e8-c67fc17c57d3","Type":"ContainerDied","Data":"a1b789c3b6b002e2db1f8ea07fe218057180abef6a2f8f1a5fd3f4bad91a1c92"}
Jul 08 21:34:36.276453 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:36.276396    2568 scope.go:117] "RemoveContainer" containerID="a1b789c3b6b002e2db1f8ea07fe218057180abef6a2f8f1a5fd3f4bad91a1c92"
Jul 08 21:34:37.281804 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:37.281763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4vp9q" event={"ID":"d592cb17-8a58-4916-b7e8-c67fc17c57d3","Type":"ContainerStarted","Data":"eb13339f61e36c28a325bc6e3cefb1e7e043f25c512ea832e69d693a2d8d404e"}
Jul 08 21:34:40.855946 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:40.855897    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc" podUID="dcfdccbd-422e-49d1-b979-2a5893a07140" containerName="registry" containerID="cri-o://6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6" gracePeriod=30
Jul 08 21:34:41.103104 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.103078    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:34:41.218437 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218326    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-image-registry-private-configuration\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.218437 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218369    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8bt2\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-kube-api-access-t8bt2\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.218437 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218436    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcfdccbd-422e-49d1-b979-2a5893a07140-ca-trust-extracted\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.218719 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218478    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-installation-pull-secrets\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.218719 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218515    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-trusted-ca\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.218719 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218568    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-certificates\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.218719 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218628    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-bound-sa-token\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.218719 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.218653    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") pod \"dcfdccbd-422e-49d1-b979-2a5893a07140\" (UID: \"dcfdccbd-422e-49d1-b979-2a5893a07140\") "
Jul 08 21:34:41.219083 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.219049    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:41.219288 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.219250    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:41.220891 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.220858    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:41.221242 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.221139    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-kube-api-access-t8bt2" (OuterVolumeSpecName: "kube-api-access-t8bt2") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "kube-api-access-t8bt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:41.221340 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.221315    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:41.221400 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.221333    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:41.221478 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.221424    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:41.227002 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.226974    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcfdccbd-422e-49d1-b979-2a5893a07140-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dcfdccbd-422e-49d1-b979-2a5893a07140" (UID: "dcfdccbd-422e-49d1-b979-2a5893a07140"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:34:41.300507 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.300473    2568 generic.go:356] "Generic (PLEG): container finished" podID="dcfdccbd-422e-49d1-b979-2a5893a07140" containerID="6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6" exitCode=0
Jul 08 21:34:41.300639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.300520    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc"
Jul 08 21:34:41.300639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.300560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc" event={"ID":"dcfdccbd-422e-49d1-b979-2a5893a07140","Type":"ContainerDied","Data":"6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6"}
Jul 08 21:34:41.300639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.300605    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b79667f8c-hbzfc" event={"ID":"dcfdccbd-422e-49d1-b979-2a5893a07140","Type":"ContainerDied","Data":"2d51807df3f79f8ddb95a09f4ff1f35851c19e4dfd515943f34a0e127318c193"}
Jul 08 21:34:41.300639 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.300624    2568 scope.go:117] "RemoveContainer" containerID="6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6"
Jul 08 21:34:41.309370 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.309354    2568 scope.go:117] "RemoveContainer" containerID="6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6"
Jul 08 21:34:41.309648 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:34:41.309626    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6\": container with ID starting with 6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6 not found: ID does not exist" containerID="6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6"
Jul 08 21:34:41.309716 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.309655    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6"} err="failed to get container status \"6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6\": rpc error: code = NotFound desc = could not find container \"6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6\": container with ID starting with 6b634508d5d7c4dfc66190456d157875a207cb96dc7c0d2d389b114a284309c6 not found: ID does not exist"
Jul 08 21:34:41.320205 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320185    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-trusted-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.320205 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320202    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-certificates\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.320306 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320211    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-bound-sa-token\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.320306 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320220    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-registry-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.320306 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320229    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-image-registry-private-configuration\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.320306 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320238    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8bt2\" (UniqueName: \"kubernetes.io/projected/dcfdccbd-422e-49d1-b979-2a5893a07140-kube-api-access-t8bt2\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.320306 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320246    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcfdccbd-422e-49d1-b979-2a5893a07140-ca-trust-extracted\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.320306 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.320254    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcfdccbd-422e-49d1-b979-2a5893a07140-installation-pull-secrets\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:41.322652 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.322633    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b79667f8c-hbzfc"]
Jul 08 21:34:41.325710 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:41.325692    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b79667f8c-hbzfc"]
Jul 08 21:34:42.629195 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:42.629162    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcfdccbd-422e-49d1-b979-2a5893a07140" path="/var/lib/kubelet/pods/dcfdccbd-422e-49d1-b979-2a5893a07140/volumes"
Jul 08 21:34:46.992822 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:46.992759    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d844bdd4d-rqpcl" podUID="10afb7b7-4412-4273-bb34-ec87ddf7a0d1" containerName="console" containerID="cri-o://853f1cec15d3dd22fb449a455dad4f7716b09abbf72683dc91d5a632f62b089f" gracePeriod=15
Jul 08 21:34:47.333850 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.333816    2568 generic.go:356] "Generic (PLEG): container finished" podID="10afb7b7-4412-4273-bb34-ec87ddf7a0d1" containerID="853f1cec15d3dd22fb449a455dad4f7716b09abbf72683dc91d5a632f62b089f" exitCode=0
Jul 08 21:34:47.333997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.333868    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d844bdd4d-rqpcl" event={"ID":"10afb7b7-4412-4273-bb34-ec87ddf7a0d1","Type":"ContainerDied","Data":"853f1cec15d3dd22fb449a455dad4f7716b09abbf72683dc91d5a632f62b089f"}
Jul 08 21:34:47.333997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.333911    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d844bdd4d-rqpcl" event={"ID":"10afb7b7-4412-4273-bb34-ec87ddf7a0d1","Type":"ContainerDied","Data":"9a6cf80f41fe5d0a66770110e6cf21a84ded0cfa0e63f26881abc26eaff3c320"}
Jul 08 21:34:47.333997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.333926    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a6cf80f41fe5d0a66770110e6cf21a84ded0cfa0e63f26881abc26eaff3c320"
Jul 08 21:34:47.333997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.333959    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:34:47.372425 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372387    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-config\") pod \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") "
Jul 08 21:34:47.372557 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372446    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbgcs\" (UniqueName: \"kubernetes.io/projected/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-kube-api-access-tbgcs\") pod \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") "
Jul 08 21:34:47.372557 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372538    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-oauth-config\") pod \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") "
Jul 08 21:34:47.372664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372577    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-serving-cert\") pod \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") "
Jul 08 21:34:47.372664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372611    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-service-ca\") pod \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") "
Jul 08 21:34:47.372664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372637    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-trusted-ca-bundle\") pod \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") "
Jul 08 21:34:47.372664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372652    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-oauth-serving-cert\") pod \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\" (UID: \"10afb7b7-4412-4273-bb34-ec87ddf7a0d1\") "
Jul 08 21:34:47.372940 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.372897    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-config" (OuterVolumeSpecName: "console-config") pod "10afb7b7-4412-4273-bb34-ec87ddf7a0d1" (UID: "10afb7b7-4412-4273-bb34-ec87ddf7a0d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:47.373171 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.373140    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "10afb7b7-4412-4273-bb34-ec87ddf7a0d1" (UID: "10afb7b7-4412-4273-bb34-ec87ddf7a0d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:47.373171 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.373163    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "10afb7b7-4412-4273-bb34-ec87ddf7a0d1" (UID: "10afb7b7-4412-4273-bb34-ec87ddf7a0d1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:47.373341 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.373268    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "10afb7b7-4412-4273-bb34-ec87ddf7a0d1" (UID: "10afb7b7-4412-4273-bb34-ec87ddf7a0d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:47.374880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.374853    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-kube-api-access-tbgcs" (OuterVolumeSpecName: "kube-api-access-tbgcs") pod "10afb7b7-4412-4273-bb34-ec87ddf7a0d1" (UID: "10afb7b7-4412-4273-bb34-ec87ddf7a0d1"). InnerVolumeSpecName "kube-api-access-tbgcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:47.374880 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.374867    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "10afb7b7-4412-4273-bb34-ec87ddf7a0d1" (UID: "10afb7b7-4412-4273-bb34-ec87ddf7a0d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:47.375256 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.375240    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "10afb7b7-4412-4273-bb34-ec87ddf7a0d1" (UID: "10afb7b7-4412-4273-bb34-ec87ddf7a0d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:47.474252 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.474215    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-oauth-config\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:47.474252 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.474243    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-serving-cert\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:47.474252 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.474253    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:47.474252 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.474261    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-trusted-ca-bundle\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:47.474517 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.474270    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-oauth-serving-cert\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:47.474517 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.474278    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-console-config\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:47.474517 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:47.474286    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbgcs\" (UniqueName: \"kubernetes.io/projected/10afb7b7-4412-4273-bb34-ec87ddf7a0d1-kube-api-access-tbgcs\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:34:48.337574 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:48.337542    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d844bdd4d-rqpcl"
Jul 08 21:34:48.360865 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:48.360838    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d844bdd4d-rqpcl"]
Jul 08 21:34:48.364710 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:48.364688    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d844bdd4d-rqpcl"]
Jul 08 21:34:48.629407 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:48.629315    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10afb7b7-4412-4273-bb34-ec87ddf7a0d1" path="/var/lib/kubelet/pods/10afb7b7-4412-4273-bb34-ec87ddf7a0d1/volumes"
Jul 08 21:34:52.356284 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:52.356251    2568 generic.go:356] "Generic (PLEG): container finished" podID="1a85ea56-a77c-44f3-bef6-0ed26f0354ab" containerID="ff547cc37d5031d91fec24741ea5d5d63a403344d709bf78d9c65556dfc4f90b" exitCode=0
Jul 08 21:34:52.356674 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:52.356331    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp" event={"ID":"1a85ea56-a77c-44f3-bef6-0ed26f0354ab","Type":"ContainerDied","Data":"ff547cc37d5031d91fec24741ea5d5d63a403344d709bf78d9c65556dfc4f90b"}
Jul 08 21:34:52.356744 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:52.356727    2568 scope.go:117] "RemoveContainer" containerID="ff547cc37d5031d91fec24741ea5d5d63a403344d709bf78d9c65556dfc4f90b"
Jul 08 21:34:53.366740 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:34:53.366707    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pmglp" event={"ID":"1a85ea56-a77c-44f3-bef6-0ed26f0354ab","Type":"ContainerStarted","Data":"963d1b705217b610ec26336f47cd256557f0e77804ba7c9fdea65c45a6ba2b88"}
Jul 08 21:37:34.514613 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:34.514584    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:37:34.517579 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:34.517554    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:37:34.522819 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:34.522795    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:37:34.526050 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:34.526021    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 21:37:34.526279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:34.526263    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:37:38.010321 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.010285    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"]
Jul 08 21:37:38.012648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.010632    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10afb7b7-4412-4273-bb34-ec87ddf7a0d1" containerName="console"
Jul 08 21:37:38.012648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.010645    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="10afb7b7-4412-4273-bb34-ec87ddf7a0d1" containerName="console"
Jul 08 21:37:38.012648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.010659    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcfdccbd-422e-49d1-b979-2a5893a07140" containerName="registry"
Jul 08 21:37:38.012648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.010664    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcfdccbd-422e-49d1-b979-2a5893a07140" containerName="registry"
Jul 08 21:37:38.012648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.010717    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="10afb7b7-4412-4273-bb34-ec87ddf7a0d1" containerName="console"
Jul 08 21:37:38.012648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.010727    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcfdccbd-422e-49d1-b979-2a5893a07140" containerName="registry"
Jul 08 21:37:38.013597 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.013582    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.016958 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.016937    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 21:37:38.017121 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.017103    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 21:37:38.017219 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.017201    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 21:37:38.017340 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.017319    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 21:37:38.017614 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.017597    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-trgck\""
Jul 08 21:37:38.032539 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.032517    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"]
Jul 08 21:37:38.156473 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.156442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.156473 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.156477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-manifests\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.156670 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.156504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-webhook-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.156670 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.156553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-tmp\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.156670 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.156603    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clw6d\" (UniqueName: \"kubernetes.io/projected/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-kube-api-access-clw6d\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.257868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.257834    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.257868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.257872    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-manifests\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.258063 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.257907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-webhook-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.258063 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.257925    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-tmp\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.258063 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.257951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clw6d\" (UniqueName: \"kubernetes.io/projected/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-kube-api-access-clw6d\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.258323 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.258303    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-manifests\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.260358 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.260301    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-tmp\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.260480 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.260392    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-webhook-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.260480 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.260448    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.269986 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.269961    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clw6d\" (UniqueName: \"kubernetes.io/projected/bfaf6d10-e55b-4238-9f43-0e42dbbbae58-kube-api-access-clw6d\") pod \"opendatahub-operator-controller-manager-c97f5c75f-hw2fl\" (UID: \"bfaf6d10-e55b-4238-9f43-0e42dbbbae58\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.324016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.323993    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:38.460214 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.460184    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"]
Jul 08 21:37:38.462504 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:37:38.462475    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfaf6d10_e55b_4238_9f43_0e42dbbbae58.slice/crio-c41522fe7b8af22045c355d9d1e4621af5071ae8b9106217815476df39635c01 WatchSource:0}: Error finding container c41522fe7b8af22045c355d9d1e4621af5071ae8b9106217815476df39635c01: Status 404 returned error can't find the container with id c41522fe7b8af22045c355d9d1e4621af5071ae8b9106217815476df39635c01
Jul 08 21:37:38.464220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:38.464203    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:37:39.066573 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:39.066523    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl" event={"ID":"bfaf6d10-e55b-4238-9f43-0e42dbbbae58","Type":"ContainerStarted","Data":"c41522fe7b8af22045c355d9d1e4621af5071ae8b9106217815476df39635c01"}
Jul 08 21:37:42.082602 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:42.082563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl" event={"ID":"bfaf6d10-e55b-4238-9f43-0e42dbbbae58","Type":"ContainerStarted","Data":"9dbbd86421b9766e24ad96cd6e8ba719f82208b32c40b44eee70d49445afe976"}
Jul 08 21:37:43.088457 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:43.088391    2568 generic.go:356] "Generic (PLEG): container finished" podID="bfaf6d10-e55b-4238-9f43-0e42dbbbae58" containerID="9dbbd86421b9766e24ad96cd6e8ba719f82208b32c40b44eee70d49445afe976" exitCode=0
Jul 08 21:37:43.088839 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:43.088472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl" event={"ID":"bfaf6d10-e55b-4238-9f43-0e42dbbbae58","Type":"ContainerDied","Data":"9dbbd86421b9766e24ad96cd6e8ba719f82208b32c40b44eee70d49445afe976"}
Jul 08 21:37:44.095035 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:44.095000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl" event={"ID":"bfaf6d10-e55b-4238-9f43-0e42dbbbae58","Type":"ContainerStarted","Data":"1c5d44882230702b59e5043d7da5da0fab00aea762ba7b5307f11076891c15f2"}
Jul 08 21:37:44.095404 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:44.095093    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:44.139016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:44.138966    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl" podStartSLOduration=2.945823408 podStartE2EDuration="7.138950165s" totalImagesPullingTime="3.158428082s" totalInitContainerRuntime="1.034698675s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:44.138528178 +0000 UTC m=+310.028309204" watchObservedRunningTime="2026-07-08 21:37:44.138950165 +0000 UTC m=+310.028731190"
Jul 08 21:37:55.101861 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:55.101826    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-hw2fl"
Jul 08 21:37:57.667948 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.667914    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"]
Jul 08 21:37:57.671086 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.671068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.673737 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.673710    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 21:37:57.673886 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.673748    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 21:37:57.674002 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.673982    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xcd4c\""
Jul 08 21:37:57.683869 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.683844    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"]
Jul 08 21:37:57.718466 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.718434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c43f8392-402b-44ad-8604-f99b8759ff27-tls-certs\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.718636 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.718471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmmh8\" (UniqueName: \"kubernetes.io/projected/c43f8392-402b-44ad-8604-f99b8759ff27-kube-api-access-dmmh8\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.718636 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.718563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c43f8392-402b-44ad-8604-f99b8759ff27-tmp\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.819225 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.819194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c43f8392-402b-44ad-8604-f99b8759ff27-tls-certs\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.819403 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.819233    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmh8\" (UniqueName: \"kubernetes.io/projected/c43f8392-402b-44ad-8604-f99b8759ff27-kube-api-access-dmmh8\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.819403 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.819285    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c43f8392-402b-44ad-8604-f99b8759ff27-tmp\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.821620 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.821594    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c43f8392-402b-44ad-8604-f99b8759ff27-tls-certs\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.821746 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.821731    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c43f8392-402b-44ad-8604-f99b8759ff27-tmp\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.836743 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.836709    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmh8\" (UniqueName: \"kubernetes.io/projected/c43f8392-402b-44ad-8604-f99b8759ff27-kube-api-access-dmmh8\") pod \"kube-auth-proxy-589c8d496f-kxp2l\" (UID: \"c43f8392-402b-44ad-8604-f99b8759ff27\") " pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:57.849702 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.849677    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nmtdn"]
Jul 08 21:37:57.852887 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.852873    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:57.857349 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.857329    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 21:37:57.857677 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.857648    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hpctk\""
Jul 08 21:37:57.876261 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.876239    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nmtdn"]
Jul 08 21:37:57.920043 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.919982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f669s\" (UniqueName: \"kubernetes.io/projected/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-kube-api-access-f669s\") pod \"odh-model-controller-7998c67dc4-nmtdn\" (UID: \"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d\") " pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:57.920148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.920079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-cert\") pod \"odh-model-controller-7998c67dc4-nmtdn\" (UID: \"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d\") " pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:57.981315 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:57.981281    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"
Jul 08 21:37:58.020906 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.020830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f669s\" (UniqueName: \"kubernetes.io/projected/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-kube-api-access-f669s\") pod \"odh-model-controller-7998c67dc4-nmtdn\" (UID: \"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d\") " pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:58.021094 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.020912    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-cert\") pod \"odh-model-controller-7998c67dc4-nmtdn\" (UID: \"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d\") " pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:58.021094 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:37:58.021039    2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 21:37:58.021218 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:37:58.021117    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-cert podName:6f3ce70a-4cfe-479f-9d8e-a223d0ca205d nodeName:}" failed. No retries permitted until 2026-07-08 21:37:58.521094675 +0000 UTC m=+324.410875691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-cert") pod "odh-model-controller-7998c67dc4-nmtdn" (UID: "6f3ce70a-4cfe-479f-9d8e-a223d0ca205d") : secret "odh-model-controller-webhook-cert" not found
Jul 08 21:37:58.030905 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.030529    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f669s\" (UniqueName: \"kubernetes.io/projected/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-kube-api-access-f669s\") pod \"odh-model-controller-7998c67dc4-nmtdn\" (UID: \"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d\") " pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:58.114902 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.114877    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l"]
Jul 08 21:37:58.116844 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:37:58.116816    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43f8392_402b_44ad_8604_f99b8759ff27.slice/crio-78fcd39a96f2fc9200e5afef9ca967493b2b047e5acbe613af31950ee968d456 WatchSource:0}: Error finding container 78fcd39a96f2fc9200e5afef9ca967493b2b047e5acbe613af31950ee968d456: Status 404 returned error can't find the container with id 78fcd39a96f2fc9200e5afef9ca967493b2b047e5acbe613af31950ee968d456
Jul 08 21:37:58.155824 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.155796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l" event={"ID":"c43f8392-402b-44ad-8604-f99b8759ff27","Type":"ContainerStarted","Data":"78fcd39a96f2fc9200e5afef9ca967493b2b047e5acbe613af31950ee968d456"}
Jul 08 21:37:58.526360 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.526322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-cert\") pod \"odh-model-controller-7998c67dc4-nmtdn\" (UID: \"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d\") " pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:58.528862 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.528840    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f3ce70a-4cfe-479f-9d8e-a223d0ca205d-cert\") pod \"odh-model-controller-7998c67dc4-nmtdn\" (UID: \"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d\") " pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:58.733305 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.733268    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zw4jm"]
Jul 08 21:37:58.736980 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.736958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:58.740913 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.740871    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 21:37:58.752342 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.752316    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zw4jm"]
Jul 08 21:37:58.762774 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.762745    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:37:58.828988 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.828508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2s2n\" (UniqueName: \"kubernetes.io/projected/31a0d1c8-3cbe-4199-82f1-4f86ef567f6b-kube-api-access-p2s2n\") pod \"model-serving-api-54d89bd5fc-zw4jm\" (UID: \"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:58.828988 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.828553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a0d1c8-3cbe-4199-82f1-4f86ef567f6b-tls-certs\") pod \"model-serving-api-54d89bd5fc-zw4jm\" (UID: \"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:58.929690 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.929206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2s2n\" (UniqueName: \"kubernetes.io/projected/31a0d1c8-3cbe-4199-82f1-4f86ef567f6b-kube-api-access-p2s2n\") pod \"model-serving-api-54d89bd5fc-zw4jm\" (UID: \"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:58.929690 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.929257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a0d1c8-3cbe-4199-82f1-4f86ef567f6b-tls-certs\") pod \"model-serving-api-54d89bd5fc-zw4jm\" (UID: \"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:58.929925 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.929884    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nmtdn"]
Jul 08 21:37:58.932217 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.932196    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31a0d1c8-3cbe-4199-82f1-4f86ef567f6b-tls-certs\") pod \"model-serving-api-54d89bd5fc-zw4jm\" (UID: \"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:58.933368 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:37:58.933339    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3ce70a_4cfe_479f_9d8e_a223d0ca205d.slice/crio-fc7e3c36e847600c3b5875ce5287a6a2ab4c2ff8d27ad4b088d947c7b35e6bb1 WatchSource:0}: Error finding container fc7e3c36e847600c3b5875ce5287a6a2ab4c2ff8d27ad4b088d947c7b35e6bb1: Status 404 returned error can't find the container with id fc7e3c36e847600c3b5875ce5287a6a2ab4c2ff8d27ad4b088d947c7b35e6bb1
Jul 08 21:37:58.940274 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.940246    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2s2n\" (UniqueName: \"kubernetes.io/projected/31a0d1c8-3cbe-4199-82f1-4f86ef567f6b-kube-api-access-p2s2n\") pod \"model-serving-api-54d89bd5fc-zw4jm\" (UID: \"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:58.969133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.969103    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"]
Jul 08 21:37:58.973747 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.973725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:58.976608 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.976588    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 21:37:58.976608 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.976600    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 21:37:58.976795 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.976669    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 21:37:58.976890 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.976842    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 21:37:58.976890 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.976856    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hknbd\""
Jul 08 21:37:58.984215 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:58.984195    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"]
Jul 08 21:37:59.030081 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.030052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-cacerts\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.030262 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.030098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-istio-token\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.030262 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.030139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.030262 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.030162    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8xrv\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-kube-api-access-h8xrv\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.030262 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.030189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.030262 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.030218    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.030262 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.030246    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7f2426-e319-4c05-962d-b3442081f58f-local-certs\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.053015 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.052986    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:37:59.131651 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.131621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-cacerts\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.131827 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.131679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-istio-token\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.131827 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.131726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.131827 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.131760    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8xrv\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-kube-api-access-h8xrv\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.131827 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.131803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.132040 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.131846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.132040 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.131878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7f2426-e319-4c05-962d-b3442081f58f-local-certs\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.132556 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.132529    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.133966 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.133939    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7f2426-e319-4c05-962d-b3442081f58f-local-certs\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.134345 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.134320    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-cacerts\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.134506 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.134487    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.134551 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.134487    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.142576 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.142535    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-istio-token\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.143404 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.143376    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8xrv\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-kube-api-access-h8xrv\") pod \"istiod-openshift-gateway-7574459656-m94zp\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.165179 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.164598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn" event={"ID":"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d","Type":"ContainerStarted","Data":"fc7e3c36e847600c3b5875ce5287a6a2ab4c2ff8d27ad4b088d947c7b35e6bb1"}
Jul 08 21:37:59.193367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.193338    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zw4jm"]
Jul 08 21:37:59.195739 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:37:59.195707    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a0d1c8_3cbe_4199_82f1_4f86ef567f6b.slice/crio-6b2efb6d623ca0d3baec47ce795998f2729799bb11a8780a58a6cd3854545a97 WatchSource:0}: Error finding container 6b2efb6d623ca0d3baec47ce795998f2729799bb11a8780a58a6cd3854545a97: Status 404 returned error can't find the container with id 6b2efb6d623ca0d3baec47ce795998f2729799bb11a8780a58a6cd3854545a97
Jul 08 21:37:59.285155 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.285125    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:37:59.432530 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:37:59.432506    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"]
Jul 08 21:37:59.434221 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:37:59.434193    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7f2426_e319_4c05_962d_b3442081f58f.slice/crio-b63f30fe75d4b7a9c80087721af235ddf4de3b5c52b6e2be9b1e5dbde2d724d0 WatchSource:0}: Error finding container b63f30fe75d4b7a9c80087721af235ddf4de3b5c52b6e2be9b1e5dbde2d724d0: Status 404 returned error can't find the container with id b63f30fe75d4b7a9c80087721af235ddf4de3b5c52b6e2be9b1e5dbde2d724d0
Jul 08 21:38:00.176756 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:00.176719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp" event={"ID":"fe7f2426-e319-4c05-962d-b3442081f58f","Type":"ContainerStarted","Data":"b63f30fe75d4b7a9c80087721af235ddf4de3b5c52b6e2be9b1e5dbde2d724d0"}
Jul 08 21:38:00.178599 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:00.178514    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm" event={"ID":"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b","Type":"ContainerStarted","Data":"6b2efb6d623ca0d3baec47ce795998f2729799bb11a8780a58a6cd3854545a97"}
Jul 08 21:38:03.883268 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:03.883208    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:38:03.883607 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:03.883313    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:38:04.202982 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.202885    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp" event={"ID":"fe7f2426-e319-4c05-962d-b3442081f58f","Type":"ContainerStarted","Data":"a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e"}
Jul 08 21:38:04.203222 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.203202    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:38:04.205231 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.205201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn" event={"ID":"6f3ce70a-4cfe-479f-9d8e-a223d0ca205d","Type":"ContainerStarted","Data":"c0440f44c6abf8b0c67aaf8cb4aad02d031b5edb4204ad1574d79d958269861c"}
Jul 08 21:38:04.205455 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.205438    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:38:04.205623 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.205604    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-m94zp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 21:38:04.205751 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.205734    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp" podUID="fe7f2426-e319-4c05-962d-b3442081f58f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:38:04.207142 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.207109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm" event={"ID":"31a0d1c8-3cbe-4199-82f1-4f86ef567f6b","Type":"ContainerStarted","Data":"9098735614ea58a17ade83217fc509e23dd2efeeb5b1c6b874e93d4e4746d30a"}
Jul 08 21:38:04.207258 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.207205    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:38:04.209027 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.209002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l" event={"ID":"c43f8392-402b-44ad-8604-f99b8759ff27","Type":"ContainerStarted","Data":"73c6c3ee800b3385911f24f8f27c0b7bae6b438f3889fc2fa154deb983bc313e"}
Jul 08 21:38:04.233982 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.233916    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp" podStartSLOduration=1.7873329770000002 podStartE2EDuration="6.233894669s" totalImagesPullingTime="4.446561692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:38:04.230364851 +0000 UTC m=+330.120145902" watchObservedRunningTime="2026-07-08 21:38:04.233894669 +0000 UTC m=+330.123675695"
Jul 08 21:38:04.256230 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.256172    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-589c8d496f-kxp2l" podStartSLOduration=1.508843117 podStartE2EDuration="7.256156252s" totalImagesPullingTime="5.747313135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:38:04.253902734 +0000 UTC m=+330.143683781" watchObservedRunningTime="2026-07-08 21:38:04.256156252 +0000 UTC m=+330.145937293"
Jul 08 21:38:04.280156 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.280092    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn" podStartSLOduration=2.331282496 podStartE2EDuration="7.280071181s" totalImagesPullingTime="4.948788685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:38:04.276561745 +0000 UTC m=+330.166342772" watchObservedRunningTime="2026-07-08 21:38:04.280071181 +0000 UTC m=+330.169852207"
Jul 08 21:38:04.296792 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:04.296743    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm" podStartSLOduration=1.628573423 podStartE2EDuration="6.296727924s" totalImagesPullingTime="4.668154501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:38:04.295218355 +0000 UTC m=+330.184999387" watchObservedRunningTime="2026-07-08 21:38:04.296727924 +0000 UTC m=+330.186508948"
Jul 08 21:38:05.214963 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:05.214937    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:38:08.004816 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.000557    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"]
Jul 08 21:38:08.006304 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.006272    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"]
Jul 08 21:38:08.006492 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.006396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.009201 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.009184    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t22qz\""
Jul 08 21:38:08.009362 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.009194    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 21:38:08.117253 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.117218    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f44fcc-3775-4ee7-a975-6e1f2767326f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jgbxh\" (UID: \"b3f44fcc-3775-4ee7-a975-6e1f2767326f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.117253 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.117254    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pr7g\" (UniqueName: \"kubernetes.io/projected/b3f44fcc-3775-4ee7-a975-6e1f2767326f-kube-api-access-6pr7g\") pod \"llmisvc-controller-manager-777c6bd7d5-jgbxh\" (UID: \"b3f44fcc-3775-4ee7-a975-6e1f2767326f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.217760 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.217725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f44fcc-3775-4ee7-a975-6e1f2767326f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jgbxh\" (UID: \"b3f44fcc-3775-4ee7-a975-6e1f2767326f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.217760 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.217761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pr7g\" (UniqueName: \"kubernetes.io/projected/b3f44fcc-3775-4ee7-a975-6e1f2767326f-kube-api-access-6pr7g\") pod \"llmisvc-controller-manager-777c6bd7d5-jgbxh\" (UID: \"b3f44fcc-3775-4ee7-a975-6e1f2767326f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.217953 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:38:08.217878    2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 21:38:08.217953 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:38:08.217948    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f44fcc-3775-4ee7-a975-6e1f2767326f-cert podName:b3f44fcc-3775-4ee7-a975-6e1f2767326f nodeName:}" failed. No retries permitted until 2026-07-08 21:38:08.717928034 +0000 UTC m=+334.607709041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b3f44fcc-3775-4ee7-a975-6e1f2767326f-cert") pod "llmisvc-controller-manager-777c6bd7d5-jgbxh" (UID: "b3f44fcc-3775-4ee7-a975-6e1f2767326f") : secret "llmisvc-webhook-server-cert" not found
Jul 08 21:38:08.228963 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.228925    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pr7g\" (UniqueName: \"kubernetes.io/projected/b3f44fcc-3775-4ee7-a975-6e1f2767326f-kube-api-access-6pr7g\") pod \"llmisvc-controller-manager-777c6bd7d5-jgbxh\" (UID: \"b3f44fcc-3775-4ee7-a975-6e1f2767326f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.721066 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.721030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f44fcc-3775-4ee7-a975-6e1f2767326f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jgbxh\" (UID: \"b3f44fcc-3775-4ee7-a975-6e1f2767326f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.723484 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.723459    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3f44fcc-3775-4ee7-a975-6e1f2767326f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jgbxh\" (UID: \"b3f44fcc-3775-4ee7-a975-6e1f2767326f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:08.918582 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:08.918531    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:09.047389 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:09.047355    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"]
Jul 08 21:38:09.050703 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:38:09.050675    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb3f44fcc_3775_4ee7_a975_6e1f2767326f.slice/crio-2e62d99c30c58d1b6ddc238f178210f172d9b7e5c0458e2c2c528885048957e0 WatchSource:0}: Error finding container 2e62d99c30c58d1b6ddc238f178210f172d9b7e5c0458e2c2c528885048957e0: Status 404 returned error can't find the container with id 2e62d99c30c58d1b6ddc238f178210f172d9b7e5c0458e2c2c528885048957e0
Jul 08 21:38:09.232739 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:09.232703    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh" event={"ID":"b3f44fcc-3775-4ee7-a975-6e1f2767326f","Type":"ContainerStarted","Data":"2e62d99c30c58d1b6ddc238f178210f172d9b7e5c0458e2c2c528885048957e0"}
Jul 08 21:38:10.948584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:10.948548    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"]
Jul 08 21:38:10.949028 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:10.948781    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp" podUID="fe7f2426-e319-4c05-962d-b3442081f58f" containerName="discovery" containerID="cri-o://a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e" gracePeriod=30
Jul 08 21:38:11.217194 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.217170    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:38:11.243776 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.243739    2568 generic.go:356] "Generic (PLEG): container finished" podID="fe7f2426-e319-4c05-962d-b3442081f58f" containerID="a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e" exitCode=0
Jul 08 21:38:11.243945 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.243786    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"
Jul 08 21:38:11.243945 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.243824    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp" event={"ID":"fe7f2426-e319-4c05-962d-b3442081f58f","Type":"ContainerDied","Data":"a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e"}
Jul 08 21:38:11.243945 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.243885    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m94zp" event={"ID":"fe7f2426-e319-4c05-962d-b3442081f58f","Type":"ContainerDied","Data":"b63f30fe75d4b7a9c80087721af235ddf4de3b5c52b6e2be9b1e5dbde2d724d0"}
Jul 08 21:38:11.243945 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.243915    2568 scope.go:117] "RemoveContainer" containerID="a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e"
Jul 08 21:38:11.252464 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.252447    2568 scope.go:117] "RemoveContainer" containerID="a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e"
Jul 08 21:38:11.252748 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:38:11.252729    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e\": container with ID starting with a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e not found: ID does not exist" containerID="a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e"
Jul 08 21:38:11.252801 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.252756    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e"} err="failed to get container status \"a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e\": rpc error: code = NotFound desc = could not find container \"a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e\": container with ID starting with a89abf1d0ae08d694a11fbedb9d3574f81e9b71c8ceddb8d992e374579faef0e not found: ID does not exist"
Jul 08 21:38:11.345382 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.345349    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-dns-cert\") pod \"fe7f2426-e319-4c05-962d-b3442081f58f\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") "
Jul 08 21:38:11.345382 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.345389    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-cacerts\") pod \"fe7f2426-e319-4c05-962d-b3442081f58f\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") "
Jul 08 21:38:11.345618 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.345449    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8xrv\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-kube-api-access-h8xrv\") pod \"fe7f2426-e319-4c05-962d-b3442081f58f\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") "
Jul 08 21:38:11.345618 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.345472    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7f2426-e319-4c05-962d-b3442081f58f-local-certs\") pod \"fe7f2426-e319-4c05-962d-b3442081f58f\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") "
Jul 08 21:38:11.345618 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.345577    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-istio-token\") pod \"fe7f2426-e319-4c05-962d-b3442081f58f\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") "
Jul 08 21:38:11.345778 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.345663    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-kubeconfig\") pod \"fe7f2426-e319-4c05-962d-b3442081f58f\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") "
Jul 08 21:38:11.345778 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.345692    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-ca-configmap\") pod \"fe7f2426-e319-4c05-962d-b3442081f58f\" (UID: \"fe7f2426-e319-4c05-962d-b3442081f58f\") "
Jul 08 21:38:11.346326 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.346287    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "fe7f2426-e319-4c05-962d-b3442081f58f" (UID: "fe7f2426-e319-4c05-962d-b3442081f58f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:38:11.347943 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.347915    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7f2426-e319-4c05-962d-b3442081f58f-local-certs" (OuterVolumeSpecName: "local-certs") pod "fe7f2426-e319-4c05-962d-b3442081f58f" (UID: "fe7f2426-e319-4c05-962d-b3442081f58f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:11.348068 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.347966    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "fe7f2426-e319-4c05-962d-b3442081f58f" (UID: "fe7f2426-e319-4c05-962d-b3442081f58f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:38:11.348141 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.348121    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-kube-api-access-h8xrv" (OuterVolumeSpecName: "kube-api-access-h8xrv") pod "fe7f2426-e319-4c05-962d-b3442081f58f" (UID: "fe7f2426-e319-4c05-962d-b3442081f58f"). InnerVolumeSpecName "kube-api-access-h8xrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:38:11.348200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.348164    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe7f2426-e319-4c05-962d-b3442081f58f" (UID: "fe7f2426-e319-4c05-962d-b3442081f58f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:38:11.348254 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.348194    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-cacerts" (OuterVolumeSpecName: "cacerts") pod "fe7f2426-e319-4c05-962d-b3442081f58f" (UID: "fe7f2426-e319-4c05-962d-b3442081f58f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:38:11.348254 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.348237    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "fe7f2426-e319-4c05-962d-b3442081f58f" (UID: "fe7f2426-e319-4c05-962d-b3442081f58f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:38:11.446634 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.446591    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-dns-cert\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:38:11.446634 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.446625    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-cacerts\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:38:11.446634 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.446635    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8xrv\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-kube-api-access-h8xrv\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:38:11.446634 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.446644    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7f2426-e319-4c05-962d-b3442081f58f-local-certs\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:38:11.446904 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.446652    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7f2426-e319-4c05-962d-b3442081f58f-istio-token\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:38:11.446904 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.446659    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe7f2426-e319-4c05-962d-b3442081f58f-istio-kubeconfig\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:38:11.446904 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.446667    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fe7f2426-e319-4c05-962d-b3442081f58f-istio-csr-ca-configmap\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:38:11.572385 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.572355    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"]
Jul 08 21:38:11.574382 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:11.574356    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m94zp"]
Jul 08 21:38:12.631809 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:12.631770    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7f2426-e319-4c05-962d-b3442081f58f" path="/var/lib/kubelet/pods/fe7f2426-e319-4c05-962d-b3442081f58f/volumes"
Jul 08 21:38:13.260070 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:13.260038    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh" event={"ID":"b3f44fcc-3775-4ee7-a975-6e1f2767326f","Type":"ContainerStarted","Data":"f94dba8cc89b8c1710f68d771fba4381f3d9ae232d3d1e7897449170545ca151"}
Jul 08 21:38:13.260260 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:13.260128    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:13.279157 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:13.279111    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh" podStartSLOduration=2.561521719 podStartE2EDuration="6.279096806s" totalImagesPullingTime="3.717575087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:38:13.277149075 +0000 UTC m=+339.166930112" watchObservedRunningTime="2026-07-08 21:38:13.279096806 +0000 UTC m=+339.168877831"
Jul 08 21:38:15.218872 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:15.218841    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zw4jm"
Jul 08 21:38:15.222911 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:15.222887    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nmtdn"
Jul 08 21:38:44.267581 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:44.267545    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jgbxh"
Jul 08 21:38:58.729562 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.729525    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvttk"]
Jul 08 21:38:58.729964 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.729861    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7f2426-e319-4c05-962d-b3442081f58f" containerName="discovery"
Jul 08 21:38:58.729964 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.729871    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7f2426-e319-4c05-962d-b3442081f58f" containerName="discovery"
Jul 08 21:38:58.729964 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.729934    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe7f2426-e319-4c05-962d-b3442081f58f" containerName="discovery"
Jul 08 21:38:58.733210 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.733186    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dvttk"
Jul 08 21:38:58.737072 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.737042    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w42zp\""
Jul 08 21:38:58.738069 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.738047    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 21:38:58.738199 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.738049    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 21:38:58.745601 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.745578    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvttk"]
Jul 08 21:38:58.840328 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.840289    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwft2\" (UniqueName: \"kubernetes.io/projected/15ba349d-8153-4340-b46a-58ae1f8d1e4f-kube-api-access-mwft2\") pod \"kuadrant-operator-catalog-dvttk\" (UID: \"15ba349d-8153-4340-b46a-58ae1f8d1e4f\") " pod="kuadrant-system/kuadrant-operator-catalog-dvttk"
Jul 08 21:38:58.941136 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.941098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwft2\" (UniqueName: \"kubernetes.io/projected/15ba349d-8153-4340-b46a-58ae1f8d1e4f-kube-api-access-mwft2\") pod \"kuadrant-operator-catalog-dvttk\" (UID: \"15ba349d-8153-4340-b46a-58ae1f8d1e4f\") " pod="kuadrant-system/kuadrant-operator-catalog-dvttk"
Jul 08 21:38:58.957353 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:58.957323    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwft2\" (UniqueName: \"kubernetes.io/projected/15ba349d-8153-4340-b46a-58ae1f8d1e4f-kube-api-access-mwft2\") pod \"kuadrant-operator-catalog-dvttk\" (UID: \"15ba349d-8153-4340-b46a-58ae1f8d1e4f\") " pod="kuadrant-system/kuadrant-operator-catalog-dvttk"
Jul 08 21:38:59.043105 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.043059    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dvttk"
Jul 08 21:38:59.083768 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.083732    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvttk"]
Jul 08 21:38:59.174990 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.174956    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvttk"]
Jul 08 21:38:59.178806 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:38:59.178777    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ba349d_8153_4340_b46a_58ae1f8d1e4f.slice/crio-dfd9bfc2059f02780359afc055b99c4103185c07e2d6f266fd1036ed679f0a4f WatchSource:0}: Error finding container dfd9bfc2059f02780359afc055b99c4103185c07e2d6f266fd1036ed679f0a4f: Status 404 returned error can't find the container with id dfd9bfc2059f02780359afc055b99c4103185c07e2d6f266fd1036ed679f0a4f
Jul 08 21:38:59.292895 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.292862    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hlgpn"]
Jul 08 21:38:59.297275 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.297229    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:38:59.305220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.305199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hlgpn"]
Jul 08 21:38:59.344017 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.343988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmfhq\" (UniqueName: \"kubernetes.io/projected/230261f0-1d10-4701-ba8a-fa2cee5d6235-kube-api-access-fmfhq\") pod \"kuadrant-operator-catalog-hlgpn\" (UID: \"230261f0-1d10-4701-ba8a-fa2cee5d6235\") " pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:38:59.445279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.445238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmfhq\" (UniqueName: \"kubernetes.io/projected/230261f0-1d10-4701-ba8a-fa2cee5d6235-kube-api-access-fmfhq\") pod \"kuadrant-operator-catalog-hlgpn\" (UID: \"230261f0-1d10-4701-ba8a-fa2cee5d6235\") " pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:38:59.454654 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.454628    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmfhq\" (UniqueName: \"kubernetes.io/projected/230261f0-1d10-4701-ba8a-fa2cee5d6235-kube-api-access-fmfhq\") pod \"kuadrant-operator-catalog-hlgpn\" (UID: \"230261f0-1d10-4701-ba8a-fa2cee5d6235\") " pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:38:59.465932 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.465903    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dvttk" event={"ID":"15ba349d-8153-4340-b46a-58ae1f8d1e4f","Type":"ContainerStarted","Data":"dfd9bfc2059f02780359afc055b99c4103185c07e2d6f266fd1036ed679f0a4f"}
Jul 08 21:38:59.607588 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.607503    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:38:59.746570 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:38:59.746377    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hlgpn"]
Jul 08 21:38:59.749338 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:38:59.749309    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230261f0_1d10_4701_ba8a_fa2cee5d6235.slice/crio-ed1b5ebb5e7001111e8af15cb0075d65d937de65083a4cd005251c06d52aaed2 WatchSource:0}: Error finding container ed1b5ebb5e7001111e8af15cb0075d65d937de65083a4cd005251c06d52aaed2: Status 404 returned error can't find the container with id ed1b5ebb5e7001111e8af15cb0075d65d937de65083a4cd005251c06d52aaed2
Jul 08 21:39:00.475791 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:00.475753    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn" event={"ID":"230261f0-1d10-4701-ba8a-fa2cee5d6235","Type":"ContainerStarted","Data":"ed1b5ebb5e7001111e8af15cb0075d65d937de65083a4cd005251c06d52aaed2"}
Jul 08 21:39:01.482223 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.482185    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn" event={"ID":"230261f0-1d10-4701-ba8a-fa2cee5d6235","Type":"ContainerStarted","Data":"1f9f676a2084488b4f3df1ec04eb7eaec7dcd94c60aff07abd83c746b669e4aa"}
Jul 08 21:39:01.483763 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.483709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dvttk" event={"ID":"15ba349d-8153-4340-b46a-58ae1f8d1e4f","Type":"ContainerStarted","Data":"b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94"}
Jul 08 21:39:01.483763 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.483732    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dvttk" podUID="15ba349d-8153-4340-b46a-58ae1f8d1e4f" containerName="registry-server" containerID="cri-o://b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94" gracePeriod=2
Jul 08 21:39:01.497491 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.497403    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn" podStartSLOduration=0.906883615 podStartE2EDuration="2.497380993s" totalImagesPullingTime="1.590497378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:01.497039884 +0000 UTC m=+387.386820946" watchObservedRunningTime="2026-07-08 21:39:01.497380993 +0000 UTC m=+387.387162020"
Jul 08 21:39:01.511627 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.511576    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dvttk" podStartSLOduration=1.351686313 podStartE2EDuration="3.511558391s" totalImagesPullingTime="2.159872078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:01.511177701 +0000 UTC m=+387.400958718" watchObservedRunningTime="2026-07-08 21:39:01.511558391 +0000 UTC m=+387.401339416"
Jul 08 21:39:01.729649 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.729625    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dvttk_15ba349d-8153-4340-b46a-58ae1f8d1e4f/registry-server/0.log"
Jul 08 21:39:01.732105 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.732088    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dvttk"
Jul 08 21:39:01.764192 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.764164    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwft2\" (UniqueName: \"kubernetes.io/projected/15ba349d-8153-4340-b46a-58ae1f8d1e4f-kube-api-access-mwft2\") pod \"15ba349d-8153-4340-b46a-58ae1f8d1e4f\" (UID: \"15ba349d-8153-4340-b46a-58ae1f8d1e4f\") "
Jul 08 21:39:01.766317 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.766286    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ba349d-8153-4340-b46a-58ae1f8d1e4f-kube-api-access-mwft2" (OuterVolumeSpecName: "kube-api-access-mwft2") pod "15ba349d-8153-4340-b46a-58ae1f8d1e4f" (UID: "15ba349d-8153-4340-b46a-58ae1f8d1e4f"). InnerVolumeSpecName "kube-api-access-mwft2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:39:01.864855 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:01.864769    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwft2\" (UniqueName: \"kubernetes.io/projected/15ba349d-8153-4340-b46a-58ae1f8d1e4f-kube-api-access-mwft2\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:39:02.489435 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.489392    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dvttk_15ba349d-8153-4340-b46a-58ae1f8d1e4f/registry-server/0.log"
Jul 08 21:39:02.489909 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.489445    2568 generic.go:356] "Generic (PLEG): container finished" podID="15ba349d-8153-4340-b46a-58ae1f8d1e4f" containerID="b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94" exitCode=1
Jul 08 21:39:02.489909 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.489511    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dvttk"
Jul 08 21:39:02.489909 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.489538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dvttk" event={"ID":"15ba349d-8153-4340-b46a-58ae1f8d1e4f","Type":"ContainerDied","Data":"b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94"}
Jul 08 21:39:02.489909 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.489585    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dvttk" event={"ID":"15ba349d-8153-4340-b46a-58ae1f8d1e4f","Type":"ContainerDied","Data":"dfd9bfc2059f02780359afc055b99c4103185c07e2d6f266fd1036ed679f0a4f"}
Jul 08 21:39:02.489909 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.489611    2568 scope.go:117] "RemoveContainer" containerID="b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94"
Jul 08 21:39:02.498521 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.498502    2568 scope.go:117] "RemoveContainer" containerID="b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94"
Jul 08 21:39:02.498792 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:39:02.498772    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94\": container with ID starting with b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94 not found: ID does not exist" containerID="b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94"
Jul 08 21:39:02.498848 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.498802    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94"} err="failed to get container status \"b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94\": rpc error: code = NotFound desc = could not find container \"b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94\": container with ID starting with b97779ae9e18a3942182c65afcdf0a068d7b4991ce76b4af8964f1295ac28e94 not found: ID does not exist"
Jul 08 21:39:02.509819 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.509796    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvttk"]
Jul 08 21:39:02.513310 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.513289    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dvttk"]
Jul 08 21:39:02.629803 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:02.629727    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ba349d-8153-4340-b46a-58ae1f8d1e4f" path="/var/lib/kubelet/pods/15ba349d-8153-4340-b46a-58ae1f8d1e4f/volumes"
Jul 08 21:39:09.607705 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:09.607667    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:39:09.608223 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:09.607769    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:39:09.630216 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:09.630189    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:39:10.554644 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:10.554619    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hlgpn"
Jul 08 21:39:35.966113 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:35.966075    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"]
Jul 08 21:39:35.966622 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:35.966601    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ba349d-8153-4340-b46a-58ae1f8d1e4f" containerName="registry-server"
Jul 08 21:39:35.966693 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:35.966625    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ba349d-8153-4340-b46a-58ae1f8d1e4f" containerName="registry-server"
Jul 08 21:39:35.966770 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:35.966757    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ba349d-8153-4340-b46a-58ae1f8d1e4f" containerName="registry-server"
Jul 08 21:39:35.974350 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:35.974327    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:39:35.977855 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:35.977835    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"]
Jul 08 21:39:35.978116 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:35.978094    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pk6f5\""
Jul 08 21:39:36.046604 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:36.046566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2flgk\" (UniqueName: \"kubernetes.io/projected/be2bc820-c476-4bc4-9f2a-33365375d11e-kube-api-access-2flgk\") pod \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" (UID: \"be2bc820-c476-4bc4-9f2a-33365375d11e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:39:36.148077 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:36.148038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2flgk\" (UniqueName: \"kubernetes.io/projected/be2bc820-c476-4bc4-9f2a-33365375d11e-kube-api-access-2flgk\") pod \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" (UID: \"be2bc820-c476-4bc4-9f2a-33365375d11e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:39:36.163004 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:36.162979    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2flgk\" (UniqueName: \"kubernetes.io/projected/be2bc820-c476-4bc4-9f2a-33365375d11e-kube-api-access-2flgk\") pod \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" (UID: \"be2bc820-c476-4bc4-9f2a-33365375d11e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:39:36.285707 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:36.285675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:39:36.415367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:36.415345    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"]
Jul 08 21:39:36.417665 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:39:36.417627    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2bc820_c476_4bc4_9f2a_33365375d11e.slice/crio-6d77f46139a6c0e76e16b7d0651e3ab02e0e7edb13549780cfc8fcafdb541768 WatchSource:0}: Error finding container 6d77f46139a6c0e76e16b7d0651e3ab02e0e7edb13549780cfc8fcafdb541768: Status 404 returned error can't find the container with id 6d77f46139a6c0e76e16b7d0651e3ab02e0e7edb13549780cfc8fcafdb541768
Jul 08 21:39:36.646670 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:36.646581    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd" event={"ID":"be2bc820-c476-4bc4-9f2a-33365375d11e","Type":"ContainerStarted","Data":"6d77f46139a6c0e76e16b7d0651e3ab02e0e7edb13549780cfc8fcafdb541768"}
Jul 08 21:39:39.663709 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:39.663676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd" event={"ID":"be2bc820-c476-4bc4-9f2a-33365375d11e","Type":"ContainerStarted","Data":"4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421"}
Jul 08 21:39:39.664173 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:39.663782    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:39:39.681004 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:39.680953    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd" podStartSLOduration=2.3740707260000002 podStartE2EDuration="4.68093699s" totalImagesPullingTime="2.306866264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:39.680536796 +0000 UTC m=+425.570317843" watchObservedRunningTime="2026-07-08 21:39:39.68093699 +0000 UTC m=+425.570718016"
Jul 08 21:39:41.114686 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.114653    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"]
Jul 08 21:39:41.117932 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.117909    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.120768 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.120746    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r8m52\""
Jul 08 21:39:41.133091 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.133071    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"]
Jul 08 21:39:41.190892 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.190853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.191081 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.190916    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h28md\" (UniqueName: \"kubernetes.io/projected/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-kube-api-access-h28md\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.291888 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.291851    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h28md\" (UniqueName: \"kubernetes.io/projected/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-kube-api-access-h28md\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.292083 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.291914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.292264 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.292246    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.301808 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.301776    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h28md\" (UniqueName: \"kubernetes.io/projected/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-kube-api-access-h28md\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.428118 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.428028    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:41.569048 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.568995    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"]
Jul 08 21:39:41.573270 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:39:41.573242    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c89f4fc_ceb5_4ec9_91d8_7b701d0201f7.slice/crio-9d4bbfd3505f44e971d2b1c1cf087a0db5fcddbd206aea5eeb234fb2ce9c269d WatchSource:0}: Error finding container 9d4bbfd3505f44e971d2b1c1cf087a0db5fcddbd206aea5eeb234fb2ce9c269d: Status 404 returned error can't find the container with id 9d4bbfd3505f44e971d2b1c1cf087a0db5fcddbd206aea5eeb234fb2ce9c269d
Jul 08 21:39:41.673289 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:41.673254    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt" event={"ID":"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7","Type":"ContainerStarted","Data":"9d4bbfd3505f44e971d2b1c1cf087a0db5fcddbd206aea5eeb234fb2ce9c269d"}
Jul 08 21:39:44.718445 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:44.718399    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"]
Jul 08 21:39:44.722094 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:44.722071    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"
Jul 08 21:39:44.725027 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:44.724854    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-n6vjq\""
Jul 08 21:39:44.731439 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:44.730924    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"]
Jul 08 21:39:44.825566 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:44.825527    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bz7m\" (UniqueName: \"kubernetes.io/projected/965eb9e4-6d89-49ee-9a49-cff05e830049-kube-api-access-5bz7m\") pod \"authorino-operator-75cc8d5cb7-cdkxw\" (UID: \"965eb9e4-6d89-49ee-9a49-cff05e830049\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"
Jul 08 21:39:44.926561 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:44.926518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bz7m\" (UniqueName: \"kubernetes.io/projected/965eb9e4-6d89-49ee-9a49-cff05e830049-kube-api-access-5bz7m\") pod \"authorino-operator-75cc8d5cb7-cdkxw\" (UID: \"965eb9e4-6d89-49ee-9a49-cff05e830049\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"
Jul 08 21:39:44.939627 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:44.939598    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bz7m\" (UniqueName: \"kubernetes.io/projected/965eb9e4-6d89-49ee-9a49-cff05e830049-kube-api-access-5bz7m\") pod \"authorino-operator-75cc8d5cb7-cdkxw\" (UID: \"965eb9e4-6d89-49ee-9a49-cff05e830049\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"
Jul 08 21:39:45.035839 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:45.035804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"
Jul 08 21:39:45.174153 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:45.174125    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"]
Jul 08 21:39:45.176214 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:39:45.176185    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965eb9e4_6d89_49ee_9a49_cff05e830049.slice/crio-1a6adc4020a68b8a9103999566718c1b9ee278d064e9aae245db4ae2dbc911d3 WatchSource:0}: Error finding container 1a6adc4020a68b8a9103999566718c1b9ee278d064e9aae245db4ae2dbc911d3: Status 404 returned error can't find the container with id 1a6adc4020a68b8a9103999566718c1b9ee278d064e9aae245db4ae2dbc911d3
Jul 08 21:39:45.694455 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:45.694405    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw" event={"ID":"965eb9e4-6d89-49ee-9a49-cff05e830049","Type":"ContainerStarted","Data":"1a6adc4020a68b8a9103999566718c1b9ee278d064e9aae245db4ae2dbc911d3"}
Jul 08 21:39:49.716194 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:49.716161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt" event={"ID":"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7","Type":"ContainerStarted","Data":"9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1"}
Jul 08 21:39:49.716635 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:49.716288    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:39:49.717782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:49.717759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw" event={"ID":"965eb9e4-6d89-49ee-9a49-cff05e830049","Type":"ContainerStarted","Data":"03b1afb16c12072737c496607924c874368dbe024a722c3aae3836a1c655cb35"}
Jul 08 21:39:49.717896 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:49.717805    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"
Jul 08 21:39:49.744292 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:49.744248    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt" podStartSLOduration=1.630398274 podStartE2EDuration="8.744233901s" totalImagesPullingTime="7.113835627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:49.743043102 +0000 UTC m=+435.632824139" watchObservedRunningTime="2026-07-08 21:39:49.744233901 +0000 UTC m=+435.634014925"
Jul 08 21:39:49.764997 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:49.764958    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw" podStartSLOduration=2.263241714 podStartE2EDuration="5.764944317s" totalImagesPullingTime="3.501702603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:39:49.764300669 +0000 UTC m=+435.654081696" watchObservedRunningTime="2026-07-08 21:39:49.764944317 +0000 UTC m=+435.654725341"
Jul 08 21:39:50.669882 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:39:50.669853    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:00.725280 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:00.725065    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:00.725676 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:00.725356    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdkxw"
Jul 08 21:40:02.673556 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.673520    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"]
Jul 08 21:40:02.673977 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.673698    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" containerName="manager" containerID="cri-o://9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1" gracePeriod=2
Jul 08 21:40:02.690057 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.690024    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"]
Jul 08 21:40:02.711087 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.711055    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"]
Jul 08 21:40:02.711364 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.711334    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" containerName="manager" containerID="cri-o://4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421" gracePeriod=2
Jul 08 21:40:02.714002 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.713964    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:02.721390 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.721361    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"]
Jul 08 21:40:02.724710 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.724683    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"]
Jul 08 21:40:02.725120 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.725080    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" containerName="manager"
Jul 08 21:40:02.725120 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.725103    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" containerName="manager"
Jul 08 21:40:02.725254 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.725143    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" containerName="manager"
Jul 08 21:40:02.725254 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.725152    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" containerName="manager"
Jul 08 21:40:02.725254 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.725247    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" containerName="manager"
Jul 08 21:40:02.725401 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.725261    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" containerName="manager"
Jul 08 21:40:02.728270 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.728251    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:02.731596 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.731569    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:02.734105 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.734072    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:02.744253 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.744204    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"]
Jul 08 21:40:02.748215 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.748194    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"]
Jul 08 21:40:02.748309 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.748288    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"
Jul 08 21:40:02.761596 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.761562    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"]
Jul 08 21:40:02.767048 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.767013    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:02.767208 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.767068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bltzn\" (UniqueName: \"kubernetes.io/projected/8f67fa5e-75d3-4099-a7a9-e6a624a6a192-kube-api-access-bltzn\") pod \"limitador-operator-controller-manager-859d7b78bd-dwtls\" (UID: \"8f67fa5e-75d3-4099-a7a9-e6a624a6a192\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"
Jul 08 21:40:02.812059 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.812020    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:02.868527 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.868486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drwdm\" (UniqueName: \"kubernetes.io/projected/f2320581-4483-46f0-a8f5-d91f773333e2-kube-api-access-drwdm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ts76\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:02.868735 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.868563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bltzn\" (UniqueName: \"kubernetes.io/projected/8f67fa5e-75d3-4099-a7a9-e6a624a6a192-kube-api-access-bltzn\") pod \"limitador-operator-controller-manager-859d7b78bd-dwtls\" (UID: \"8f67fa5e-75d3-4099-a7a9-e6a624a6a192\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"
Jul 08 21:40:02.868735 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.868607    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2320581-4483-46f0-a8f5-d91f773333e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ts76\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:02.878006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.877968    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bltzn\" (UniqueName: \"kubernetes.io/projected/8f67fa5e-75d3-4099-a7a9-e6a624a6a192-kube-api-access-bltzn\") pod \"limitador-operator-controller-manager-859d7b78bd-dwtls\" (UID: \"8f67fa5e-75d3-4099-a7a9-e6a624a6a192\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"
Jul 08 21:40:02.958945 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.958920    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:02.961622 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.961603    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:02.962004 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.961980    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:02.964618 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.964590    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:02.968031 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.968008    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:02.969290 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.969268    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h28md\" (UniqueName: \"kubernetes.io/projected/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-kube-api-access-h28md\") pod \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") "
Jul 08 21:40:02.969351 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.969338    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-extensions-socket-volume\") pod \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\" (UID: \"4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7\") "
Jul 08 21:40:02.969440 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.969400    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2flgk\" (UniqueName: \"kubernetes.io/projected/be2bc820-c476-4bc4-9f2a-33365375d11e-kube-api-access-2flgk\") pod \"be2bc820-c476-4bc4-9f2a-33365375d11e\" (UID: \"be2bc820-c476-4bc4-9f2a-33365375d11e\") "
Jul 08 21:40:02.969546 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.969525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2320581-4483-46f0-a8f5-d91f773333e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ts76\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:02.969637 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.969623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drwdm\" (UniqueName: \"kubernetes.io/projected/f2320581-4483-46f0-a8f5-d91f773333e2-kube-api-access-drwdm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ts76\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:02.969894 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.969869    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" (UID: "4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:40:02.969999 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.969928    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2320581-4483-46f0-a8f5-d91f773333e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ts76\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:02.970734 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:02.970705    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:02.971517 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.971487    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-kube-api-access-h28md" (OuterVolumeSpecName: "kube-api-access-h28md") pod "4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" (UID: "4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7"). InnerVolumeSpecName "kube-api-access-h28md". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:40:02.971599 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.971534    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2bc820-c476-4bc4-9f2a-33365375d11e-kube-api-access-2flgk" (OuterVolumeSpecName: "kube-api-access-2flgk") pod "be2bc820-c476-4bc4-9f2a-33365375d11e" (UID: "be2bc820-c476-4bc4-9f2a-33365375d11e"). InnerVolumeSpecName "kube-api-access-2flgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:40:02.979017 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:02.978997    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drwdm\" (UniqueName: \"kubernetes.io/projected/f2320581-4483-46f0-a8f5-d91f773333e2-kube-api-access-drwdm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ts76\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:03.070305 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.070268    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h28md\" (UniqueName: \"kubernetes.io/projected/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-kube-api-access-h28md\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:40:03.070305 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.070298    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7-extensions-socket-volume\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:40:03.070305 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.070308    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2flgk\" (UniqueName: \"kubernetes.io/projected/be2bc820-c476-4bc4-9f2a-33365375d11e-kube-api-access-2flgk\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:40:03.089016 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.088986    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:03.095231 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.095203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"
Jul 08 21:40:03.242334 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.242306    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"]
Jul 08 21:40:03.244426 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:40:03.244381    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2320581_4483_46f0_a8f5_d91f773333e2.slice/crio-c172e9d280f468c61e7af46235dea2630e1dd07dabe6aebead49fef6e0ba96b3 WatchSource:0}: Error finding container c172e9d280f468c61e7af46235dea2630e1dd07dabe6aebead49fef6e0ba96b3: Status 404 returned error can't find the container with id c172e9d280f468c61e7af46235dea2630e1dd07dabe6aebead49fef6e0ba96b3
Jul 08 21:40:03.265153 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.265091    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"]
Jul 08 21:40:03.266961 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:40:03.266938    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f67fa5e_75d3_4099_a7a9_e6a624a6a192.slice/crio-89c5c7b4c8b06add485d604e66e0d84a24dca264934cf2b3bb9b8ae29bfb9d11 WatchSource:0}: Error finding container 89c5c7b4c8b06add485d604e66e0d84a24dca264934cf2b3bb9b8ae29bfb9d11: Status 404 returned error can't find the container with id 89c5c7b4c8b06add485d604e66e0d84a24dca264934cf2b3bb9b8ae29bfb9d11
Jul 08 21:40:03.783752 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.783716    2568 generic.go:356] "Generic (PLEG): container finished" podID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" containerID="9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1" exitCode=0
Jul 08 21:40:03.784200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.783767    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:03.784200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.783824    2568 scope.go:117] "RemoveContainer" containerID="9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1"
Jul 08 21:40:03.785433 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.785384    2568 generic.go:356] "Generic (PLEG): container finished" podID="be2bc820-c476-4bc4-9f2a-33365375d11e" containerID="4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421" exitCode=0
Jul 08 21:40:03.785549 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.785453    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:03.786645 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.786621    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:03.787366 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.787338    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls" event={"ID":"8f67fa5e-75d3-4099-a7a9-e6a624a6a192","Type":"ContainerStarted","Data":"7509e1327d99e289305e6466eabb6ce33d97092870262f4e5694f8f97501f826"}
Jul 08 21:40:03.787497 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.787390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls" event={"ID":"8f67fa5e-75d3-4099-a7a9-e6a624a6a192","Type":"ContainerStarted","Data":"89c5c7b4c8b06add485d604e66e0d84a24dca264934cf2b3bb9b8ae29bfb9d11"}
Jul 08 21:40:03.787497 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.787439    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"
Jul 08 21:40:03.789197 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.789177    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76" event={"ID":"f2320581-4483-46f0-a8f5-d91f773333e2","Type":"ContainerStarted","Data":"406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2"}
Jul 08 21:40:03.789360 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.789333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76" event={"ID":"f2320581-4483-46f0-a8f5-d91f773333e2","Type":"ContainerStarted","Data":"c172e9d280f468c61e7af46235dea2630e1dd07dabe6aebead49fef6e0ba96b3"}
Jul 08 21:40:03.789497 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.789468    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:03.793237 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.793215    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:03.794837 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.794818    2568 scope.go:117] "RemoveContainer" containerID="9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1"
Jul 08 21:40:03.795097 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.795078    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1\": container with ID starting with 9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1 not found: ID does not exist" containerID="9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1"
Jul 08 21:40:03.795170 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.795103    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1"} err="failed to get container status \"9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1\": rpc error: code = NotFound desc = could not find container \"9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1\": container with ID starting with 9082ac776370f8b813730976ba85182fe9ce2eacd4c86efa99e7634026655df1 not found: ID does not exist"
Jul 08 21:40:03.795170 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.795119    2568 scope.go:117] "RemoveContainer" containerID="4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421"
Jul 08 21:40:03.802055 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.802030    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:03.803863 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.803846    2568 scope.go:117] "RemoveContainer" containerID="4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421"
Jul 08 21:40:03.804183 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.804165    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421\": container with ID starting with 4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421 not found: ID does not exist" containerID="4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421"
Jul 08 21:40:03.804236 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.804190    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421"} err="failed to get container status \"4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421\": rpc error: code = NotFound desc = could not find container \"4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421\": container with ID starting with 4bdf39bf48f647edb438025323b8d680c58492bdc121a98ed606f67fe21b1421 not found: ID does not exist"
Jul 08 21:40:03.832308 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.832246    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls" podStartSLOduration=1.83222322 podStartE2EDuration="1.83222322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:03.831171329 +0000 UTC m=+449.720952390" watchObservedRunningTime="2026-07-08 21:40:03.83222322 +0000 UTC m=+449.722004241"
Jul 08 21:40:03.834492 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.834453    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:03.862077 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:03.862021    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76" podStartSLOduration=1.862004883 podStartE2EDuration="1.862004883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:03.861129963 +0000 UTC m=+449.750910989" watchObservedRunningTime="2026-07-08 21:40:03.862004883 +0000 UTC m=+449.751785907"
Jul 08 21:40:03.865392 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.865361    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:03.867689 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:03.867653    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:04.627963 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:04.627926    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nl5bt\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nl5bt"
Jul 08 21:40:04.629567 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:04.629541    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7" path="/var/lib/kubelet/pods/4c89f4fc-ceb5-4ec9-91d8-7b701d0201f7/volumes"
Jul 08 21:40:04.629933 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:04.629916    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" path="/var/lib/kubelet/pods/be2bc820-c476-4bc4-9f2a-33365375d11e/volumes"
Jul 08 21:40:04.630022 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:04.630005    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvcsd\" is forbidden: User \"system:node:ip-10-0-131-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-2.ec2.internal' and this object" podUID="be2bc820-c476-4bc4-9f2a-33365375d11e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvcsd"
Jul 08 21:40:14.798023 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:14.797991    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:14.798510 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:14.798060    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwtls"
Jul 08 21:40:32.270472 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.270436    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"]
Jul 08 21:40:32.270897 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.270631    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76" podUID="f2320581-4483-46f0-a8f5-d91f773333e2" containerName="manager" containerID="cri-o://406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2" gracePeriod=10
Jul 08 21:40:32.518713 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.518690    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:32.616648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.616572    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drwdm\" (UniqueName: \"kubernetes.io/projected/f2320581-4483-46f0-a8f5-d91f773333e2-kube-api-access-drwdm\") pod \"f2320581-4483-46f0-a8f5-d91f773333e2\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") "
Jul 08 21:40:32.616648 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.616624    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2320581-4483-46f0-a8f5-d91f773333e2-extensions-socket-volume\") pod \"f2320581-4483-46f0-a8f5-d91f773333e2\" (UID: \"f2320581-4483-46f0-a8f5-d91f773333e2\") "
Jul 08 21:40:32.616970 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.616945    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2320581-4483-46f0-a8f5-d91f773333e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2320581-4483-46f0-a8f5-d91f773333e2" (UID: "f2320581-4483-46f0-a8f5-d91f773333e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:40:32.618700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.618674    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2320581-4483-46f0-a8f5-d91f773333e2-kube-api-access-drwdm" (OuterVolumeSpecName: "kube-api-access-drwdm") pod "f2320581-4483-46f0-a8f5-d91f773333e2" (UID: "f2320581-4483-46f0-a8f5-d91f773333e2"). InnerVolumeSpecName "kube-api-access-drwdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:40:32.717807 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.717775    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drwdm\" (UniqueName: \"kubernetes.io/projected/f2320581-4483-46f0-a8f5-d91f773333e2-kube-api-access-drwdm\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:40:32.717807 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.717800    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2320581-4483-46f0-a8f5-d91f773333e2-extensions-socket-volume\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:40:32.929993 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.929901    2568 generic.go:356] "Generic (PLEG): container finished" podID="f2320581-4483-46f0-a8f5-d91f773333e2" containerID="406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2" exitCode=0
Jul 08 21:40:32.929993 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.929945    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"
Jul 08 21:40:32.930169 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.929991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76" event={"ID":"f2320581-4483-46f0-a8f5-d91f773333e2","Type":"ContainerDied","Data":"406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2"}
Jul 08 21:40:32.930169 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.930036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76" event={"ID":"f2320581-4483-46f0-a8f5-d91f773333e2","Type":"ContainerDied","Data":"c172e9d280f468c61e7af46235dea2630e1dd07dabe6aebead49fef6e0ba96b3"}
Jul 08 21:40:32.930169 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.930057    2568 scope.go:117] "RemoveContainer" containerID="406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2"
Jul 08 21:40:32.938899 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.938880    2568 scope.go:117] "RemoveContainer" containerID="406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2"
Jul 08 21:40:32.939163 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:40:32.939146    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2\": container with ID starting with 406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2 not found: ID does not exist" containerID="406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2"
Jul 08 21:40:32.939220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.939172    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2"} err="failed to get container status \"406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2\": rpc error: code = NotFound desc = could not find container \"406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2\": container with ID starting with 406372048dd2ae2c64b670596ac67552570825a23622e58e53b58c448bd177f2 not found: ID does not exist"
Jul 08 21:40:32.960006 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.959983    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"]
Jul 08 21:40:32.965211 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:32.965191    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ts76"]
Jul 08 21:40:34.551656 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:34.551627    2568 scope.go:117] "RemoveContainer" containerID="853f1cec15d3dd22fb449a455dad4f7716b09abbf72683dc91d5a632f62b089f"
Jul 08 21:40:34.628995 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:34.628964    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2320581-4483-46f0-a8f5-d91f773333e2" path="/var/lib/kubelet/pods/f2320581-4483-46f0-a8f5-d91f773333e2/volumes"
Jul 08 21:40:48.714241 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.714208    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"]
Jul 08 21:40:48.714725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.714622    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2320581-4483-46f0-a8f5-d91f773333e2" containerName="manager"
Jul 08 21:40:48.714725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.714636    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2320581-4483-46f0-a8f5-d91f773333e2" containerName="manager"
Jul 08 21:40:48.714725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.714701    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2320581-4483-46f0-a8f5-d91f773333e2" containerName="manager"
Jul 08 21:40:48.719161 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.719143    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.722057 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.722029    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 21:40:48.722187 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.722163    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qnrwn\""
Jul 08 21:40:48.739178 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.739151    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"]
Jul 08 21:40:48.853829 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.853794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.853829 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.853827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2zzk\" (UniqueName: \"kubernetes.io/projected/06173637-5786-4d73-b1d3-0c79b8ad7052-kube-api-access-m2zzk\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.854037 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.853859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.854037 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.853926    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.854037 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.853956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.854037 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.853978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.854037 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.853995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06173637-5786-4d73-b1d3-0c79b8ad7052-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.854235 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.854054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.854235 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.854088    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955245 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955405 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955253    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955405 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955405 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06173637-5786-4d73-b1d3-0c79b8ad7052-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955405 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955340    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955405 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955476    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2zzk\" (UniqueName: \"kubernetes.io/projected/06173637-5786-4d73-b1d3-0c79b8ad7052-kube-api-access-m2zzk\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955664    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955700 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955682    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.955943 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955847    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.956002 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.955946    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.956328 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.956303    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06173637-5786-4d73-b1d3-0c79b8ad7052-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.958147 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.958125    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.958389 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.958369    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.964923 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.964869    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06173637-5786-4d73-b1d3-0c79b8ad7052-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:48.965465 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:48.965443    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2zzk\" (UniqueName: \"kubernetes.io/projected/06173637-5786-4d73-b1d3-0c79b8ad7052-kube-api-access-m2zzk\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2h5j\" (UID: \"06173637-5786-4d73-b1d3-0c79b8ad7052\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:49.029326 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:49.029299    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:49.208510 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:49.208476    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"]
Jul 08 21:40:49.210717 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:40:49.210680    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06173637_5786_4d73_b1d3_0c79b8ad7052.slice/crio-22ee9d2331223d8110ee8cb544c3ed3918aefa46d0c820ecf1292ea803c8db6a WatchSource:0}: Error finding container 22ee9d2331223d8110ee8cb544c3ed3918aefa46d0c820ecf1292ea803c8db6a: Status 404 returned error can't find the container with id 22ee9d2331223d8110ee8cb544c3ed3918aefa46d0c820ecf1292ea803c8db6a
Jul 08 21:40:50.008055 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:50.008020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" event={"ID":"06173637-5786-4d73-b1d3-0c79b8ad7052","Type":"ContainerStarted","Data":"22ee9d2331223d8110ee8cb544c3ed3918aefa46d0c820ecf1292ea803c8db6a"}
Jul 08 21:40:51.579329 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:51.579290    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:40:51.579633 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:51.579376    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:40:51.579633 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:51.579423    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:40:52.021746 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:52.021710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" event={"ID":"06173637-5786-4d73-b1d3-0c79b8ad7052","Type":"ContainerStarted","Data":"fad3f50a4c74e5825f5269e5c090ef38def527d1874cdedbd94064a948618f6f"}
Jul 08 21:40:52.030049 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:52.030023    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:52.034430 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:52.034395    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:52.043768 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:52.043725    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" podStartSLOduration=1.6778408040000001 podStartE2EDuration="4.043710183s" totalImagesPullingTime="2.365869379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:52.042119161 +0000 UTC m=+497.931900209" watchObservedRunningTime="2026-07-08 21:40:52.043710183 +0000 UTC m=+497.933491255"
Jul 08 21:40:53.026559 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:53.026519    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:53.027641 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:53.027618    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:40:54.733366 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.733329    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"]
Jul 08 21:40:54.737145 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.737123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:54.741221 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.741200    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 21:40:54.741356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.741224    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gm7tq\""
Jul 08 21:40:54.751682 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.751658    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"]
Jul 08 21:40:54.819764 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.819734    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"]
Jul 08 21:40:54.909155 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.909121    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/016bac07-ef67-45a1-89f5-604bce046acf-config-file\") pod \"limitador-limitador-64c94fd64f-vjv7d\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:54.909155 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:54.909159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7crm\" (UniqueName: \"kubernetes.io/projected/016bac07-ef67-45a1-89f5-604bce046acf-kube-api-access-z7crm\") pod \"limitador-limitador-64c94fd64f-vjv7d\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:55.010453 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.010398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/016bac07-ef67-45a1-89f5-604bce046acf-config-file\") pod \"limitador-limitador-64c94fd64f-vjv7d\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:55.010638 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.010469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7crm\" (UniqueName: \"kubernetes.io/projected/016bac07-ef67-45a1-89f5-604bce046acf-kube-api-access-z7crm\") pod \"limitador-limitador-64c94fd64f-vjv7d\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:55.011193 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.011172    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/016bac07-ef67-45a1-89f5-604bce046acf-config-file\") pod \"limitador-limitador-64c94fd64f-vjv7d\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:55.025424 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.025381    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7crm\" (UniqueName: \"kubernetes.io/projected/016bac07-ef67-45a1-89f5-604bce046acf-kube-api-access-z7crm\") pod \"limitador-limitador-64c94fd64f-vjv7d\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:55.047711 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.047686    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:55.206812 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.206788    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"]
Jul 08 21:40:55.208824 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:40:55.208801    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016bac07_ef67_45a1_89f5_604bce046acf.slice/crio-1a36fbca789f6603136f4741732ac1b2624faeecd1ce9ba580fc5b7fd221cf0a WatchSource:0}: Error finding container 1a36fbca789f6603136f4741732ac1b2624faeecd1ce9ba580fc5b7fd221cf0a: Status 404 returned error can't find the container with id 1a36fbca789f6603136f4741732ac1b2624faeecd1ce9ba580fc5b7fd221cf0a
Jul 08 21:40:55.672419 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.672379    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-868sg"]
Jul 08 21:40:55.677392 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.677362    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-868sg"
Jul 08 21:40:55.679689 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.679670    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b5c6q\""
Jul 08 21:40:55.685916 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.685889    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-868sg"]
Jul 08 21:40:55.818893 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.818852    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbfbs\" (UniqueName: \"kubernetes.io/projected/878bae88-f8cf-44e0-8aa9-660c2325419a-kube-api-access-gbfbs\") pod \"authorino-58cd955675-868sg\" (UID: \"878bae88-f8cf-44e0-8aa9-660c2325419a\") " pod="kuadrant-system/authorino-58cd955675-868sg"
Jul 08 21:40:55.903160 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.903133    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8tw5n"]
Jul 08 21:40:55.906879 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.906859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8tw5n"
Jul 08 21:40:55.920153 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.920131    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8tw5n"]
Jul 08 21:40:55.920253 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.920127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbfbs\" (UniqueName: \"kubernetes.io/projected/878bae88-f8cf-44e0-8aa9-660c2325419a-kube-api-access-gbfbs\") pod \"authorino-58cd955675-868sg\" (UID: \"878bae88-f8cf-44e0-8aa9-660c2325419a\") " pod="kuadrant-system/authorino-58cd955675-868sg"
Jul 08 21:40:55.937382 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.937314    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbfbs\" (UniqueName: \"kubernetes.io/projected/878bae88-f8cf-44e0-8aa9-660c2325419a-kube-api-access-gbfbs\") pod \"authorino-58cd955675-868sg\" (UID: \"878bae88-f8cf-44e0-8aa9-660c2325419a\") " pod="kuadrant-system/authorino-58cd955675-868sg"
Jul 08 21:40:55.994841 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:55.994806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-868sg"
Jul 08 21:40:56.021028 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:56.020853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpg4q\" (UniqueName: \"kubernetes.io/projected/62cdf426-df6e-4fe6-b6c3-c18b805fb087-kube-api-access-dpg4q\") pod \"authorino-75d556bd77-8tw5n\" (UID: \"62cdf426-df6e-4fe6-b6c3-c18b805fb087\") " pod="kuadrant-system/authorino-75d556bd77-8tw5n"
Jul 08 21:40:56.045361 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:56.045268    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d" event={"ID":"016bac07-ef67-45a1-89f5-604bce046acf","Type":"ContainerStarted","Data":"1a36fbca789f6603136f4741732ac1b2624faeecd1ce9ba580fc5b7fd221cf0a"}
Jul 08 21:40:56.122440 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:56.121970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpg4q\" (UniqueName: \"kubernetes.io/projected/62cdf426-df6e-4fe6-b6c3-c18b805fb087-kube-api-access-dpg4q\") pod \"authorino-75d556bd77-8tw5n\" (UID: \"62cdf426-df6e-4fe6-b6c3-c18b805fb087\") " pod="kuadrant-system/authorino-75d556bd77-8tw5n"
Jul 08 21:40:56.138990 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:56.138766    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpg4q\" (UniqueName: \"kubernetes.io/projected/62cdf426-df6e-4fe6-b6c3-c18b805fb087-kube-api-access-dpg4q\") pod \"authorino-75d556bd77-8tw5n\" (UID: \"62cdf426-df6e-4fe6-b6c3-c18b805fb087\") " pod="kuadrant-system/authorino-75d556bd77-8tw5n"
Jul 08 21:40:56.191540 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:56.191433    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-868sg"]
Jul 08 21:40:56.194475 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:40:56.194438    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod878bae88_f8cf_44e0_8aa9_660c2325419a.slice/crio-7f57b098ee48c29e0bc60e5b6651662621530e16747dd34d7da4a97661af5482 WatchSource:0}: Error finding container 7f57b098ee48c29e0bc60e5b6651662621530e16747dd34d7da4a97661af5482: Status 404 returned error can't find the container with id 7f57b098ee48c29e0bc60e5b6651662621530e16747dd34d7da4a97661af5482
Jul 08 21:40:56.215676 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:56.215651    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8tw5n"
Jul 08 21:40:56.394877 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:56.394844    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8tw5n"]
Jul 08 21:40:56.398093 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:40:56.398066    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62cdf426_df6e_4fe6_b6c3_c18b805fb087.slice/crio-af9bc5232dc721a1b0b7ae70d1d473e8d6c28d9ce2a448f688e4661020be18f0 WatchSource:0}: Error finding container af9bc5232dc721a1b0b7ae70d1d473e8d6c28d9ce2a448f688e4661020be18f0: Status 404 returned error can't find the container with id af9bc5232dc721a1b0b7ae70d1d473e8d6c28d9ce2a448f688e4661020be18f0
Jul 08 21:40:57.051261 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:57.051227    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-868sg" event={"ID":"878bae88-f8cf-44e0-8aa9-660c2325419a","Type":"ContainerStarted","Data":"7f57b098ee48c29e0bc60e5b6651662621530e16747dd34d7da4a97661af5482"}
Jul 08 21:40:57.052514 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:57.052484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8tw5n" event={"ID":"62cdf426-df6e-4fe6-b6c3-c18b805fb087","Type":"ContainerStarted","Data":"af9bc5232dc721a1b0b7ae70d1d473e8d6c28d9ce2a448f688e4661020be18f0"}
Jul 08 21:40:59.067302 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:59.067257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d" event={"ID":"016bac07-ef67-45a1-89f5-604bce046acf","Type":"ContainerStarted","Data":"a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55"}
Jul 08 21:40:59.067801 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:59.067394    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:40:59.085180 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:40:59.085128    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d" podStartSLOduration=2.092817652 podStartE2EDuration="5.085108353s" totalImagesPullingTime="2.992290701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:59.084452492 +0000 UTC m=+504.974233529" watchObservedRunningTime="2026-07-08 21:40:59.085108353 +0000 UTC m=+504.974889377"
Jul 08 21:41:01.079637 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:01.079598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-868sg" event={"ID":"878bae88-f8cf-44e0-8aa9-660c2325419a","Type":"ContainerStarted","Data":"144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6"}
Jul 08 21:41:01.081044 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:01.081018    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8tw5n" event={"ID":"62cdf426-df6e-4fe6-b6c3-c18b805fb087","Type":"ContainerStarted","Data":"96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14"}
Jul 08 21:41:01.095892 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:01.095807    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-868sg" podStartSLOduration=1.4356112269999999 podStartE2EDuration="6.095790756s" totalImagesPullingTime="4.660179529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:01.095340856 +0000 UTC m=+506.985121880" watchObservedRunningTime="2026-07-08 21:41:01.095790756 +0000 UTC m=+506.985571782"
Jul 08 21:41:01.110523 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:01.110479    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8tw5n" podStartSLOduration=1.665193156 podStartE2EDuration="6.110464392s" totalImagesPullingTime="4.445271236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:01.10945879 +0000 UTC m=+506.999239818" watchObservedRunningTime="2026-07-08 21:41:01.110464392 +0000 UTC m=+507.000245416"
Jul 08 21:41:01.133790 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:01.133761    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-868sg"]
Jul 08 21:41:03.089817 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:03.089776    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-868sg" podUID="878bae88-f8cf-44e0-8aa9-660c2325419a" containerName="authorino" containerID="cri-o://144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6" gracePeriod=30
Jul 08 21:41:03.343030 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:03.342964    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-868sg"
Jul 08 21:41:03.492649 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:03.492616    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbfbs\" (UniqueName: \"kubernetes.io/projected/878bae88-f8cf-44e0-8aa9-660c2325419a-kube-api-access-gbfbs\") pod \"878bae88-f8cf-44e0-8aa9-660c2325419a\" (UID: \"878bae88-f8cf-44e0-8aa9-660c2325419a\") "
Jul 08 21:41:03.494669 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:03.494643    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878bae88-f8cf-44e0-8aa9-660c2325419a-kube-api-access-gbfbs" (OuterVolumeSpecName: "kube-api-access-gbfbs") pod "878bae88-f8cf-44e0-8aa9-660c2325419a" (UID: "878bae88-f8cf-44e0-8aa9-660c2325419a"). InnerVolumeSpecName "kube-api-access-gbfbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:03.594272 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:03.594189    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbfbs\" (UniqueName: \"kubernetes.io/projected/878bae88-f8cf-44e0-8aa9-660c2325419a-kube-api-access-gbfbs\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:04.095321 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.095290    2568 generic.go:356] "Generic (PLEG): container finished" podID="878bae88-f8cf-44e0-8aa9-660c2325419a" containerID="144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6" exitCode=0
Jul 08 21:41:04.095782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.095334    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-868sg"
Jul 08 21:41:04.095782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.095388    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-868sg" event={"ID":"878bae88-f8cf-44e0-8aa9-660c2325419a","Type":"ContainerDied","Data":"144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6"}
Jul 08 21:41:04.095782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.095453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-868sg" event={"ID":"878bae88-f8cf-44e0-8aa9-660c2325419a","Type":"ContainerDied","Data":"7f57b098ee48c29e0bc60e5b6651662621530e16747dd34d7da4a97661af5482"}
Jul 08 21:41:04.095782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.095476    2568 scope.go:117] "RemoveContainer" containerID="144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6"
Jul 08 21:41:04.104590 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.104572    2568 scope.go:117] "RemoveContainer" containerID="144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6"
Jul 08 21:41:04.104851 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:41:04.104834    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6\": container with ID starting with 144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6 not found: ID does not exist" containerID="144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6"
Jul 08 21:41:04.104908 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.104862    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6"} err="failed to get container status \"144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6\": rpc error: code = NotFound desc = could not find container \"144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6\": container with ID starting with 144d4fa8e4ab1e8c1b1f66d932fc89b7e6066d4aae486ed31bf4980ec544a0a6 not found: ID does not exist"
Jul 08 21:41:04.117273 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.117240    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-868sg"]
Jul 08 21:41:04.121187 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.121163    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-868sg"]
Jul 08 21:41:04.629308 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:04.629270    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="878bae88-f8cf-44e0-8aa9-660c2325419a" path="/var/lib/kubelet/pods/878bae88-f8cf-44e0-8aa9-660c2325419a/volumes"
Jul 08 21:41:09.724577 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:09.724542    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"]
Jul 08 21:41:09.725033 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:09.724760    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d" podUID="016bac07-ef67-45a1-89f5-604bce046acf" containerName="limitador" containerID="cri-o://a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55" gracePeriod=30
Jul 08 21:41:09.725536 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:09.725517    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:41:10.275783 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:10.275760    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:41:10.349725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:10.349637    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/016bac07-ef67-45a1-89f5-604bce046acf-config-file\") pod \"016bac07-ef67-45a1-89f5-604bce046acf\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") "
Jul 08 21:41:10.349725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:10.349707    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7crm\" (UniqueName: \"kubernetes.io/projected/016bac07-ef67-45a1-89f5-604bce046acf-kube-api-access-z7crm\") pod \"016bac07-ef67-45a1-89f5-604bce046acf\" (UID: \"016bac07-ef67-45a1-89f5-604bce046acf\") "
Jul 08 21:41:10.350025 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:10.350003    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016bac07-ef67-45a1-89f5-604bce046acf-config-file" (OuterVolumeSpecName: "config-file") pod "016bac07-ef67-45a1-89f5-604bce046acf" (UID: "016bac07-ef67-45a1-89f5-604bce046acf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:41:10.351720 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:10.351700    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016bac07-ef67-45a1-89f5-604bce046acf-kube-api-access-z7crm" (OuterVolumeSpecName: "kube-api-access-z7crm") pod "016bac07-ef67-45a1-89f5-604bce046acf" (UID: "016bac07-ef67-45a1-89f5-604bce046acf"). InnerVolumeSpecName "kube-api-access-z7crm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:10.450971 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:10.450942    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7crm\" (UniqueName: \"kubernetes.io/projected/016bac07-ef67-45a1-89f5-604bce046acf-kube-api-access-z7crm\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:10.450971 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:10.450966    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/016bac07-ef67-45a1-89f5-604bce046acf-config-file\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:11.131809 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.131777    2568 generic.go:356] "Generic (PLEG): container finished" podID="016bac07-ef67-45a1-89f5-604bce046acf" containerID="a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55" exitCode=0
Jul 08 21:41:11.132215 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.131834    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"
Jul 08 21:41:11.132215 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.131859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d" event={"ID":"016bac07-ef67-45a1-89f5-604bce046acf","Type":"ContainerDied","Data":"a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55"}
Jul 08 21:41:11.132215 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.131936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjv7d" event={"ID":"016bac07-ef67-45a1-89f5-604bce046acf","Type":"ContainerDied","Data":"1a36fbca789f6603136f4741732ac1b2624faeecd1ce9ba580fc5b7fd221cf0a"}
Jul 08 21:41:11.132215 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.131958    2568 scope.go:117] "RemoveContainer" containerID="a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55"
Jul 08 21:41:11.140482 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.140468    2568 scope.go:117] "RemoveContainer" containerID="a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55"
Jul 08 21:41:11.140719 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:41:11.140702    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55\": container with ID starting with a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55 not found: ID does not exist" containerID="a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55"
Jul 08 21:41:11.140766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.140725    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55"} err="failed to get container status \"a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55\": rpc error: code = NotFound desc = could not find container \"a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55\": container with ID starting with a1415fc6891a3bd4f65ae2fe7f3ef060f8b71c4b29ff6f4590a57ff984c73f55 not found: ID does not exist"
Jul 08 21:41:11.149990 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.149969    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"]
Jul 08 21:41:11.154859 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:11.154839    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjv7d"]
Jul 08 21:41:12.629890 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:12.629854    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016bac07-ef67-45a1-89f5-604bce046acf" path="/var/lib/kubelet/pods/016bac07-ef67-45a1-89f5-604bce046acf/volumes"
Jul 08 21:41:14.808972 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.808938    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"]
Jul 08 21:41:14.809323 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.809300    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016bac07-ef67-45a1-89f5-604bce046acf" containerName="limitador"
Jul 08 21:41:14.809323 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.809310    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="016bac07-ef67-45a1-89f5-604bce046acf" containerName="limitador"
Jul 08 21:41:14.809323 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.809320    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878bae88-f8cf-44e0-8aa9-660c2325419a" containerName="authorino"
Jul 08 21:41:14.809323 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.809326    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="878bae88-f8cf-44e0-8aa9-660c2325419a" containerName="authorino"
Jul 08 21:41:14.809494 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.809383    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="016bac07-ef67-45a1-89f5-604bce046acf" containerName="limitador"
Jul 08 21:41:14.809494 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.809393    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="878bae88-f8cf-44e0-8aa9-660c2325419a" containerName="authorino"
Jul 08 21:41:14.813653 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.813632    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:14.817234 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.817204    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:41:14.817533 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.817514    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:41:14.820438 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.817959    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 21:41:14.820438 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.818229    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-g86f8\""
Jul 08 21:41:14.827621 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.827595    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"]
Jul 08 21:41:14.890133 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.890098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ss5\" (UniqueName: \"kubernetes.io/projected/ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2-kube-api-access-m7ss5\") pod \"postgres-69fb4594cf-6ghrw\" (UID: \"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:14.890300 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.890146    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2-data\") pod \"postgres-69fb4594cf-6ghrw\" (UID: \"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:14.991487 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.991449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ss5\" (UniqueName: \"kubernetes.io/projected/ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2-kube-api-access-m7ss5\") pod \"postgres-69fb4594cf-6ghrw\" (UID: \"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:14.991649 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.991538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2-data\") pod \"postgres-69fb4594cf-6ghrw\" (UID: \"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:14.991928 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.991907    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2-data\") pod \"postgres-69fb4594cf-6ghrw\" (UID: \"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:14.999534 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:14.999514    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ss5\" (UniqueName: \"kubernetes.io/projected/ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2-kube-api-access-m7ss5\") pod \"postgres-69fb4594cf-6ghrw\" (UID: \"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:15.128721 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:15.128629    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:15.281426 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:15.281392    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"]
Jul 08 21:41:15.284020 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:41:15.283994    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5a9ab6_cf2e_4e05_949b_5e4052ebdaf2.slice/crio-ea08400cf32817de80d6bdae3e3ea3adc127afdcd2ed46a1029faaf0c4f8630a WatchSource:0}: Error finding container ea08400cf32817de80d6bdae3e3ea3adc127afdcd2ed46a1029faaf0c4f8630a: Status 404 returned error can't find the container with id ea08400cf32817de80d6bdae3e3ea3adc127afdcd2ed46a1029faaf0c4f8630a
Jul 08 21:41:16.157315 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:16.157276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw" event={"ID":"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2","Type":"ContainerStarted","Data":"ea08400cf32817de80d6bdae3e3ea3adc127afdcd2ed46a1029faaf0c4f8630a"}
Jul 08 21:41:21.194504 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:21.194449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw" event={"ID":"ea5a9ab6-cf2e-4e05-949b-5e4052ebdaf2","Type":"ContainerStarted","Data":"5f1bd1cfa1611d97b3532bec50a8b38bf82c3795672662b3cd1040e0fd39419c"}
Jul 08 21:41:21.194987 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:21.194549    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:21.213174 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:21.213112    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw" podStartSLOduration=2.297967532 podStartE2EDuration="7.213093309s" totalImagesPullingTime="4.915125777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:21.211507544 +0000 UTC m=+527.101288580" watchObservedRunningTime="2026-07-08 21:41:21.213093309 +0000 UTC m=+527.102874333"
Jul 08 21:41:27.229829 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:27.229757    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6ghrw"
Jul 08 21:41:27.797543 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:27.797507    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w59wf"]
Jul 08 21:41:27.805869 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:27.805845    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w59wf"
Jul 08 21:41:27.807365 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:27.807335    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w59wf"]
Jul 08 21:41:27.907665 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:27.907632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9jbb\" (UniqueName: \"kubernetes.io/projected/c3ba64ff-122e-47c0-8760-78a670514c1d-kube-api-access-j9jbb\") pod \"authorino-5d4b67c446-w59wf\" (UID: \"c3ba64ff-122e-47c0-8760-78a670514c1d\") " pod="kuadrant-system/authorino-5d4b67c446-w59wf"
Jul 08 21:41:27.987146 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:27.987113    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w59wf"]
Jul 08 21:41:27.987386 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:41:27.987364    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j9jbb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-w59wf" podUID="c3ba64ff-122e-47c0-8760-78a670514c1d"
Jul 08 21:41:28.009079 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.009043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9jbb\" (UniqueName: \"kubernetes.io/projected/c3ba64ff-122e-47c0-8760-78a670514c1d-kube-api-access-j9jbb\") pod \"authorino-5d4b67c446-w59wf\" (UID: \"c3ba64ff-122e-47c0-8760-78a670514c1d\") " pod="kuadrant-system/authorino-5d4b67c446-w59wf"
Jul 08 21:41:28.018254 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.018233    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-shzpf"]
Jul 08 21:41:28.021366 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.021340    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9jbb\" (UniqueName: \"kubernetes.io/projected/c3ba64ff-122e-47c0-8760-78a670514c1d-kube-api-access-j9jbb\") pod \"authorino-5d4b67c446-w59wf\" (UID: \"c3ba64ff-122e-47c0-8760-78a670514c1d\") " pod="kuadrant-system/authorino-5d4b67c446-w59wf"
Jul 08 21:41:28.022377 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.022360    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.024960 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.024941    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 21:41:28.030896 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.030875    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-shzpf"]
Jul 08 21:41:28.072401 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.072344    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-shzpf"]
Jul 08 21:41:28.072617 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:41:28.072597    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cmbw4 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-cmbw4 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-shzpf" podUID="0870e67f-722c-4021-831f-fc8fd9b2adc9"
Jul 08 21:41:28.103568 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.103544    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85b8dff69d-4ldx6"]
Jul 08 21:41:28.107550 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.107535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.109787 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.109767    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmbw4\" (UniqueName: \"kubernetes.io/projected/0870e67f-722c-4021-831f-fc8fd9b2adc9-kube-api-access-cmbw4\") pod \"authorino-76877994-shzpf\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") " pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.109900 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.109849    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0870e67f-722c-4021-831f-fc8fd9b2adc9-tls-cert\") pod \"authorino-76877994-shzpf\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") " pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.113906 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.113887    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85b8dff69d-4ldx6"]
Jul 08 21:41:28.210947 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.210912    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4t6s\" (UniqueName: \"kubernetes.io/projected/ce9f4e67-c318-4ce5-99b0-e5915a282d54-kube-api-access-b4t6s\") pod \"authorino-85b8dff69d-4ldx6\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") " pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.211105 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.210953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmbw4\" (UniqueName: \"kubernetes.io/projected/0870e67f-722c-4021-831f-fc8fd9b2adc9-kube-api-access-cmbw4\") pod \"authorino-76877994-shzpf\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") " pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.211105 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.211050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0870e67f-722c-4021-831f-fc8fd9b2adc9-tls-cert\") pod \"authorino-76877994-shzpf\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") " pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.211209 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.211106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9f4e67-c318-4ce5-99b0-e5915a282d54-tls-cert\") pod \"authorino-85b8dff69d-4ldx6\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") " pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.213295 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.213277    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0870e67f-722c-4021-831f-fc8fd9b2adc9-tls-cert\") pod \"authorino-76877994-shzpf\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") " pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.218909 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.218886    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmbw4\" (UniqueName: \"kubernetes.io/projected/0870e67f-722c-4021-831f-fc8fd9b2adc9-kube-api-access-cmbw4\") pod \"authorino-76877994-shzpf\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") " pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.228458 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.228433    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.228545 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.228442    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w59wf"
Jul 08 21:41:28.235964 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.235945    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:28.238706 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.238688    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w59wf"
Jul 08 21:41:28.312245 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.312214    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9jbb\" (UniqueName: \"kubernetes.io/projected/c3ba64ff-122e-47c0-8760-78a670514c1d-kube-api-access-j9jbb\") pod \"c3ba64ff-122e-47c0-8760-78a670514c1d\" (UID: \"c3ba64ff-122e-47c0-8760-78a670514c1d\") "
Jul 08 21:41:28.312400 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.312267    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmbw4\" (UniqueName: \"kubernetes.io/projected/0870e67f-722c-4021-831f-fc8fd9b2adc9-kube-api-access-cmbw4\") pod \"0870e67f-722c-4021-831f-fc8fd9b2adc9\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") "
Jul 08 21:41:28.312400 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.312285    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0870e67f-722c-4021-831f-fc8fd9b2adc9-tls-cert\") pod \"0870e67f-722c-4021-831f-fc8fd9b2adc9\" (UID: \"0870e67f-722c-4021-831f-fc8fd9b2adc9\") "
Jul 08 21:41:28.312400 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.312397    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4t6s\" (UniqueName: \"kubernetes.io/projected/ce9f4e67-c318-4ce5-99b0-e5915a282d54-kube-api-access-b4t6s\") pod \"authorino-85b8dff69d-4ldx6\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") " pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.312616 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.312562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9f4e67-c318-4ce5-99b0-e5915a282d54-tls-cert\") pod \"authorino-85b8dff69d-4ldx6\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") " pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.314556 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.314513    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0870e67f-722c-4021-831f-fc8fd9b2adc9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0870e67f-722c-4021-831f-fc8fd9b2adc9" (UID: "0870e67f-722c-4021-831f-fc8fd9b2adc9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:41:28.314556 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.314536    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0870e67f-722c-4021-831f-fc8fd9b2adc9-kube-api-access-cmbw4" (OuterVolumeSpecName: "kube-api-access-cmbw4") pod "0870e67f-722c-4021-831f-fc8fd9b2adc9" (UID: "0870e67f-722c-4021-831f-fc8fd9b2adc9"). InnerVolumeSpecName "kube-api-access-cmbw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:28.314695 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.314629    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ba64ff-122e-47c0-8760-78a670514c1d-kube-api-access-j9jbb" (OuterVolumeSpecName: "kube-api-access-j9jbb") pod "c3ba64ff-122e-47c0-8760-78a670514c1d" (UID: "c3ba64ff-122e-47c0-8760-78a670514c1d"). InnerVolumeSpecName "kube-api-access-j9jbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:28.314953 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.314937    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9f4e67-c318-4ce5-99b0-e5915a282d54-tls-cert\") pod \"authorino-85b8dff69d-4ldx6\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") " pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.321683 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.321661    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4t6s\" (UniqueName: \"kubernetes.io/projected/ce9f4e67-c318-4ce5-99b0-e5915a282d54-kube-api-access-b4t6s\") pod \"authorino-85b8dff69d-4ldx6\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") " pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.413168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.413094    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9jbb\" (UniqueName: \"kubernetes.io/projected/c3ba64ff-122e-47c0-8760-78a670514c1d-kube-api-access-j9jbb\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:28.413168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.413121    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmbw4\" (UniqueName: \"kubernetes.io/projected/0870e67f-722c-4021-831f-fc8fd9b2adc9-kube-api-access-cmbw4\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:28.413168 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.413132    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0870e67f-722c-4021-831f-fc8fd9b2adc9-tls-cert\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:28.416985 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.416959    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:41:28.542510 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:28.542475    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85b8dff69d-4ldx6"]
Jul 08 21:41:28.545399 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:41:28.545374    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce9f4e67_c318_4ce5_99b0_e5915a282d54.slice/crio-8ad21a53cc1d0cb5c589e772b652262cf386c5bfdd7a7cf69766f847cf18db16 WatchSource:0}: Error finding container 8ad21a53cc1d0cb5c589e772b652262cf386c5bfdd7a7cf69766f847cf18db16: Status 404 returned error can't find the container with id 8ad21a53cc1d0cb5c589e772b652262cf386c5bfdd7a7cf69766f847cf18db16
Jul 08 21:41:29.234766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.234666    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b8dff69d-4ldx6" event={"ID":"ce9f4e67-c318-4ce5-99b0-e5915a282d54","Type":"ContainerStarted","Data":"f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2"}
Jul 08 21:41:29.234766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.234693    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-shzpf"
Jul 08 21:41:29.234766 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.234705    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b8dff69d-4ldx6" event={"ID":"ce9f4e67-c318-4ce5-99b0-e5915a282d54","Type":"ContainerStarted","Data":"8ad21a53cc1d0cb5c589e772b652262cf386c5bfdd7a7cf69766f847cf18db16"}
Jul 08 21:41:29.235039 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.234819    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w59wf"
Jul 08 21:41:29.250984 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.250940    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85b8dff69d-4ldx6" podStartSLOduration=0.942778974 podStartE2EDuration="1.250926724s" totalImagesPullingTime="308.14775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:29.25004221 +0000 UTC m=+535.139823234" watchObservedRunningTime="2026-07-08 21:41:29.250926724 +0000 UTC m=+535.140707748"
Jul 08 21:41:29.275678 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.275564    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w59wf"]
Jul 08 21:41:29.279788 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.279766    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w59wf"]
Jul 08 21:41:29.281405 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.281385    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8tw5n"]
Jul 08 21:41:29.281580 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.281543    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8tw5n" podUID="62cdf426-df6e-4fe6-b6c3-c18b805fb087" containerName="authorino" containerID="cri-o://96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14" gracePeriod=30
Jul 08 21:41:29.308975 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.308939    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-shzpf"]
Jul 08 21:41:29.313488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.313466    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-shzpf"]
Jul 08 21:41:29.539177 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.539154    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8tw5n"
Jul 08 21:41:29.624069 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.624039    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpg4q\" (UniqueName: \"kubernetes.io/projected/62cdf426-df6e-4fe6-b6c3-c18b805fb087-kube-api-access-dpg4q\") pod \"62cdf426-df6e-4fe6-b6c3-c18b805fb087\" (UID: \"62cdf426-df6e-4fe6-b6c3-c18b805fb087\") "
Jul 08 21:41:29.626029 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.625992    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62cdf426-df6e-4fe6-b6c3-c18b805fb087-kube-api-access-dpg4q" (OuterVolumeSpecName: "kube-api-access-dpg4q") pod "62cdf426-df6e-4fe6-b6c3-c18b805fb087" (UID: "62cdf426-df6e-4fe6-b6c3-c18b805fb087"). InnerVolumeSpecName "kube-api-access-dpg4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:29.724798 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:29.724761    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpg4q\" (UniqueName: \"kubernetes.io/projected/62cdf426-df6e-4fe6-b6c3-c18b805fb087-kube-api-access-dpg4q\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:30.241210 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.241175    2568 generic.go:356] "Generic (PLEG): container finished" podID="62cdf426-df6e-4fe6-b6c3-c18b805fb087" containerID="96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14" exitCode=0
Jul 08 21:41:30.241379 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.241219    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8tw5n"
Jul 08 21:41:30.241379 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.241259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8tw5n" event={"ID":"62cdf426-df6e-4fe6-b6c3-c18b805fb087","Type":"ContainerDied","Data":"96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14"}
Jul 08 21:41:30.241379 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.241306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8tw5n" event={"ID":"62cdf426-df6e-4fe6-b6c3-c18b805fb087","Type":"ContainerDied","Data":"af9bc5232dc721a1b0b7ae70d1d473e8d6c28d9ce2a448f688e4661020be18f0"}
Jul 08 21:41:30.241379 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.241326    2568 scope.go:117] "RemoveContainer" containerID="96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14"
Jul 08 21:41:30.250062 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.250040    2568 scope.go:117] "RemoveContainer" containerID="96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14"
Jul 08 21:41:30.250317 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:41:30.250300    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14\": container with ID starting with 96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14 not found: ID does not exist" containerID="96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14"
Jul 08 21:41:30.250389 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.250323    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14"} err="failed to get container status \"96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14\": rpc error: code = NotFound desc = could not find container \"96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14\": container with ID starting with 96d38134166af1b464434ec8527831485537e805d8e639ce7b60bef1f0724d14 not found: ID does not exist"
Jul 08 21:41:30.267687 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.267663    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8tw5n"]
Jul 08 21:41:30.270821 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.270804    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8tw5n"]
Jul 08 21:41:30.630067 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.630035    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0870e67f-722c-4021-831f-fc8fd9b2adc9" path="/var/lib/kubelet/pods/0870e67f-722c-4021-831f-fc8fd9b2adc9/volumes"
Jul 08 21:41:30.630270 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.630259    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62cdf426-df6e-4fe6-b6c3-c18b805fb087" path="/var/lib/kubelet/pods/62cdf426-df6e-4fe6-b6c3-c18b805fb087/volumes"
Jul 08 21:41:30.630590 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:30.630577    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ba64ff-122e-47c0-8760-78a670514c1d" path="/var/lib/kubelet/pods/c3ba64ff-122e-47c0-8760-78a670514c1d/volumes"
Jul 08 21:41:33.641331 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.641293    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59657584b7-mdj2w"]
Jul 08 21:41:33.641812 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.641679    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62cdf426-df6e-4fe6-b6c3-c18b805fb087" containerName="authorino"
Jul 08 21:41:33.641812 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.641691    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62cdf426-df6e-4fe6-b6c3-c18b805fb087" containerName="authorino"
Jul 08 21:41:33.641812 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.641750    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62cdf426-df6e-4fe6-b6c3-c18b805fb087" containerName="authorino"
Jul 08 21:41:33.725567 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.725536    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59657584b7-mdj2w"]
Jul 08 21:41:33.725741 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.725648    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:33.728584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.728551    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 21:41:33.728759 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.728740    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 21:41:33.728820 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.728753    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z6f8q\""
Jul 08 21:41:33.813056 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.813021    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c9fb9975-w8l4b"]
Jul 08 21:41:33.836597 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.836562    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9fb9975-w8l4b"]
Jul 08 21:41:33.836754 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.836673    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:33.859919 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.859886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwdf\" (UniqueName: \"kubernetes.io/projected/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-kube-api-access-5qwdf\") pod \"maas-controller-59657584b7-mdj2w\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") " pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:33.860019 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.859985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-webhook-cert\") pod \"maas-controller-59657584b7-mdj2w\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") " pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:33.960877 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.960795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-webhook-cert\") pod \"maas-controller-59657584b7-mdj2w\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") " pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:33.960877 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.960866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwdf\" (UniqueName: \"kubernetes.io/projected/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-kube-api-access-5qwdf\") pod \"maas-controller-59657584b7-mdj2w\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") " pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:33.961088 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.960898    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4rdw\" (UniqueName: \"kubernetes.io/projected/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-kube-api-access-q4rdw\") pod \"maas-controller-8c9fb9975-w8l4b\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") " pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:33.961088 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.960945    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-webhook-cert\") pod \"maas-controller-8c9fb9975-w8l4b\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") " pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:33.963165 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.963137    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-webhook-cert\") pod \"maas-controller-59657584b7-mdj2w\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") " pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:33.969193 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:33.969168    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwdf\" (UniqueName: \"kubernetes.io/projected/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-kube-api-access-5qwdf\") pod \"maas-controller-59657584b7-mdj2w\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") " pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:34.036253 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.036221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:34.062058 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.062033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rdw\" (UniqueName: \"kubernetes.io/projected/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-kube-api-access-q4rdw\") pod \"maas-controller-8c9fb9975-w8l4b\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") " pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:34.062180 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.062088    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-webhook-cert\") pod \"maas-controller-8c9fb9975-w8l4b\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") " pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:34.064698 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.064672    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-webhook-cert\") pod \"maas-controller-8c9fb9975-w8l4b\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") " pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:34.070534 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.070507    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4rdw\" (UniqueName: \"kubernetes.io/projected/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-kube-api-access-q4rdw\") pod \"maas-controller-8c9fb9975-w8l4b\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") " pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:34.147802 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.147770    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:34.189770 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.189745    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59657584b7-mdj2w"]
Jul 08 21:41:34.191604 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:41:34.191581    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fef9d6_acf7_4e6c_b7a0_85d6a20b49ce.slice/crio-30fd004c035766f6aa3f74146cf32eb48270b9d52eeb30a58420a42f17bd90b3 WatchSource:0}: Error finding container 30fd004c035766f6aa3f74146cf32eb48270b9d52eeb30a58420a42f17bd90b3: Status 404 returned error can't find the container with id 30fd004c035766f6aa3f74146cf32eb48270b9d52eeb30a58420a42f17bd90b3
Jul 08 21:41:34.264245 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.264211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59657584b7-mdj2w" event={"ID":"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce","Type":"ContainerStarted","Data":"30fd004c035766f6aa3f74146cf32eb48270b9d52eeb30a58420a42f17bd90b3"}
Jul 08 21:41:34.289322 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:34.289284    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9fb9975-w8l4b"]
Jul 08 21:41:34.295875 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:41:34.295850    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cc96b1_ccc1_4cae_aa40_5d60f7e6f07a.slice/crio-ec3a3187b39961beb3bc507cb0f39f204ee21a363608f7be6e974e8dd38fbabb WatchSource:0}: Error finding container ec3a3187b39961beb3bc507cb0f39f204ee21a363608f7be6e974e8dd38fbabb: Status 404 returned error can't find the container with id ec3a3187b39961beb3bc507cb0f39f204ee21a363608f7be6e974e8dd38fbabb
Jul 08 21:41:35.277718 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:35.277675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9fb9975-w8l4b" event={"ID":"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a","Type":"ContainerStarted","Data":"ec3a3187b39961beb3bc507cb0f39f204ee21a363608f7be6e974e8dd38fbabb"}
Jul 08 21:41:36.788982 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:36.788950    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 21:41:37.291931 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:37.291893    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9fb9975-w8l4b" event={"ID":"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a","Type":"ContainerStarted","Data":"a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860"}
Jul 08 21:41:37.292119 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:37.292034    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:37.293470 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:37.293449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59657584b7-mdj2w" event={"ID":"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce","Type":"ContainerStarted","Data":"e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742"}
Jul 08 21:41:37.293640 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:37.293624    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:37.327072 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:37.327022    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c9fb9975-w8l4b" podStartSLOduration=1.830399723 podStartE2EDuration="4.32700854s" totalImagesPullingTime="2.496608817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:37.325137447 +0000 UTC m=+543.214918500" watchObservedRunningTime="2026-07-08 21:41:37.32700854 +0000 UTC m=+543.216789543"
Jul 08 21:41:37.354692 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:37.354588    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59657584b7-mdj2w" podStartSLOduration=1.7612695839999999 podStartE2EDuration="4.354569061s" totalImagesPullingTime="2.593299477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:37.354298451 +0000 UTC m=+543.244079501" watchObservedRunningTime="2026-07-08 21:41:37.354569061 +0000 UTC m=+543.244350158"
Jul 08 21:41:48.303390 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.303359    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:48.303808 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.303454    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:41:48.365048 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.365013    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59657584b7-mdj2w"]
Jul 08 21:41:48.365233 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.365208    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-59657584b7-mdj2w" podUID="f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" containerName="manager" containerID="cri-o://e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742" gracePeriod=30
Jul 08 21:41:48.613492 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.613464    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:48.792767 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.792736    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qwdf\" (UniqueName: \"kubernetes.io/projected/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-kube-api-access-5qwdf\") pod \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") "
Jul 08 21:41:48.792959 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.792784    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-webhook-cert\") pod \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\" (UID: \"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce\") "
Jul 08 21:41:48.795042 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.795011    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-kube-api-access-5qwdf" (OuterVolumeSpecName: "kube-api-access-5qwdf") pod "f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" (UID: "f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce"). InnerVolumeSpecName "kube-api-access-5qwdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:48.795042 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.795016    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" (UID: "f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:41:48.893883 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.893804    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qwdf\" (UniqueName: \"kubernetes.io/projected/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-kube-api-access-5qwdf\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:48.893883 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:48.893831    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce-webhook-cert\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:41:49.351743 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.351702    2568 generic.go:356] "Generic (PLEG): container finished" podID="f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" containerID="e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742" exitCode=0
Jul 08 21:41:49.351743 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.351745    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59657584b7-mdj2w"
Jul 08 21:41:49.352200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.351790    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59657584b7-mdj2w" event={"ID":"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce","Type":"ContainerDied","Data":"e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742"}
Jul 08 21:41:49.352200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.351844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59657584b7-mdj2w" event={"ID":"f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce","Type":"ContainerDied","Data":"30fd004c035766f6aa3f74146cf32eb48270b9d52eeb30a58420a42f17bd90b3"}
Jul 08 21:41:49.352200 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.351866    2568 scope.go:117] "RemoveContainer" containerID="e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742"
Jul 08 21:41:49.361014 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.360994    2568 scope.go:117] "RemoveContainer" containerID="e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742"
Jul 08 21:41:49.361291 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:41:49.361274    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742\": container with ID starting with e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742 not found: ID does not exist" containerID="e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742"
Jul 08 21:41:49.361346 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.361299    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742"} err="failed to get container status \"e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742\": rpc error: code = NotFound desc = could not find container \"e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742\": container with ID starting with e9e89186bdaaceb573977b87e8f5c27c88c78a734726b3b0b9698cdfd2d93742 not found: ID does not exist"
Jul 08 21:41:49.373318 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.373298    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59657584b7-mdj2w"]
Jul 08 21:41:49.379474 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:49.379455    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59657584b7-mdj2w"]
Jul 08 21:41:50.630959 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:41:50.630923    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" path="/var/lib/kubelet/pods/f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce/volumes"
Jul 08 21:42:08.190939 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.190897    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"]
Jul 08 21:42:08.191567 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.191546    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" containerName="manager"
Jul 08 21:42:08.191567 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.191569    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" containerName="manager"
Jul 08 21:42:08.191715 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.191693    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4fef9d6-acf7-4e6c-b7a0-85d6a20b49ce" containerName="manager"
Jul 08 21:42:08.199483 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.199461    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.202180 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.202155    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 21:42:08.202270 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.202213    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-m94p2\""
Jul 08 21:42:08.211805 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.211775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"]
Jul 08 21:42:08.253701 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.253675    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b622a32-5642-4c39-9082-d0eb277f0765-openshift-service-ca\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.253816 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.253719    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shkm4\" (UniqueName: \"kubernetes.io/projected/0b622a32-5642-4c39-9082-d0eb277f0765-kube-api-access-shkm4\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.253816 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.253772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b622a32-5642-4c39-9082-d0eb277f0765-maas-api-tls\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.354564 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.354524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shkm4\" (UniqueName: \"kubernetes.io/projected/0b622a32-5642-4c39-9082-d0eb277f0765-kube-api-access-shkm4\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.354755 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.354606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b622a32-5642-4c39-9082-d0eb277f0765-maas-api-tls\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.354755 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.354672    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b622a32-5642-4c39-9082-d0eb277f0765-openshift-service-ca\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.354755 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:42:08.354743    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 21:42:08.354944 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:42:08.354810    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b622a32-5642-4c39-9082-d0eb277f0765-maas-api-tls podName:0b622a32-5642-4c39-9082-d0eb277f0765 nodeName:}" failed. No retries permitted until 2026-07-08 21:42:08.854794094 +0000 UTC m=+574.744575098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0b622a32-5642-4c39-9082-d0eb277f0765-maas-api-tls") pod "maas-api-dc6f988dd-q29q2" (UID: "0b622a32-5642-4c39-9082-d0eb277f0765") : secret "maas-api-serving-cert" not found
Jul 08 21:42:08.355308 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.355286    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b622a32-5642-4c39-9082-d0eb277f0765-openshift-service-ca\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.363584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.363558    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shkm4\" (UniqueName: \"kubernetes.io/projected/0b622a32-5642-4c39-9082-d0eb277f0765-kube-api-access-shkm4\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.748280 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.748238    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x4dbx"]
Jul 08 21:42:08.751559 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.751538    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:08.754585 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.754568    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sjnmr\""
Jul 08 21:42:08.754724 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.754707    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 21:42:08.758373 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.758339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmxn\" (UniqueName: \"kubernetes.io/projected/6b901007-007c-4d5f-be4a-b6f8f05cba4c-kube-api-access-gpmxn\") pod \"payload-pre-processing-7964457696-x4dbx\" (UID: \"6b901007-007c-4d5f-be4a-b6f8f05cba4c\") " pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:08.758485 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.758400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b901007-007c-4d5f-be4a-b6f8f05cba4c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x4dbx\" (UID: \"6b901007-007c-4d5f-be4a-b6f8f05cba4c\") " pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:08.766160 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.766137    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x4dbx"]
Jul 08 21:42:08.779467 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.779438    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bxvfs"]
Jul 08 21:42:08.782460 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.782442    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:08.790831 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.790809    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bxvfs"]
Jul 08 21:42:08.859492 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.859462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b622a32-5642-4c39-9082-d0eb277f0765-maas-api-tls\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.859664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.859501    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4404e904-bceb-4256-80ab-f7491db3e51a-plugins-config-volume\") pod \"payload-processing-58f86c7798-bxvfs\" (UID: \"4404e904-bceb-4256-80ab-f7491db3e51a\") " pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:08.859664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.859531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp7cz\" (UniqueName: \"kubernetes.io/projected/4404e904-bceb-4256-80ab-f7491db3e51a-kube-api-access-sp7cz\") pod \"payload-processing-58f86c7798-bxvfs\" (UID: \"4404e904-bceb-4256-80ab-f7491db3e51a\") " pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:08.859664 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.859614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmxn\" (UniqueName: \"kubernetes.io/projected/6b901007-007c-4d5f-be4a-b6f8f05cba4c-kube-api-access-gpmxn\") pod \"payload-pre-processing-7964457696-x4dbx\" (UID: \"6b901007-007c-4d5f-be4a-b6f8f05cba4c\") " pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:08.859791 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.859676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b901007-007c-4d5f-be4a-b6f8f05cba4c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x4dbx\" (UID: \"6b901007-007c-4d5f-be4a-b6f8f05cba4c\") " pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:08.860332 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.860315    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b901007-007c-4d5f-be4a-b6f8f05cba4c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x4dbx\" (UID: \"6b901007-007c-4d5f-be4a-b6f8f05cba4c\") " pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:08.861833 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.861816    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b622a32-5642-4c39-9082-d0eb277f0765-maas-api-tls\") pod \"maas-api-dc6f988dd-q29q2\" (UID: \"0b622a32-5642-4c39-9082-d0eb277f0765\") " pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:08.867790 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.867763    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmxn\" (UniqueName: \"kubernetes.io/projected/6b901007-007c-4d5f-be4a-b6f8f05cba4c-kube-api-access-gpmxn\") pod \"payload-pre-processing-7964457696-x4dbx\" (UID: \"6b901007-007c-4d5f-be4a-b6f8f05cba4c\") " pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:08.960314 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.960281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4404e904-bceb-4256-80ab-f7491db3e51a-plugins-config-volume\") pod \"payload-processing-58f86c7798-bxvfs\" (UID: \"4404e904-bceb-4256-80ab-f7491db3e51a\") " pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:08.960314 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.960323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp7cz\" (UniqueName: \"kubernetes.io/projected/4404e904-bceb-4256-80ab-f7491db3e51a-kube-api-access-sp7cz\") pod \"payload-processing-58f86c7798-bxvfs\" (UID: \"4404e904-bceb-4256-80ab-f7491db3e51a\") " pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:08.961043 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.961015    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4404e904-bceb-4256-80ab-f7491db3e51a-plugins-config-volume\") pod \"payload-processing-58f86c7798-bxvfs\" (UID: \"4404e904-bceb-4256-80ab-f7491db3e51a\") " pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:08.969680 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:08.969650    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp7cz\" (UniqueName: \"kubernetes.io/projected/4404e904-bceb-4256-80ab-f7491db3e51a-kube-api-access-sp7cz\") pod \"payload-processing-58f86c7798-bxvfs\" (UID: \"4404e904-bceb-4256-80ab-f7491db3e51a\") " pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:09.063665 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.063591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:09.093591 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.093563    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:09.111697 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.111570    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:09.241329 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.241230    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x4dbx"]
Jul 08 21:42:09.243658 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:42:09.243615    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b901007_007c_4d5f_be4a_b6f8f05cba4c.slice/crio-bd6c0d97c4c1bfa71031f0dd1baada4f98411388fe8428df9551ba681f2cbf18 WatchSource:0}: Error finding container bd6c0d97c4c1bfa71031f0dd1baada4f98411388fe8428df9551ba681f2cbf18: Status 404 returned error can't find the container with id bd6c0d97c4c1bfa71031f0dd1baada4f98411388fe8428df9551ba681f2cbf18
Jul 08 21:42:09.289718 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.289683    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bxvfs"]
Jul 08 21:42:09.292545 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:42:09.292515    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4404e904_bceb_4256_80ab_f7491db3e51a.slice/crio-6fec2780e91679f62f2e75d8087ed25b4d79a9ecd3216cb471a17c253b7abdeb WatchSource:0}: Error finding container 6fec2780e91679f62f2e75d8087ed25b4d79a9ecd3216cb471a17c253b7abdeb: Status 404 returned error can't find the container with id 6fec2780e91679f62f2e75d8087ed25b4d79a9ecd3216cb471a17c253b7abdeb
Jul 08 21:42:09.314264 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.314238    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"]
Jul 08 21:42:09.317828 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:42:09.317795    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b622a32_5642_4c39_9082_d0eb277f0765.slice/crio-98806a19d39b508f754a4ef3a17577b9cc48f92a2f345034eb5624adf3f64436 WatchSource:0}: Error finding container 98806a19d39b508f754a4ef3a17577b9cc48f92a2f345034eb5624adf3f64436: Status 404 returned error can't find the container with id 98806a19d39b508f754a4ef3a17577b9cc48f92a2f345034eb5624adf3f64436
Jul 08 21:42:09.454895 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.454849    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2" event={"ID":"0b622a32-5642-4c39-9082-d0eb277f0765","Type":"ContainerStarted","Data":"98806a19d39b508f754a4ef3a17577b9cc48f92a2f345034eb5624adf3f64436"}
Jul 08 21:42:09.456080 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.456053    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-bxvfs" event={"ID":"4404e904-bceb-4256-80ab-f7491db3e51a","Type":"ContainerStarted","Data":"6fec2780e91679f62f2e75d8087ed25b4d79a9ecd3216cb471a17c253b7abdeb"}
Jul 08 21:42:09.457152 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:09.457133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx" event={"ID":"6b901007-007c-4d5f-be4a-b6f8f05cba4c","Type":"ContainerStarted","Data":"bd6c0d97c4c1bfa71031f0dd1baada4f98411388fe8428df9551ba681f2cbf18"}
Jul 08 21:42:12.477383 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.477335    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx" event={"ID":"6b901007-007c-4d5f-be4a-b6f8f05cba4c","Type":"ContainerStarted","Data":"3e49516db3e3d74c8ed3dc7c0548b09829898e22719b6722bf8f5270dc5ea0e5"}
Jul 08 21:42:12.477819 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.477525    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:12.479436 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.479377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2" event={"ID":"0b622a32-5642-4c39-9082-d0eb277f0765","Type":"ContainerStarted","Data":"0359594619a4e5964476f8eafa3144d43844bc80adb5ba21a1f92518827be4be"}
Jul 08 21:42:12.479563 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.479464    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:12.481117 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.481091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-bxvfs" event={"ID":"4404e904-bceb-4256-80ab-f7491db3e51a","Type":"ContainerStarted","Data":"15394a2ab426e71155bf8a9cf7ef02f1ac2d42307d83641d45af370b55f08f21"}
Jul 08 21:42:12.481237 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.481224    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:12.494611 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.494571    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx" podStartSLOduration=2.329199693 podStartE2EDuration="4.494558977s" totalImagesPullingTime="2.165359284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:12.492568402 +0000 UTC m=+578.382349427" watchObservedRunningTime="2026-07-08 21:42:12.494558977 +0000 UTC m=+578.384340001"
Jul 08 21:42:12.509860 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.509809    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2" podStartSLOduration=2.418198516 podStartE2EDuration="4.509796593s" totalImagesPullingTime="2.091598077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:12.507484145 +0000 UTC m=+578.397265171" watchObservedRunningTime="2026-07-08 21:42:12.509796593 +0000 UTC m=+578.399577618"
Jul 08 21:42:12.525719 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:12.525665    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-bxvfs" podStartSLOduration=2.406990788 podStartE2EDuration="4.525647576s" totalImagesPullingTime="2.118656788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:12.523002008 +0000 UTC m=+578.412783046" watchObservedRunningTime="2026-07-08 21:42:12.525647576 +0000 UTC m=+578.415428601"
Jul 08 21:42:16.508130 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:16.508095    2568 generic.go:356] "Generic (PLEG): container finished" podID="06173637-5786-4d73-b1d3-0c79b8ad7052" containerID="fad3f50a4c74e5825f5269e5c090ef38def527d1874cdedbd94064a948618f6f" exitCode=0
Jul 08 21:42:16.508663 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:16.508169    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" event={"ID":"06173637-5786-4d73-b1d3-0c79b8ad7052","Type":"ContainerDied","Data":"fad3f50a4c74e5825f5269e5c090ef38def527d1874cdedbd94064a948618f6f"}
Jul 08 21:42:16.508732 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:16.508713    2568 scope.go:117] "RemoveContainer" containerID="fad3f50a4c74e5825f5269e5c090ef38def527d1874cdedbd94064a948618f6f"
Jul 08 21:42:16.509735 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:16.509704    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:42:16.509800 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:16.509780    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:42:16.509837 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:16.509813    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 21:42:17.516000 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:17.515960    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" event={"ID":"06173637-5786-4d73-b1d3-0c79b8ad7052","Type":"ContainerStarted","Data":"4ecd047fd2265d03e1cc0afc7673e9ac8bad39e86bfdbaf56651f7ea89316a27"}
Jul 08 21:42:18.030719 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:18.030680    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:42:18.030932 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:18.030813    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2h5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 08 21:42:18.030932 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:18.030859    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" podUID="06173637-5786-4d73-b1d3-0c79b8ad7052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 08 21:42:18.492122 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:18.492045    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dc6f988dd-q29q2"
Jul 08 21:42:19.030372 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:19.030332    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2h5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 08 21:42:19.030922 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:19.030424    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" podUID="06173637-5786-4d73-b1d3-0c79b8ad7052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 08 21:42:20.030170 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:20.030134    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2h5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 08 21:42:20.030485 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:20.030451    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" podUID="06173637-5786-4d73-b1d3-0c79b8ad7052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 08 21:42:21.029928 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:21.029884    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2h5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 08 21:42:21.030179 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:21.029973    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j" podUID="06173637-5786-4d73-b1d3-0c79b8ad7052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 08 21:42:22.033490 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:22.033460    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:42:22.033868 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:22.033728    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:42:22.034458 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:22.034435    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2h5j"
Jul 08 21:42:23.488124 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:23.488092    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-bxvfs"
Jul 08 21:42:23.488624 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:23.488286    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-x4dbx"
Jul 08 21:42:28.702579 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.702541    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"]
Jul 08 21:42:28.713731 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.713707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.717185 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.717157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mwth9\""
Jul 08 21:42:28.717493 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.717452    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 21:42:28.717816 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.717795    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 21:42:28.717912 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.717832    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 21:42:28.718802 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.718782    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"]
Jul 08 21:42:28.747861 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.747829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.748007 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.747883    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.748007 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.747899    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a578b42b-c0dd-481c-897a-67a5b05d2823-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.748106 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.748010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.748106 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.748058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.748106 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.748080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz926\" (UniqueName: \"kubernetes.io/projected/a578b42b-c0dd-481c-897a-67a5b05d2823-kube-api-access-kz926\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.849501 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.849696 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.849696 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a578b42b-c0dd-481c-897a-67a5b05d2823-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.849696 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.849696 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.849696 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz926\" (UniqueName: \"kubernetes.io/projected/a578b42b-c0dd-481c-897a-67a5b05d2823-kube-api-access-kz926\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.849992 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849968    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.850057 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.849996    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.850097 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.850068    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.851739 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.851717    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a578b42b-c0dd-481c-897a-67a5b05d2823-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.851896 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.851878    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a578b42b-c0dd-481c-897a-67a5b05d2823-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:28.857548 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:28.857529    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz926\" (UniqueName: \"kubernetes.io/projected/a578b42b-c0dd-481c-897a-67a5b05d2823-kube-api-access-kz926\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l\" (UID: \"a578b42b-c0dd-481c-897a-67a5b05d2823\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:29.026905 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:29.026859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:29.167303 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:29.167274    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"]
Jul 08 21:42:29.169783 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:42:29.169756    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda578b42b_c0dd_481c_897a_67a5b05d2823.slice/crio-020b834f620944951272eaf9995d3a414ed32055270c236fbc2066fb6c77aa2d WatchSource:0}: Error finding container 020b834f620944951272eaf9995d3a414ed32055270c236fbc2066fb6c77aa2d: Status 404 returned error can't find the container with id 020b834f620944951272eaf9995d3a414ed32055270c236fbc2066fb6c77aa2d
Jul 08 21:42:29.590461 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:29.590390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l" event={"ID":"a578b42b-c0dd-481c-897a-67a5b05d2823","Type":"ContainerStarted","Data":"020b834f620944951272eaf9995d3a414ed32055270c236fbc2066fb6c77aa2d"}
Jul 08 21:42:30.597680 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:30.597585    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l" event={"ID":"a578b42b-c0dd-481c-897a-67a5b05d2823","Type":"ContainerStarted","Data":"ea4b4e4afd30eb665dd85ff108e0c8c9c25f61cbecfad12c93a1a10a940454bc"}
Jul 08 21:42:30.618190 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:30.618145    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l" podStartSLOduration=1.450419616 podStartE2EDuration="2.618130581s" totalImagesPullingTime="1.167710965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:30.61516126 +0000 UTC m=+596.504942285" watchObservedRunningTime="2026-07-08 21:42:30.618130581 +0000 UTC m=+596.507911644"
Jul 08 21:42:34.549464 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:34.549430    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:42:34.552279 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:34.552258    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:42:34.559001 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:34.558980    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:42:34.561536 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:34.561519    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:42:39.028040 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:39.028004    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:39.028547 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:39.028060    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:39.040301 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:39.040276    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:39.654253 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:39.654228    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l"
Jul 08 21:42:53.601129 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.601087    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"]
Jul 08 21:42:53.607272 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.607247    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.610329 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.610310    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 21:42:53.618151 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.618130    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"]
Jul 08 21:42:53.777183 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.777146    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.777369 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.777195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.777369 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.777211    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.777369 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.777273    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8327223b-5d46-43a4-ba3f-6246888f141d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.777369 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.777345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.777563 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.777375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzdg9\" (UniqueName: \"kubernetes.io/projected/8327223b-5d46-43a4-ba3f-6246888f141d-kube-api-access-jzdg9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.878885 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.878801    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879042 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.878888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzdg9\" (UniqueName: \"kubernetes.io/projected/8327223b-5d46-43a4-ba3f-6246888f141d-kube-api-access-jzdg9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879042 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.878939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879042 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.878977    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879042 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.879000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879042 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.879038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8327223b-5d46-43a4-ba3f-6246888f141d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879342 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.879311    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879406 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.879369    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.879503 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.879448    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.881353 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.881329    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8327223b-5d46-43a4-ba3f-6246888f141d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.881550 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.881532    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8327223b-5d46-43a4-ba3f-6246888f141d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.886626 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.886609    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzdg9\" (UniqueName: \"kubernetes.io/projected/8327223b-5d46-43a4-ba3f-6246888f141d-kube-api-access-jzdg9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wrvqf\" (UID: \"8327223b-5d46-43a4-ba3f-6246888f141d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:53.918646 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:53.918616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:42:54.058287 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:54.058263    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"]
Jul 08 21:42:54.060620 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:42:54.060583    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8327223b_5d46_43a4_ba3f_6246888f141d.slice/crio-5c721c929c1038f46f906f124788b612e21f62f9eda50c1391a58ed10fb3efcd WatchSource:0}: Error finding container 5c721c929c1038f46f906f124788b612e21f62f9eda50c1391a58ed10fb3efcd: Status 404 returned error can't find the container with id 5c721c929c1038f46f906f124788b612e21f62f9eda50c1391a58ed10fb3efcd
Jul 08 21:42:54.061819 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:54.061801    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:42:54.714023 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:54.713988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf" event={"ID":"8327223b-5d46-43a4-ba3f-6246888f141d","Type":"ContainerStarted","Data":"e55108f06c21fe403e2548b1bdbfffcd98c0a2f81a04fc71cab07d56b3760949"}
Jul 08 21:42:54.714447 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:54.714044    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf" event={"ID":"8327223b-5d46-43a4-ba3f-6246888f141d","Type":"ContainerStarted","Data":"5c721c929c1038f46f906f124788b612e21f62f9eda50c1391a58ed10fb3efcd"}
Jul 08 21:42:54.734858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:42:54.734815    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf" podStartSLOduration=1.552629276 podStartE2EDuration="1.734798468s" totalImagesPullingTime="182.169192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:42:54.732258182 +0000 UTC m=+620.622039207" watchObservedRunningTime="2026-07-08 21:42:54.734798468 +0000 UTC m=+620.624579492"
Jul 08 21:43:03.919208 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:43:03.919122    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:43:03.919208 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:43:03.919180    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:43:03.932013 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:43:03.931992    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:43:04.780900 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:43:04.780868    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wrvqf"
Jul 08 21:44:16.375685 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.375649    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b769d5575-5lj4z"]
Jul 08 21:44:16.379226 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.379209    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.387113 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.387092    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b769d5575-5lj4z"]
Jul 08 21:44:16.499491 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.499458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltgxw\" (UniqueName: \"kubernetes.io/projected/7250f159-e94d-4e34-bd43-f45f1d0df14d-kube-api-access-ltgxw\") pod \"authorino-b769d5575-5lj4z\" (UID: \"7250f159-e94d-4e34-bd43-f45f1d0df14d\") " pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.499491 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.499495    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7250f159-e94d-4e34-bd43-f45f1d0df14d-tls-cert\") pod \"authorino-b769d5575-5lj4z\" (UID: \"7250f159-e94d-4e34-bd43-f45f1d0df14d\") " pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.600516 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.600479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltgxw\" (UniqueName: \"kubernetes.io/projected/7250f159-e94d-4e34-bd43-f45f1d0df14d-kube-api-access-ltgxw\") pod \"authorino-b769d5575-5lj4z\" (UID: \"7250f159-e94d-4e34-bd43-f45f1d0df14d\") " pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.600516 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.600520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7250f159-e94d-4e34-bd43-f45f1d0df14d-tls-cert\") pod \"authorino-b769d5575-5lj4z\" (UID: \"7250f159-e94d-4e34-bd43-f45f1d0df14d\") " pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.602949 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.602920    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7250f159-e94d-4e34-bd43-f45f1d0df14d-tls-cert\") pod \"authorino-b769d5575-5lj4z\" (UID: \"7250f159-e94d-4e34-bd43-f45f1d0df14d\") " pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.609131 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.609100    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltgxw\" (UniqueName: \"kubernetes.io/projected/7250f159-e94d-4e34-bd43-f45f1d0df14d-kube-api-access-ltgxw\") pod \"authorino-b769d5575-5lj4z\" (UID: \"7250f159-e94d-4e34-bd43-f45f1d0df14d\") " pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.689463 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.689361    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b769d5575-5lj4z"
Jul 08 21:44:16.833107 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:16.833079    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b769d5575-5lj4z"]
Jul 08 21:44:16.835321 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:44:16.835296    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7250f159_e94d_4e34_bd43_f45f1d0df14d.slice/crio-6c530c92918d0b1fe37342da0406914b49320bddac96e96bd05d51cfba617f37 WatchSource:0}: Error finding container 6c530c92918d0b1fe37342da0406914b49320bddac96e96bd05d51cfba617f37: Status 404 returned error can't find the container with id 6c530c92918d0b1fe37342da0406914b49320bddac96e96bd05d51cfba617f37
Jul 08 21:44:17.127591 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:17.127551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b769d5575-5lj4z" event={"ID":"7250f159-e94d-4e34-bd43-f45f1d0df14d","Type":"ContainerStarted","Data":"6c530c92918d0b1fe37342da0406914b49320bddac96e96bd05d51cfba617f37"}
Jul 08 21:44:18.134313 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.134274    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b769d5575-5lj4z" event={"ID":"7250f159-e94d-4e34-bd43-f45f1d0df14d","Type":"ContainerStarted","Data":"75d92b223bfa94e8a6c0bfb59486c6cfa9b7f79eb02137fac99200dc318b4b58"}
Jul 08 21:44:18.159274 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.159209    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b769d5575-5lj4z" podStartSLOduration=1.82357198 podStartE2EDuration="2.159185493s" totalImagesPullingTime="335.613513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:18.159130302 +0000 UTC m=+704.048911327" watchObservedRunningTime="2026-07-08 21:44:18.159185493 +0000 UTC m=+704.048966518"
Jul 08 21:44:18.212436 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.212149    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85b8dff69d-4ldx6"]
Jul 08 21:44:18.212436 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.212375    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-85b8dff69d-4ldx6" podUID="ce9f4e67-c318-4ce5-99b0-e5915a282d54" containerName="authorino" containerID="cri-o://f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2" gracePeriod=30
Jul 08 21:44:18.485173 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.485149    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:44:18.620718 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.620683    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4t6s\" (UniqueName: \"kubernetes.io/projected/ce9f4e67-c318-4ce5-99b0-e5915a282d54-kube-api-access-b4t6s\") pod \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") "
Jul 08 21:44:18.620924 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.620762    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9f4e67-c318-4ce5-99b0-e5915a282d54-tls-cert\") pod \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\" (UID: \"ce9f4e67-c318-4ce5-99b0-e5915a282d54\") "
Jul 08 21:44:18.622836 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.622797    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9f4e67-c318-4ce5-99b0-e5915a282d54-kube-api-access-b4t6s" (OuterVolumeSpecName: "kube-api-access-b4t6s") pod "ce9f4e67-c318-4ce5-99b0-e5915a282d54" (UID: "ce9f4e67-c318-4ce5-99b0-e5915a282d54"). InnerVolumeSpecName "kube-api-access-b4t6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:44:18.632539 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.632509    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce9f4e67-c318-4ce5-99b0-e5915a282d54-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ce9f4e67-c318-4ce5-99b0-e5915a282d54" (UID: "ce9f4e67-c318-4ce5-99b0-e5915a282d54"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:44:18.721505 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.721471    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9f4e67-c318-4ce5-99b0-e5915a282d54-tls-cert\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:44:18.721505 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:18.721501    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4t6s\" (UniqueName: \"kubernetes.io/projected/ce9f4e67-c318-4ce5-99b0-e5915a282d54-kube-api-access-b4t6s\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:44:19.141488 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.141444    2568 generic.go:356] "Generic (PLEG): container finished" podID="ce9f4e67-c318-4ce5-99b0-e5915a282d54" containerID="f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2" exitCode=0
Jul 08 21:44:19.141983 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.141504    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b8dff69d-4ldx6"
Jul 08 21:44:19.141983 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.141576    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b8dff69d-4ldx6" event={"ID":"ce9f4e67-c318-4ce5-99b0-e5915a282d54","Type":"ContainerDied","Data":"f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2"}
Jul 08 21:44:19.141983 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.141612    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85b8dff69d-4ldx6" event={"ID":"ce9f4e67-c318-4ce5-99b0-e5915a282d54","Type":"ContainerDied","Data":"8ad21a53cc1d0cb5c589e772b652262cf386c5bfdd7a7cf69766f847cf18db16"}
Jul 08 21:44:19.141983 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.141634    2568 scope.go:117] "RemoveContainer" containerID="f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2"
Jul 08 21:44:19.152594 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.152575    2568 scope.go:117] "RemoveContainer" containerID="f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2"
Jul 08 21:44:19.152929 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:44:19.152902    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2\": container with ID starting with f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2 not found: ID does not exist" containerID="f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2"
Jul 08 21:44:19.153018 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.152942    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2"} err="failed to get container status \"f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2\": rpc error: code = NotFound desc = could not find container \"f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2\": container with ID starting with f08cdd09a6c40f60d76f87de4a8e04fd3e51bfb71e025b9069e19082ad5bb6d2 not found: ID does not exist"
Jul 08 21:44:19.158612 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.158589    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85b8dff69d-4ldx6"]
Jul 08 21:44:19.160538 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:19.160519    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85b8dff69d-4ldx6"]
Jul 08 21:44:20.630096 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:44:20.630067    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce9f4e67-c318-4ce5-99b0-e5915a282d54" path="/var/lib/kubelet/pods/ce9f4e67-c318-4ce5-99b0-e5915a282d54/volumes"
Jul 08 21:45:28.640917 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:28.640883    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c9fb9975-w8l4b"]
Jul 08 21:45:28.641513 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:28.641069    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8c9fb9975-w8l4b" podUID="d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" containerName="manager" containerID="cri-o://a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860" gracePeriod=30
Jul 08 21:45:28.917077 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:28.917049    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:45:29.046047 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.046017    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-webhook-cert\") pod \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") "
Jul 08 21:45:29.046232 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.046146    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4rdw\" (UniqueName: \"kubernetes.io/projected/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-kube-api-access-q4rdw\") pod \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\" (UID: \"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a\") "
Jul 08 21:45:29.048117 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.048090    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-kube-api-access-q4rdw" (OuterVolumeSpecName: "kube-api-access-q4rdw") pod "d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" (UID: "d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a"). InnerVolumeSpecName "kube-api-access-q4rdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:45:29.048223 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.048125    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" (UID: "d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:45:29.147067 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.146979    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4rdw\" (UniqueName: \"kubernetes.io/projected/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-kube-api-access-q4rdw\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:45:29.147067 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.147006    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a-webhook-cert\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:45:29.513110 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.513072    2568 generic.go:356] "Generic (PLEG): container finished" podID="d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" containerID="a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860" exitCode=0
Jul 08 21:45:29.513277 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.513116    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9fb9975-w8l4b"
Jul 08 21:45:29.513277 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.513160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9fb9975-w8l4b" event={"ID":"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a","Type":"ContainerDied","Data":"a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860"}
Jul 08 21:45:29.513277 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.513238    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9fb9975-w8l4b" event={"ID":"d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a","Type":"ContainerDied","Data":"ec3a3187b39961beb3bc507cb0f39f204ee21a363608f7be6e974e8dd38fbabb"}
Jul 08 21:45:29.513277 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.513265    2568 scope.go:117] "RemoveContainer" containerID="a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860"
Jul 08 21:45:29.523173 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.523157    2568 scope.go:117] "RemoveContainer" containerID="a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860"
Jul 08 21:45:29.523472 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:45:29.523455    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860\": container with ID starting with a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860 not found: ID does not exist" containerID="a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860"
Jul 08 21:45:29.523535 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.523482    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860"} err="failed to get container status \"a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860\": rpc error: code = NotFound desc = could not find container \"a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860\": container with ID starting with a88948a3ca9810197ae8996e9268ddbd57e113fc4300ad3556e8a89776727860 not found: ID does not exist"
Jul 08 21:45:29.535051 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.535030    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c9fb9975-w8l4b"]
Jul 08 21:45:29.539381 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:29.539361    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c9fb9975-w8l4b"]
Jul 08 21:45:30.402270 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.402237    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c9fb9975-qwbff"]
Jul 08 21:45:30.402704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.402673    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9f4e67-c318-4ce5-99b0-e5915a282d54" containerName="authorino"
Jul 08 21:45:30.402704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.402686    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9f4e67-c318-4ce5-99b0-e5915a282d54" containerName="authorino"
Jul 08 21:45:30.402704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.402694    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" containerName="manager"
Jul 08 21:45:30.402704 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.402699    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" containerName="manager"
Jul 08 21:45:30.402858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.402758    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9f4e67-c318-4ce5-99b0-e5915a282d54" containerName="authorino"
Jul 08 21:45:30.402858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.402767    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" containerName="manager"
Jul 08 21:45:30.405762 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.405746    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.408655 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.408631    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 21:45:30.409821 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.409805    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z6f8q\""
Jul 08 21:45:30.409821 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.409821    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 21:45:30.414220 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.414198    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9fb9975-qwbff"]
Jul 08 21:45:30.458949 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.458912    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fd330ce-aab6-4b88-b087-801b3cb44e40-webhook-cert\") pod \"maas-controller-8c9fb9975-qwbff\" (UID: \"8fd330ce-aab6-4b88-b087-801b3cb44e40\") " pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.459098 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.458960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b6ww\" (UniqueName: \"kubernetes.io/projected/8fd330ce-aab6-4b88-b087-801b3cb44e40-kube-api-access-8b6ww\") pod \"maas-controller-8c9fb9975-qwbff\" (UID: \"8fd330ce-aab6-4b88-b087-801b3cb44e40\") " pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.559701 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.559665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fd330ce-aab6-4b88-b087-801b3cb44e40-webhook-cert\") pod \"maas-controller-8c9fb9975-qwbff\" (UID: \"8fd330ce-aab6-4b88-b087-801b3cb44e40\") " pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.559858 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.559710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b6ww\" (UniqueName: \"kubernetes.io/projected/8fd330ce-aab6-4b88-b087-801b3cb44e40-kube-api-access-8b6ww\") pod \"maas-controller-8c9fb9975-qwbff\" (UID: \"8fd330ce-aab6-4b88-b087-801b3cb44e40\") " pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.561944 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.561917    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fd330ce-aab6-4b88-b087-801b3cb44e40-webhook-cert\") pod \"maas-controller-8c9fb9975-qwbff\" (UID: \"8fd330ce-aab6-4b88-b087-801b3cb44e40\") " pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.567534 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.567511    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b6ww\" (UniqueName: \"kubernetes.io/projected/8fd330ce-aab6-4b88-b087-801b3cb44e40-kube-api-access-8b6ww\") pod \"maas-controller-8c9fb9975-qwbff\" (UID: \"8fd330ce-aab6-4b88-b087-801b3cb44e40\") " pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.630346 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.630319    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a" path="/var/lib/kubelet/pods/d2cc96b1-ccc1-4cae-aa40-5d60f7e6f07a/volumes"
Jul 08 21:45:30.717131 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.717051    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:30.851502 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:30.851471    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9fb9975-qwbff"]
Jul 08 21:45:30.853602 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:45:30.853573    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd330ce_aab6_4b88_b087_801b3cb44e40.slice/crio-e53fb51aa3762f57447e2cb988a5e658987d109f279eebc8de64fa9c5eb6fbf0 WatchSource:0}: Error finding container e53fb51aa3762f57447e2cb988a5e658987d109f279eebc8de64fa9c5eb6fbf0: Status 404 returned error can't find the container with id e53fb51aa3762f57447e2cb988a5e658987d109f279eebc8de64fa9c5eb6fbf0
Jul 08 21:45:31.525655 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:31.525616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9fb9975-qwbff" event={"ID":"8fd330ce-aab6-4b88-b087-801b3cb44e40","Type":"ContainerStarted","Data":"fa251651a510dbe29365295762525faac9adb3355aabd10c733d035fc48ba020"}
Jul 08 21:45:31.526110 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:31.525671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9fb9975-qwbff" event={"ID":"8fd330ce-aab6-4b88-b087-801b3cb44e40","Type":"ContainerStarted","Data":"e53fb51aa3762f57447e2cb988a5e658987d109f279eebc8de64fa9c5eb6fbf0"}
Jul 08 21:45:31.526110 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:31.525702    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:45:31.544176 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:31.544128    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c9fb9975-qwbff" podStartSLOduration=1.075267024 podStartE2EDuration="1.544109767s" totalImagesPullingTime="468.842743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:45:31.543553552 +0000 UTC m=+777.433334578" watchObservedRunningTime="2026-07-08 21:45:31.544109767 +0000 UTC m=+777.433890793"
Jul 08 21:45:42.536212 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:45:42.536182    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c9fb9975-qwbff"
Jul 08 21:47:34.582682 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:47:34.582604    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:47:34.586140 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:47:34.586117    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:47:34.589707 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:47:34.589685    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:47:34.592361 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:47:34.592345    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:52:34.623584 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:52:34.623448    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:52:34.631045 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:52:34.631025    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:52:34.631556 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:52:34.631536    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:52:34.634383 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:52:34.634365    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:57:30.342820 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.342783    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"]
Jul 08 21:57:30.346844 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.346819    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.349659 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.349637    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-36ae606b-serving-cert\""
Jul 08 21:57:30.360598 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.360572    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"]
Jul 08 21:57:30.432591 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.432549    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-openshift-service-ca\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.432786 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.432617    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs4h8\" (UniqueName: \"kubernetes.io/projected/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-kube-api-access-bs4h8\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.432786 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.432669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-maas-api-tls\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.533854 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.533820    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-openshift-service-ca\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.534032 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.533896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs4h8\" (UniqueName: \"kubernetes.io/projected/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-kube-api-access-bs4h8\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.534032 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.533925    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-maas-api-tls\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.534619 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.534589    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-openshift-service-ca\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.536387 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.536365    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-maas-api-tls\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.541946 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.541922    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs4h8\" (UniqueName: \"kubernetes.io/projected/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-kube-api-access-bs4h8\") pod \"maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.657350 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.657264    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:30.804218 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.804184    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"]
Jul 08 21:57:30.806444 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:57:30.806386    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7f7254_de42_4c79_b06a_0a6ab74b45a5.slice/crio-9efb2a09bdd5028d70135cae678151882faf1c23c69589bbaa1bd836c82eb188 WatchSource:0}: Error finding container 9efb2a09bdd5028d70135cae678151882faf1c23c69589bbaa1bd836c82eb188: Status 404 returned error can't find the container with id 9efb2a09bdd5028d70135cae678151882faf1c23c69589bbaa1bd836c82eb188
Jul 08 21:57:30.808191 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:30.808176    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:57:31.238980 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:31.238904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s" event={"ID":"ce7f7254-de42-4c79-b06a-0a6ab74b45a5","Type":"ContainerStarted","Data":"9efb2a09bdd5028d70135cae678151882faf1c23c69589bbaa1bd836c82eb188"}
Jul 08 21:57:32.245249 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:32.245213    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s" event={"ID":"ce7f7254-de42-4c79-b06a-0a6ab74b45a5","Type":"ContainerStarted","Data":"02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef"}
Jul 08 21:57:32.245755 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:32.245311    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:32.263511 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:32.263464    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s" podStartSLOduration=1.807453115 podStartE2EDuration="2.263449103s" totalImagesPullingTime="455.995988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:57:32.261287094 +0000 UTC m=+1498.151068119" watchObservedRunningTime="2026-07-08 21:57:32.263449103 +0000 UTC m=+1498.153230128"
Jul 08 21:57:34.662179 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:34.662059    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:57:34.663432 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:34.663141    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 21:57:34.664819 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:34.664799    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:57:34.666102 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:34.666078    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 21:57:35.798783 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:35.798744    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"]
Jul 08 21:57:35.799327 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:35.799019    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s" podUID="ce7f7254-de42-4c79-b06a-0a6ab74b45a5" containerName="maas-api" containerID="cri-o://02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef" gracePeriod=30
Jul 08 21:57:36.060957 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.060898    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:36.080663 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.080630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs4h8\" (UniqueName: \"kubernetes.io/projected/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-kube-api-access-bs4h8\") pod \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") "
Jul 08 21:57:36.080837 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.080736    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-openshift-service-ca\") pod \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") "
Jul 08 21:57:36.080837 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.080760    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-maas-api-tls\") pod \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\" (UID: \"ce7f7254-de42-4c79-b06a-0a6ab74b45a5\") "
Jul 08 21:57:36.081198 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.081162    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce7f7254-de42-4c79-b06a-0a6ab74b45a5" (UID: "ce7f7254-de42-4c79-b06a-0a6ab74b45a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:57:36.082992 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.082960    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce7f7254-de42-4c79-b06a-0a6ab74b45a5" (UID: "ce7f7254-de42-4c79-b06a-0a6ab74b45a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:57:36.083099 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.083062    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-kube-api-access-bs4h8" (OuterVolumeSpecName: "kube-api-access-bs4h8") pod "ce7f7254-de42-4c79-b06a-0a6ab74b45a5" (UID: "ce7f7254-de42-4c79-b06a-0a6ab74b45a5"). InnerVolumeSpecName "kube-api-access-bs4h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:57:36.181720 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.181688    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-openshift-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:57:36.181720 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.181718    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-maas-api-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:57:36.181720 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.181728    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs4h8\" (UniqueName: \"kubernetes.io/projected/ce7f7254-de42-4c79-b06a-0a6ab74b45a5-kube-api-access-bs4h8\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:57:36.267780 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.267743    2568 generic.go:356] "Generic (PLEG): container finished" podID="ce7f7254-de42-4c79-b06a-0a6ab74b45a5" containerID="02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef" exitCode=0
Jul 08 21:57:36.267965 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.267787    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"
Jul 08 21:57:36.267965 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.267785    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s" event={"ID":"ce7f7254-de42-4c79-b06a-0a6ab74b45a5","Type":"ContainerDied","Data":"02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef"}
Jul 08 21:57:36.267965 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.267909    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s" event={"ID":"ce7f7254-de42-4c79-b06a-0a6ab74b45a5","Type":"ContainerDied","Data":"9efb2a09bdd5028d70135cae678151882faf1c23c69589bbaa1bd836c82eb188"}
Jul 08 21:57:36.267965 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.267937    2568 scope.go:117] "RemoveContainer" containerID="02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef"
Jul 08 21:57:36.284338 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.284304    2568 scope.go:117] "RemoveContainer" containerID="02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef"
Jul 08 21:57:36.284726 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:57:36.284703    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef\": container with ID starting with 02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef not found: ID does not exist" containerID="02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef"
Jul 08 21:57:36.284829 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.284735    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef"} err="failed to get container status \"02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef\": rpc error: code = NotFound desc = could not find container \"02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef\": container with ID starting with 02e2f0f27b48723539ce30b2b7576a6dad8a034d726dc0a31f1ce22d119d32ef not found: ID does not exist"
Jul 08 21:57:36.296065 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.296040    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"]
Jul 08 21:57:36.298886 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.298864    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-36ae606b-5947fb9c9d-fc98s"]
Jul 08 21:57:36.630717 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:36.630685    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce7f7254-de42-4c79-b06a-0a6ab74b45a5" path="/var/lib/kubelet/pods/ce7f7254-de42-4c79-b06a-0a6ab74b45a5/volumes"
Jul 08 21:57:43.223109 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.223074    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"]
Jul 08 21:57:43.223725 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.223710    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce7f7254-de42-4c79-b06a-0a6ab74b45a5" containerName="maas-api"
Jul 08 21:57:43.223776 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.223729    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce7f7254-de42-4c79-b06a-0a6ab74b45a5" containerName="maas-api"
Jul 08 21:57:43.223898 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.223887    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce7f7254-de42-4c79-b06a-0a6ab74b45a5" containerName="maas-api"
Jul 08 21:57:43.228907 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.228884    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.232206 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.232179    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e369240b-serving-cert\""
Jul 08 21:57:43.241881 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.241855    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"]
Jul 08 21:57:43.246654 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.246627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.246778 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.246731    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pk55\" (UniqueName: \"kubernetes.io/projected/4743b4df-fc57-4efa-956a-8f361bdfaa35-kube-api-access-4pk55\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.246847 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.246798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743b4df-fc57-4efa-956a-8f361bdfaa35-openshift-service-ca\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.347525 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.347489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.347737 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.347553    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pk55\" (UniqueName: \"kubernetes.io/projected/4743b4df-fc57-4efa-956a-8f361bdfaa35-kube-api-access-4pk55\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.347737 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.347588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743b4df-fc57-4efa-956a-8f361bdfaa35-openshift-service-ca\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.347737 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:57:43.347684    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-serving-cert: secret "maas-api-e2e-ait-e369240b-serving-cert" not found
Jul 08 21:57:43.347912 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:57:43.347803    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls podName:4743b4df-fc57-4efa-956a-8f361bdfaa35 nodeName:}" failed. No retries permitted until 2026-07-08 21:57:43.847781721 +0000 UTC m=+1509.737562739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls") pod "maas-api-e2e-ait-e369240b-64df579ff4-d5knr" (UID: "4743b4df-fc57-4efa-956a-8f361bdfaa35") : secret "maas-api-e2e-ait-e369240b-serving-cert" not found
Jul 08 21:57:43.348203 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.348183    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743b4df-fc57-4efa-956a-8f361bdfaa35-openshift-service-ca\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.362163 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.362132    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pk55\" (UniqueName: \"kubernetes.io/projected/4743b4df-fc57-4efa-956a-8f361bdfaa35-kube-api-access-4pk55\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.853364 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.853329    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:43.855744 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:43.855711    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls\") pod \"maas-api-e2e-ait-e369240b-64df579ff4-d5knr\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:44.141165 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:44.141062    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:44.290824 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:44.290732    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"]
Jul 08 21:57:44.293366 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:57:44.293339    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4743b4df_fc57_4efa_956a_8f361bdfaa35.slice/crio-de5ed91d0d6569915d218a33905463ec20b0dc786e3655a568ed945cc3b38c65 WatchSource:0}: Error finding container de5ed91d0d6569915d218a33905463ec20b0dc786e3655a568ed945cc3b38c65: Status 404 returned error can't find the container with id de5ed91d0d6569915d218a33905463ec20b0dc786e3655a568ed945cc3b38c65
Jul 08 21:57:44.312959 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:44.312928    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr" event={"ID":"4743b4df-fc57-4efa-956a-8f361bdfaa35","Type":"ContainerStarted","Data":"de5ed91d0d6569915d218a33905463ec20b0dc786e3655a568ed945cc3b38c65"}
Jul 08 21:57:45.319367 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:45.319333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr" event={"ID":"4743b4df-fc57-4efa-956a-8f361bdfaa35","Type":"ContainerStarted","Data":"8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d"}
Jul 08 21:57:45.319782 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:45.319399    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:45.338301 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:45.338237    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr" podStartSLOduration=1.9901204479999999 podStartE2EDuration="2.338215554s" totalImagesPullingTime="348.095106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:57:45.337927161 +0000 UTC m=+1511.227708223" watchObservedRunningTime="2026-07-08 21:57:45.338215554 +0000 UTC m=+1511.227996580"
Jul 08 21:57:48.473088 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.473048    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"]
Jul 08 21:57:48.473548 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.473236    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr" podUID="4743b4df-fc57-4efa-956a-8f361bdfaa35" containerName="maas-api" containerID="cri-o://8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d" gracePeriod=30
Jul 08 21:57:48.739172 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.739112    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:48.798998 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.798964    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pk55\" (UniqueName: \"kubernetes.io/projected/4743b4df-fc57-4efa-956a-8f361bdfaa35-kube-api-access-4pk55\") pod \"4743b4df-fc57-4efa-956a-8f361bdfaa35\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") "
Jul 08 21:57:48.799201 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.799037    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743b4df-fc57-4efa-956a-8f361bdfaa35-openshift-service-ca\") pod \"4743b4df-fc57-4efa-956a-8f361bdfaa35\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") "
Jul 08 21:57:48.799201 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.799132    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls\") pod \"4743b4df-fc57-4efa-956a-8f361bdfaa35\" (UID: \"4743b4df-fc57-4efa-956a-8f361bdfaa35\") "
Jul 08 21:57:48.799482 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.799404    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4743b4df-fc57-4efa-956a-8f361bdfaa35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4743b4df-fc57-4efa-956a-8f361bdfaa35" (UID: "4743b4df-fc57-4efa-956a-8f361bdfaa35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:57:48.801167 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.801143    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4743b4df-fc57-4efa-956a-8f361bdfaa35" (UID: "4743b4df-fc57-4efa-956a-8f361bdfaa35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:57:48.801242 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.801207    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4743b4df-fc57-4efa-956a-8f361bdfaa35-kube-api-access-4pk55" (OuterVolumeSpecName: "kube-api-access-4pk55") pod "4743b4df-fc57-4efa-956a-8f361bdfaa35" (UID: "4743b4df-fc57-4efa-956a-8f361bdfaa35"). InnerVolumeSpecName "kube-api-access-4pk55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:57:48.900381 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.900335    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4743b4df-fc57-4efa-956a-8f361bdfaa35-maas-api-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:57:48.900381 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.900368    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pk55\" (UniqueName: \"kubernetes.io/projected/4743b4df-fc57-4efa-956a-8f361bdfaa35-kube-api-access-4pk55\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:57:48.900381 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:48.900381    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743b4df-fc57-4efa-956a-8f361bdfaa35-openshift-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:57:49.348148 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.348107    2568 generic.go:356] "Generic (PLEG): container finished" podID="4743b4df-fc57-4efa-956a-8f361bdfaa35" containerID="8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d" exitCode=0
Jul 08 21:57:49.348331 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.348163    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"
Jul 08 21:57:49.348331 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.348195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr" event={"ID":"4743b4df-fc57-4efa-956a-8f361bdfaa35","Type":"ContainerDied","Data":"8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d"}
Jul 08 21:57:49.348331 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.348269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr" event={"ID":"4743b4df-fc57-4efa-956a-8f361bdfaa35","Type":"ContainerDied","Data":"de5ed91d0d6569915d218a33905463ec20b0dc786e3655a568ed945cc3b38c65"}
Jul 08 21:57:49.348331 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.348292    2568 scope.go:117] "RemoveContainer" containerID="8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d"
Jul 08 21:57:49.357930 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.357909    2568 scope.go:117] "RemoveContainer" containerID="8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d"
Jul 08 21:57:49.358198 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:57:49.358181    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d\": container with ID starting with 8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d not found: ID does not exist" containerID="8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d"
Jul 08 21:57:49.358250 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.358206    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d"} err="failed to get container status \"8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d\": rpc error: code = NotFound desc = could not find container \"8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d\": container with ID starting with 8e039831fa8c70f4c0ea299bc8e94856f21a5186ed0e06563ab5efaf2fd9448d not found: ID does not exist"
Jul 08 21:57:49.371198 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.371169    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"]
Jul 08 21:57:49.374472 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:49.374447    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e369240b-64df579ff4-d5knr"]
Jul 08 21:57:50.630453 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:57:50.630396    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4743b4df-fc57-4efa-956a-8f361bdfaa35" path="/var/lib/kubelet/pods/4743b4df-fc57-4efa-956a-8f361bdfaa35/volumes"
Jul 08 21:58:01.577885 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.577847    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"]
Jul 08 21:58:01.578594 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.578576    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4743b4df-fc57-4efa-956a-8f361bdfaa35" containerName="maas-api"
Jul 08 21:58:01.578679 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.578598    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4743b4df-fc57-4efa-956a-8f361bdfaa35" containerName="maas-api"
Jul 08 21:58:01.578747 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.578735    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4743b4df-fc57-4efa-956a-8f361bdfaa35" containerName="maas-api"
Jul 08 21:58:01.583593 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.583573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.586285 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.586266    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-bfd8243f-serving-cert\""
Jul 08 21:58:01.589771 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.589751    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"]
Jul 08 21:58:01.721767 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.721725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0886c99f-227a-4d7f-947a-c1e0e86995d3-openshift-service-ca\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.721985 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.721784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.721985 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.721823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rq88\" (UniqueName: \"kubernetes.io/projected/0886c99f-227a-4d7f-947a-c1e0e86995d3-kube-api-access-2rq88\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.823092 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.823044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0886c99f-227a-4d7f-947a-c1e0e86995d3-openshift-service-ca\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.823314 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.823106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.823314 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.823149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rq88\" (UniqueName: \"kubernetes.io/projected/0886c99f-227a-4d7f-947a-c1e0e86995d3-kube-api-access-2rq88\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.823314 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:58:01.823287    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-serving-cert: secret "maas-api-e2e-derive-bfd8243f-serving-cert" not found
Jul 08 21:58:01.823530 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:58:01.823367    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls podName:0886c99f-227a-4d7f-947a-c1e0e86995d3 nodeName:}" failed. No retries permitted until 2026-07-08 21:58:02.323346629 +0000 UTC m=+1528.213127652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls") pod "maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb" (UID: "0886c99f-227a-4d7f-947a-c1e0e86995d3") : secret "maas-api-e2e-derive-bfd8243f-serving-cert" not found
Jul 08 21:58:01.823772 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.823751    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0886c99f-227a-4d7f-947a-c1e0e86995d3-openshift-service-ca\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:01.838191 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:01.838114    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rq88\" (UniqueName: \"kubernetes.io/projected/0886c99f-227a-4d7f-947a-c1e0e86995d3-kube-api-access-2rq88\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:02.329267 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:02.329209    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:02.331920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:02.331896    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls\") pod \"maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:02.495774 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:02.495729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:02.651393 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:02.651367    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"]
Jul 08 21:58:02.653467 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:58:02.653439    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0886c99f_227a_4d7f_947a_c1e0e86995d3.slice/crio-4cc25452fcef3a801baabdeb9c3f5223d6d165ff8e41be0cbb5436c6fc3d9ee3 WatchSource:0}: Error finding container 4cc25452fcef3a801baabdeb9c3f5223d6d165ff8e41be0cbb5436c6fc3d9ee3: Status 404 returned error can't find the container with id 4cc25452fcef3a801baabdeb9c3f5223d6d165ff8e41be0cbb5436c6fc3d9ee3
Jul 08 21:58:03.432475 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:03.432354    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb" event={"ID":"0886c99f-227a-4d7f-947a-c1e0e86995d3","Type":"ContainerStarted","Data":"a741288f72ea5aabe2a48f813aa3ded2e78909937cc84aa3cb2f4fba29e39e48"}
Jul 08 21:58:03.432475 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:03.432434    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb" event={"ID":"0886c99f-227a-4d7f-947a-c1e0e86995d3","Type":"ContainerStarted","Data":"4cc25452fcef3a801baabdeb9c3f5223d6d165ff8e41be0cbb5436c6fc3d9ee3"}
Jul 08 21:58:03.432475 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:03.432465    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:03.449773 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:03.449716    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb" podStartSLOduration=2.06296436 podStartE2EDuration="2.449698713s" totalImagesPullingTime="386.734353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:58:03.449215165 +0000 UTC m=+1529.338996204" watchObservedRunningTime="2026-07-08 21:58:03.449698713 +0000 UTC m=+1529.339479738"
Jul 08 21:58:06.214814 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.214765    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"]
Jul 08 21:58:06.215482 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.215007    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb" podUID="0886c99f-227a-4d7f-947a-c1e0e86995d3" containerName="maas-api" containerID="cri-o://a741288f72ea5aabe2a48f813aa3ded2e78909937cc84aa3cb2f4fba29e39e48" gracePeriod=30
Jul 08 21:58:06.451137 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.451106    2568 generic.go:356] "Generic (PLEG): container finished" podID="0886c99f-227a-4d7f-947a-c1e0e86995d3" containerID="a741288f72ea5aabe2a48f813aa3ded2e78909937cc84aa3cb2f4fba29e39e48" exitCode=0
Jul 08 21:58:06.451308 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.451188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb" event={"ID":"0886c99f-227a-4d7f-947a-c1e0e86995d3","Type":"ContainerDied","Data":"a741288f72ea5aabe2a48f813aa3ded2e78909937cc84aa3cb2f4fba29e39e48"}
Jul 08 21:58:06.476480 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.476393    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:06.569920 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.569881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0886c99f-227a-4d7f-947a-c1e0e86995d3-openshift-service-ca\") pod \"0886c99f-227a-4d7f-947a-c1e0e86995d3\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") "
Jul 08 21:58:06.570125 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.569939    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rq88\" (UniqueName: \"kubernetes.io/projected/0886c99f-227a-4d7f-947a-c1e0e86995d3-kube-api-access-2rq88\") pod \"0886c99f-227a-4d7f-947a-c1e0e86995d3\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") "
Jul 08 21:58:06.570125 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.569984    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls\") pod \"0886c99f-227a-4d7f-947a-c1e0e86995d3\" (UID: \"0886c99f-227a-4d7f-947a-c1e0e86995d3\") "
Jul 08 21:58:06.570356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.570330    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0886c99f-227a-4d7f-947a-c1e0e86995d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0886c99f-227a-4d7f-947a-c1e0e86995d3" (UID: "0886c99f-227a-4d7f-947a-c1e0e86995d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:58:06.572117 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.572097    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0886c99f-227a-4d7f-947a-c1e0e86995d3" (UID: "0886c99f-227a-4d7f-947a-c1e0e86995d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:58:06.572185 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.572141    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0886c99f-227a-4d7f-947a-c1e0e86995d3-kube-api-access-2rq88" (OuterVolumeSpecName: "kube-api-access-2rq88") pod "0886c99f-227a-4d7f-947a-c1e0e86995d3" (UID: "0886c99f-227a-4d7f-947a-c1e0e86995d3"). InnerVolumeSpecName "kube-api-access-2rq88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:58:06.670829 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.670788    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0886c99f-227a-4d7f-947a-c1e0e86995d3-openshift-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:58:06.670829 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.670822    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rq88\" (UniqueName: \"kubernetes.io/projected/0886c99f-227a-4d7f-947a-c1e0e86995d3-kube-api-access-2rq88\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:58:06.670829 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:06.670836    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0886c99f-227a-4d7f-947a-c1e0e86995d3-maas-api-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 21:58:07.457169 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:07.457133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb" event={"ID":"0886c99f-227a-4d7f-947a-c1e0e86995d3","Type":"ContainerDied","Data":"4cc25452fcef3a801baabdeb9c3f5223d6d165ff8e41be0cbb5436c6fc3d9ee3"}
Jul 08 21:58:07.457169 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:07.457172    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"
Jul 08 21:58:07.457683 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:07.457202    2568 scope.go:117] "RemoveContainer" containerID="a741288f72ea5aabe2a48f813aa3ded2e78909937cc84aa3cb2f4fba29e39e48"
Jul 08 21:58:07.474352 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:07.474325    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"]
Jul 08 21:58:07.478143 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:07.478118    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfd8243f-68b78fdf4f-zsgpb"]
Jul 08 21:58:08.631304 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:58:08.631271    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0886c99f-227a-4d7f-947a-c1e0e86995d3" path="/var/lib/kubelet/pods/0886c99f-227a-4d7f-947a-c1e0e86995d3/volumes"
Jul 08 21:59:49.490685 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.490592    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"]
Jul 08 21:59:49.491271 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.491253    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0886c99f-227a-4d7f-947a-c1e0e86995d3" containerName="maas-api"
Jul 08 21:59:49.491342 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.491274    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0886c99f-227a-4d7f-947a-c1e0e86995d3" containerName="maas-api"
Jul 08 21:59:49.491396 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.491385    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0886c99f-227a-4d7f-947a-c1e0e86995d3" containerName="maas-api"
Jul 08 21:59:49.494857 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.494840    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.497527 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.497504    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6c8ebf0a-serving-cert\""
Jul 08 21:59:49.505799 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.505780    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"]
Jul 08 21:59:49.531665 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.531633    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.531665 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.531663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-openshift-service-ca\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.531916 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.531700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6jwf\" (UniqueName: \"kubernetes.io/projected/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-kube-api-access-p6jwf\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.633031 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.632999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6jwf\" (UniqueName: \"kubernetes.io/projected/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-kube-api-access-p6jwf\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.633210 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.633101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.633210 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.633119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-openshift-service-ca\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.633337 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:59:49.633241    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-serving-cert: secret "maas-api-e2e-mt-6c8ebf0a-serving-cert" not found
Jul 08 21:59:49.633337 ip-10-0-131-2 kubenswrapper[2568]: E0708 21:59:49.633315    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls podName:7c948085-7ab1-4863-9ae9-b6c87b80f0f9 nodeName:}" failed. No retries permitted until 2026-07-08 21:59:50.133292752 +0000 UTC m=+1636.023073754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls") pod "maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76" (UID: "7c948085-7ab1-4863-9ae9-b6c87b80f0f9") : secret "maas-api-e2e-mt-6c8ebf0a-serving-cert" not found
Jul 08 21:59:49.633846 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.633825    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-openshift-service-ca\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:49.644848 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:49.644826    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6jwf\" (UniqueName: \"kubernetes.io/projected/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-kube-api-access-p6jwf\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:50.138436 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:50.138375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:50.141000 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:50.140972    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls\") pod \"maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:50.407522 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:50.407388    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:50.547446 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:50.547398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"]
Jul 08 21:59:50.549911 ip-10-0-131-2 kubenswrapper[2568]: W0708 21:59:50.549885    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c948085_7ab1_4863_9ae9_b6c87b80f0f9.slice/crio-dc7d6c8a6b689b253ddb69a7066e286066dc63dac5a07d702d0d2f8660f89664 WatchSource:0}: Error finding container dc7d6c8a6b689b253ddb69a7066e286066dc63dac5a07d702d0d2f8660f89664: Status 404 returned error can't find the container with id dc7d6c8a6b689b253ddb69a7066e286066dc63dac5a07d702d0d2f8660f89664
Jul 08 21:59:50.993165 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:50.993120    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76" event={"ID":"7c948085-7ab1-4863-9ae9-b6c87b80f0f9","Type":"ContainerStarted","Data":"dc7d6c8a6b689b253ddb69a7066e286066dc63dac5a07d702d0d2f8660f89664"}
Jul 08 21:59:51.999356 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:51.999313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76" event={"ID":"7c948085-7ab1-4863-9ae9-b6c87b80f0f9","Type":"ContainerStarted","Data":"ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9"}
Jul 08 21:59:51.999779 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:51.999461    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 21:59:52.017001 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:52.016956    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76" podStartSLOduration=2.484101111 podStartE2EDuration="3.016942221s" totalImagesPullingTime="532.84111ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:59:52.015051641 +0000 UTC m=+1637.904832666" watchObservedRunningTime="2026-07-08 21:59:52.016942221 +0000 UTC m=+1637.906723246"
Jul 08 21:59:58.010474 ip-10-0-131-2 kubenswrapper[2568]: I0708 21:59:58.010443    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 22:00:00.130820 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.130778    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"]
Jul 08 22:00:00.134784 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.134760    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"
Jul 08 22:00:00.143044 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.143019    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"]
Jul 08 22:00:00.231930 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.231893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wdp\" (UniqueName: \"kubernetes.io/projected/356fd089-6ff0-4de1-98ee-7043a1bcf85a-kube-api-access-k8wdp\") pod \"maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk\" (UID: \"356fd089-6ff0-4de1-98ee-7043a1bcf85a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"
Jul 08 22:00:00.332826 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.332791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wdp\" (UniqueName: \"kubernetes.io/projected/356fd089-6ff0-4de1-98ee-7043a1bcf85a-kube-api-access-k8wdp\") pod \"maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk\" (UID: \"356fd089-6ff0-4de1-98ee-7043a1bcf85a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"
Jul 08 22:00:00.342608 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.342580    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wdp\" (UniqueName: \"kubernetes.io/projected/356fd089-6ff0-4de1-98ee-7043a1bcf85a-kube-api-access-k8wdp\") pod \"maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk\" (UID: \"356fd089-6ff0-4de1-98ee-7043a1bcf85a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"
Jul 08 22:00:00.446747 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.446654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"
Jul 08 22:00:00.587682 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:00.587653    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"]
Jul 08 22:00:00.589933 ip-10-0-131-2 kubenswrapper[2568]: W0708 22:00:00.589908    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356fd089_6ff0_4de1_98ee_7043a1bcf85a.slice/crio-6ca8c52b1bc948c762080ba403e0d8a9aa5d5ead661db404b09d0c9706eea12e WatchSource:0}: Error finding container 6ca8c52b1bc948c762080ba403e0d8a9aa5d5ead661db404b09d0c9706eea12e: Status 404 returned error can't find the container with id 6ca8c52b1bc948c762080ba403e0d8a9aa5d5ead661db404b09d0c9706eea12e
Jul 08 22:00:01.048278 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:01.048239    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk" event={"ID":"356fd089-6ff0-4de1-98ee-7043a1bcf85a","Type":"ContainerStarted","Data":"6ca8c52b1bc948c762080ba403e0d8a9aa5d5ead661db404b09d0c9706eea12e"}
Jul 08 22:00:01.681082 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:01.681046    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"]
Jul 08 22:00:01.681584 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:01.681281    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76" podUID="7c948085-7ab1-4863-9ae9-b6c87b80f0f9" containerName="maas-api" containerID="cri-o://ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9" gracePeriod=30
Jul 08 22:00:01.711892 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:01.711862    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"]
Jul 08 22:00:01.933109 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:01.933049    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 22:00:02.049891 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.049857    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls\") pod \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") "
Jul 08 22:00:02.050056 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.049953    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6jwf\" (UniqueName: \"kubernetes.io/projected/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-kube-api-access-p6jwf\") pod \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") "
Jul 08 22:00:02.050099 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.050059    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-openshift-service-ca\") pod \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\" (UID: \"7c948085-7ab1-4863-9ae9-b6c87b80f0f9\") "
Jul 08 22:00:02.050486 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.050459    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c948085-7ab1-4863-9ae9-b6c87b80f0f9" (UID: "7c948085-7ab1-4863-9ae9-b6c87b80f0f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:00:02.052070 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.052044    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c948085-7ab1-4863-9ae9-b6c87b80f0f9" (UID: "7c948085-7ab1-4863-9ae9-b6c87b80f0f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:00:02.052335 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.052305    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-kube-api-access-p6jwf" (OuterVolumeSpecName: "kube-api-access-p6jwf") pod "7c948085-7ab1-4863-9ae9-b6c87b80f0f9" (UID: "7c948085-7ab1-4863-9ae9-b6c87b80f0f9"). InnerVolumeSpecName "kube-api-access-p6jwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:00:02.054921 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.054897    2568 generic.go:356] "Generic (PLEG): container finished" podID="7c948085-7ab1-4863-9ae9-b6c87b80f0f9" containerID="ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9" exitCode=0
Jul 08 22:00:02.055018 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.054954    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"
Jul 08 22:00:02.055018 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.054986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76" event={"ID":"7c948085-7ab1-4863-9ae9-b6c87b80f0f9","Type":"ContainerDied","Data":"ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9"}
Jul 08 22:00:02.055105 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.055051    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76" event={"ID":"7c948085-7ab1-4863-9ae9-b6c87b80f0f9","Type":"ContainerDied","Data":"dc7d6c8a6b689b253ddb69a7066e286066dc63dac5a07d702d0d2f8660f89664"}
Jul 08 22:00:02.055105 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.055084    2568 scope.go:117] "RemoveContainer" containerID="ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9"
Jul 08 22:00:02.072446 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.072426    2568 scope.go:117] "RemoveContainer" containerID="ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9"
Jul 08 22:00:02.072731 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:00:02.072711    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9\": container with ID starting with ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9 not found: ID does not exist" containerID="ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9"
Jul 08 22:00:02.072835 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.072739    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9"} err="failed to get container status \"ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9\": rpc error: code = NotFound desc = could not find container \"ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9\": container with ID starting with ead077ecb3bb8c2e8989f70a2913617cbc8d176006cc90a71c9cdbc908c3e6d9 not found: ID does not exist"
Jul 08 22:00:02.083091 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.083065    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"]
Jul 08 22:00:02.086949 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.086927    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c8ebf0a-7bcb46bcf-kpm76"]
Jul 08 22:00:02.151146 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.151103    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-openshift-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:00:02.151146 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.151142    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-maas-api-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:00:02.151146 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.151153    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6jwf\" (UniqueName: \"kubernetes.io/projected/7c948085-7ab1-4863-9ae9-b6c87b80f0f9-kube-api-access-p6jwf\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:00:02.633503 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:02.633463    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c948085-7ab1-4863-9ae9-b6c87b80f0f9" path="/var/lib/kubelet/pods/7c948085-7ab1-4863-9ae9-b6c87b80f0f9/volumes"
Jul 08 22:00:04.070602 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:04.070560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk" event={"ID":"356fd089-6ff0-4de1-98ee-7043a1bcf85a","Type":"ContainerStarted","Data":"b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed"}
Jul 08 22:00:04.071097 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:04.070622    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk" podUID="356fd089-6ff0-4de1-98ee-7043a1bcf85a" containerName="cleanup" containerID="cri-o://b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed" gracePeriod=30
Jul 08 22:00:04.087373 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:04.087322    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk" podStartSLOduration=0.909860202 podStartE2EDuration="4.08730639s" totalImagesPullingTime="3.177446188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:00:04.084736679 +0000 UTC m=+1649.974517704" watchObservedRunningTime="2026-07-08 22:00:04.08730639 +0000 UTC m=+1649.977087415"
Jul 08 22:00:04.629763 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:04.629736    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"
Jul 08 22:00:04.675334 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:04.675295    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8wdp\" (UniqueName: \"kubernetes.io/projected/356fd089-6ff0-4de1-98ee-7043a1bcf85a-kube-api-access-k8wdp\") pod \"356fd089-6ff0-4de1-98ee-7043a1bcf85a\" (UID: \"356fd089-6ff0-4de1-98ee-7043a1bcf85a\") "
Jul 08 22:00:04.677402 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:04.677368    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/356fd089-6ff0-4de1-98ee-7043a1bcf85a-kube-api-access-k8wdp" (OuterVolumeSpecName: "kube-api-access-k8wdp") pod "356fd089-6ff0-4de1-98ee-7043a1bcf85a" (UID: "356fd089-6ff0-4de1-98ee-7043a1bcf85a"). InnerVolumeSpecName "kube-api-access-k8wdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:00:04.776469 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:04.776442    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8wdp\" (UniqueName: \"kubernetes.io/projected/356fd089-6ff0-4de1-98ee-7043a1bcf85a-kube-api-access-k8wdp\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:00:05.077523 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.077440    2568 generic.go:356] "Generic (PLEG): container finished" podID="356fd089-6ff0-4de1-98ee-7043a1bcf85a" containerID="b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed" exitCode=6
Jul 08 22:00:05.077523 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.077494    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"
Jul 08 22:00:05.077973 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.077534    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk" event={"ID":"356fd089-6ff0-4de1-98ee-7043a1bcf85a","Type":"ContainerDied","Data":"b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed"}
Jul 08 22:00:05.077973 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.077585    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk" event={"ID":"356fd089-6ff0-4de1-98ee-7043a1bcf85a","Type":"ContainerDied","Data":"6ca8c52b1bc948c762080ba403e0d8a9aa5d5ead661db404b09d0c9706eea12e"}
Jul 08 22:00:05.077973 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.077613    2568 scope.go:117] "RemoveContainer" containerID="b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed"
Jul 08 22:00:05.086805 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.086787    2568 scope.go:117] "RemoveContainer" containerID="b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed"
Jul 08 22:00:05.087070 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:00:05.087051    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed\": container with ID starting with b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed not found: ID does not exist" containerID="b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed"
Jul 08 22:00:05.087114 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.087082    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed"} err="failed to get container status \"b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed\": rpc error: code = NotFound desc = could not find container \"b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed\": container with ID starting with b13a984e9987da0e9616496cc22b777b2819a6ba4a4878fef44176323a3e49ed not found: ID does not exist"
Jul 08 22:00:05.099217 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.099188    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"]
Jul 08 22:00:05.103257 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:05.103236    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6c8ebf0a-29725800-g2jqk"]
Jul 08 22:00:06.629946 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:06.629912    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="356fd089-6ff0-4de1-98ee-7043a1bcf85a" path="/var/lib/kubelet/pods/356fd089-6ff0-4de1-98ee-7043a1bcf85a/volumes"
Jul 08 22:00:30.395109 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.395065    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"]
Jul 08 22:00:30.395640 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.395588    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356fd089-6ff0-4de1-98ee-7043a1bcf85a" containerName="cleanup"
Jul 08 22:00:30.395640 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.395604    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="356fd089-6ff0-4de1-98ee-7043a1bcf85a" containerName="cleanup"
Jul 08 22:00:30.395640 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.395630    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c948085-7ab1-4863-9ae9-b6c87b80f0f9" containerName="maas-api"
Jul 08 22:00:30.395640 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.395635    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c948085-7ab1-4863-9ae9-b6c87b80f0f9" containerName="maas-api"
Jul 08 22:00:30.395796 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.395699    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="356fd089-6ff0-4de1-98ee-7043a1bcf85a" containerName="cleanup"
Jul 08 22:00:30.395796 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.395712    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c948085-7ab1-4863-9ae9-b6c87b80f0f9" containerName="maas-api"
Jul 08 22:00:30.399185 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.399168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.403140 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.403124    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e7bf8858-serving-cert\""
Jul 08 22:00:30.409094 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.409072    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7l4\" (UniqueName: \"kubernetes.io/projected/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-kube-api-access-pq7l4\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.409193 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.409104    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-openshift-service-ca\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.409193 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.409133    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-maas-api-tls\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.413223 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.413200    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"]
Jul 08 22:00:30.510692 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.510643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7l4\" (UniqueName: \"kubernetes.io/projected/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-kube-api-access-pq7l4\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.510692 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.510698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-openshift-service-ca\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.510930 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.510732    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-maas-api-tls\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.511443 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.511392    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-openshift-service-ca\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.513175 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.513147    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-maas-api-tls\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.519298 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.519274    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7l4\" (UniqueName: \"kubernetes.io/projected/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-kube-api-access-pq7l4\") pod \"maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.710324 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.710223    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:30.856229 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:30.856204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"]
Jul 08 22:00:30.858588 ip-10-0-131-2 kubenswrapper[2568]: W0708 22:00:30.858556    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0afc21c_dfc8_46b3_bf99_40c0d7b7b7a6.slice/crio-eca55e207bf902d761c82da3c05abd48974286a021122d790bbcfce2fc696bf3 WatchSource:0}: Error finding container eca55e207bf902d761c82da3c05abd48974286a021122d790bbcfce2fc696bf3: Status 404 returned error can't find the container with id eca55e207bf902d761c82da3c05abd48974286a021122d790bbcfce2fc696bf3
Jul 08 22:00:31.224350 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:31.224312    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w" event={"ID":"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6","Type":"ContainerStarted","Data":"eca55e207bf902d761c82da3c05abd48974286a021122d790bbcfce2fc696bf3"}
Jul 08 22:00:32.234005 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:32.233964    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w" event={"ID":"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6","Type":"ContainerStarted","Data":"79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6"}
Jul 08 22:00:32.234509 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:32.234094    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:00:32.253820 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:32.253738    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w" podStartSLOduration=1.787805348 podStartE2EDuration="2.253722063s" totalImagesPullingTime="465.916715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:00:32.25116986 +0000 UTC m=+1678.140950879" watchObservedRunningTime="2026-07-08 22:00:32.253722063 +0000 UTC m=+1678.143503087"
Jul 08 22:00:38.245459 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:00:38.245426    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:01:13.153440 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.153383    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"]
Jul 08 22:01:13.154371 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.154332    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w" podUID="e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" containerName="maas-api" containerID="cri-o://79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6" gracePeriod=30
Jul 08 22:01:13.240167 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.240128    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w" podUID="e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.63:8443/health\": dial tcp 10.132.0.63:8443: connect: connection refused"
Jul 08 22:01:13.409364 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.409291    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:01:13.418347 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.418319    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq7l4\" (UniqueName: \"kubernetes.io/projected/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-kube-api-access-pq7l4\") pod \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") "
Jul 08 22:01:13.418507 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.418373    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-maas-api-tls\") pod \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") "
Jul 08 22:01:13.418507 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.418399    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-openshift-service-ca\") pod \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\" (UID: \"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6\") "
Jul 08 22:01:13.418805 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.418779    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" (UID: "e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:01:13.420501 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.420469    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" (UID: "e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:01:13.420600 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.420559    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-kube-api-access-pq7l4" (OuterVolumeSpecName: "kube-api-access-pq7l4") pod "e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" (UID: "e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6"). InnerVolumeSpecName "kube-api-access-pq7l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:13.449543 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.449504    2568 generic.go:356] "Generic (PLEG): container finished" podID="e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" containerID="79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6" exitCode=0
Jul 08 22:01:13.449726 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.449555    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"
Jul 08 22:01:13.449726 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.449601    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w" event={"ID":"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6","Type":"ContainerDied","Data":"79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6"}
Jul 08 22:01:13.449726 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.449662    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w" event={"ID":"e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6","Type":"ContainerDied","Data":"eca55e207bf902d761c82da3c05abd48974286a021122d790bbcfce2fc696bf3"}
Jul 08 22:01:13.449726 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.449676    2568 scope.go:117] "RemoveContainer" containerID="79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6"
Jul 08 22:01:13.460010 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.459983    2568 scope.go:117] "RemoveContainer" containerID="79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6"
Jul 08 22:01:13.460301 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:01:13.460276    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6\": container with ID starting with 79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6 not found: ID does not exist" containerID="79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6"
Jul 08 22:01:13.460389 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.460307    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6"} err="failed to get container status \"79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6\": rpc error: code = NotFound desc = could not find container \"79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6\": container with ID starting with 79adb8743aa78284f7fbd9dec8aa087364dd2a95907efee815ce4939942ecba6 not found: ID does not exist"
Jul 08 22:01:13.472271 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.472247    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"]
Jul 08 22:01:13.476815 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.476788    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7bf8858-7974dd9f9c-cqf6w"]
Jul 08 22:01:13.519762 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.519733    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-maas-api-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:01:13.519762 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.519756    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-openshift-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:01:13.519762 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:13.519765    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq7l4\" (UniqueName: \"kubernetes.io/projected/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6-kube-api-access-pq7l4\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:01:14.630103 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:01:14.630068    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" path="/var/lib/kubelet/pods/e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6/volumes"
Jul 08 22:02:34.695672 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:02:34.695559    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 22:02:34.695672 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:02:34.695611    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 22:02:34.701824 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:02:34.698361    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 22:02:34.701824 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:02:34.698632    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 22:03:05.204426 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.204379    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"]
Jul 08 22:03:05.205028 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.205009    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" containerName="maas-api"
Jul 08 22:03:05.205074 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.205033    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" containerName="maas-api"
Jul 08 22:03:05.205211 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.205197    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0afc21c-dfc8-46b3-bf99-40c0d7b7b7a6" containerName="maas-api"
Jul 08 22:03:05.208891 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.208872    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.211536 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.211511    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0303e4-serving-cert\""
Jul 08 22:03:05.224918 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.224892    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"]
Jul 08 22:03:05.314355 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.314299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5a0038-b045-40d5-b901-4d469b4e1224-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.314573 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.314477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.314573 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.314508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkb5b\" (UniqueName: \"kubernetes.io/projected/ad5a0038-b045-40d5-b901-4d469b4e1224-kube-api-access-bkb5b\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.415625 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.415585    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5a0038-b045-40d5-b901-4d469b4e1224-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.415793 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.415713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.415793 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.415743    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkb5b\" (UniqueName: \"kubernetes.io/projected/ad5a0038-b045-40d5-b901-4d469b4e1224-kube-api-access-bkb5b\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.415916 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:03:05.415893    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-serving-cert: secret "maas-api-e2e-inf-a-0303e4-serving-cert" not found
Jul 08 22:03:05.415985 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:03:05.415975    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls podName:ad5a0038-b045-40d5-b901-4d469b4e1224 nodeName:}" failed. No retries permitted until 2026-07-08 22:03:05.915952807 +0000 UTC m=+1831.805733817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls") pod "maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" (UID: "ad5a0038-b045-40d5-b901-4d469b4e1224") : secret "maas-api-e2e-inf-a-0303e4-serving-cert" not found
Jul 08 22:03:05.416338 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.416319    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5a0038-b045-40d5-b901-4d469b4e1224-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.424569 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.424542    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkb5b\" (UniqueName: \"kubernetes.io/projected/ad5a0038-b045-40d5-b901-4d469b4e1224-kube-api-access-bkb5b\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.919519 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.919487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:05.921920 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:05.921893    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls\") pod \"maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:06.120695 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:06.120655    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:06.260951 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:06.260911    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"]
Jul 08 22:03:06.264924 ip-10-0-131-2 kubenswrapper[2568]: W0708 22:03:06.264878    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5a0038_b045_40d5_b901_4d469b4e1224.slice/crio-4e11211e128a4f08017e8c70b11e3c4bd3d3b609fa3355b02e3b5e272262dbcf WatchSource:0}: Error finding container 4e11211e128a4f08017e8c70b11e3c4bd3d3b609fa3355b02e3b5e272262dbcf: Status 404 returned error can't find the container with id 4e11211e128a4f08017e8c70b11e3c4bd3d3b609fa3355b02e3b5e272262dbcf
Jul 08 22:03:06.266456 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:06.266434    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:03:07.020959 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:07.020919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" event={"ID":"ad5a0038-b045-40d5-b901-4d469b4e1224","Type":"ContainerStarted","Data":"0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e"}
Jul 08 22:03:07.021143 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:07.020975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" event={"ID":"ad5a0038-b045-40d5-b901-4d469b4e1224","Type":"ContainerStarted","Data":"4e11211e128a4f08017e8c70b11e3c4bd3d3b609fa3355b02e3b5e272262dbcf"}
Jul 08 22:03:07.021143 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:07.021002    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:03:07.039746 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:07.039698    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" podStartSLOduration=1.624388647 podStartE2EDuration="2.039683392s" totalImagesPullingTime="415.294745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:03:07.038173738 +0000 UTC m=+1832.927954784" watchObservedRunningTime="2026-07-08 22:03:07.039683392 +0000 UTC m=+1832.929464450"
Jul 08 22:03:13.031852 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:03:13.031824    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:04:07.606713 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:07.606571    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"]
Jul 08 22:04:07.607301 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:07.606982    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" podUID="ad5a0038-b045-40d5-b901-4d469b4e1224" containerName="maas-api" containerID="cri-o://0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e" gracePeriod=30
Jul 08 22:04:08.061857 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.061827    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:04:08.181563 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.181473    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5a0038-b045-40d5-b901-4d469b4e1224-openshift-service-ca\") pod \"ad5a0038-b045-40d5-b901-4d469b4e1224\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") "
Jul 08 22:04:08.181563 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.181510    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls\") pod \"ad5a0038-b045-40d5-b901-4d469b4e1224\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") "
Jul 08 22:04:08.181750 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.181572    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkb5b\" (UniqueName: \"kubernetes.io/projected/ad5a0038-b045-40d5-b901-4d469b4e1224-kube-api-access-bkb5b\") pod \"ad5a0038-b045-40d5-b901-4d469b4e1224\" (UID: \"ad5a0038-b045-40d5-b901-4d469b4e1224\") "
Jul 08 22:04:08.181876 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.181850    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad5a0038-b045-40d5-b901-4d469b4e1224-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad5a0038-b045-40d5-b901-4d469b4e1224" (UID: "ad5a0038-b045-40d5-b901-4d469b4e1224"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:04:08.183772 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.183745    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad5a0038-b045-40d5-b901-4d469b4e1224" (UID: "ad5a0038-b045-40d5-b901-4d469b4e1224"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:04:08.183866 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.183829    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad5a0038-b045-40d5-b901-4d469b4e1224-kube-api-access-bkb5b" (OuterVolumeSpecName: "kube-api-access-bkb5b") pod "ad5a0038-b045-40d5-b901-4d469b4e1224" (UID: "ad5a0038-b045-40d5-b901-4d469b4e1224"). InnerVolumeSpecName "kube-api-access-bkb5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:04:08.282860 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.282823    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkb5b\" (UniqueName: \"kubernetes.io/projected/ad5a0038-b045-40d5-b901-4d469b4e1224-kube-api-access-bkb5b\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:04:08.282860 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.282855    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad5a0038-b045-40d5-b901-4d469b4e1224-openshift-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:04:08.282860 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.282865    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad5a0038-b045-40d5-b901-4d469b4e1224-maas-api-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:04:08.343231 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.343197    2568 generic.go:356] "Generic (PLEG): container finished" podID="ad5a0038-b045-40d5-b901-4d469b4e1224" containerID="0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e" exitCode=0
Jul 08 22:04:08.343398 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.343247    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"
Jul 08 22:04:08.343398 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.343294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" event={"ID":"ad5a0038-b045-40d5-b901-4d469b4e1224","Type":"ContainerDied","Data":"0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e"}
Jul 08 22:04:08.343398 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.343373    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" event={"ID":"ad5a0038-b045-40d5-b901-4d469b4e1224","Type":"ContainerDied","Data":"4e11211e128a4f08017e8c70b11e3c4bd3d3b609fa3355b02e3b5e272262dbcf"}
Jul 08 22:04:08.343398 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.343395    2568 scope.go:117] "RemoveContainer" containerID="0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e"
Jul 08 22:04:08.352888 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.352872    2568 scope.go:117] "RemoveContainer" containerID="0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e"
Jul 08 22:04:08.353130 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:04:08.353111    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e\": container with ID starting with 0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e not found: ID does not exist" containerID="0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e"
Jul 08 22:04:08.353166 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.353140    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e"} err="failed to get container status \"0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e\": rpc error: code = NotFound desc = could not find container \"0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e\": container with ID starting with 0bd49a461af9ca9b0ef57a87cdc19002898d35676d8360e6f3ca98524b57b28e not found: ID does not exist"
Jul 08 22:04:08.371764 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.371741    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"]
Jul 08 22:04:08.375489 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.375470    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4"]
Jul 08 22:04:08.630457 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:08.630425    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad5a0038-b045-40d5-b901-4d469b4e1224" path="/var/lib/kubelet/pods/ad5a0038-b045-40d5-b901-4d469b4e1224/volumes"
Jul 08 22:04:11.026269 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:04:11.026215    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0303e4-6dcc4897-gtll4" podUID="ad5a0038-b045-40d5-b901-4d469b4e1224" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.64:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 08 22:05:46.064539 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.064457    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"]
Jul 08 22:05:46.065145 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.065126    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad5a0038-b045-40d5-b901-4d469b4e1224" containerName="maas-api"
Jul 08 22:05:46.065145 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.065146    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad5a0038-b045-40d5-b901-4d469b4e1224" containerName="maas-api"
Jul 08 22:05:46.065293 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.065242    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad5a0038-b045-40d5-b901-4d469b4e1224" containerName="maas-api"
Jul 08 22:05:46.068746 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.068722    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.071428 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.071395    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-4df112-serving-cert\""
Jul 08 22:05:46.082624 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.082599    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"]
Jul 08 22:05:46.174956 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.174925    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.175139 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.174961    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cjb4\" (UniqueName: \"kubernetes.io/projected/9295da61-ea8c-4d37-993d-cac54a452cbe-kube-api-access-8cjb4\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.175139 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.175039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9295da61-ea8c-4d37-993d-cac54a452cbe-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.276216 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.276184    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.276216 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.276220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cjb4\" (UniqueName: \"kubernetes.io/projected/9295da61-ea8c-4d37-993d-cac54a452cbe-kube-api-access-8cjb4\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.276511 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.276245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9295da61-ea8c-4d37-993d-cac54a452cbe-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.276511 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:05:46.276357    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-serving-cert: secret "maas-api-e2e-shared-b-4df112-serving-cert" not found
Jul 08 22:05:46.276511 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:05:46.276444    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls podName:9295da61-ea8c-4d37-993d-cac54a452cbe nodeName:}" failed. No retries permitted until 2026-07-08 22:05:46.776427634 +0000 UTC m=+1992.666208637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls") pod "maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr" (UID: "9295da61-ea8c-4d37-993d-cac54a452cbe") : secret "maas-api-e2e-shared-b-4df112-serving-cert" not found
Jul 08 22:05:46.276886 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.276867    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9295da61-ea8c-4d37-993d-cac54a452cbe-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.287675 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.287650    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cjb4\" (UniqueName: \"kubernetes.io/projected/9295da61-ea8c-4d37-993d-cac54a452cbe-kube-api-access-8cjb4\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.781595 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.781547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.784208 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.784177    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls\") pod \"maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:46.983555 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:46.983518    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:47.170763 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:47.170735    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"]
Jul 08 22:05:47.173464 ip-10-0-131-2 kubenswrapper[2568]: W0708 22:05:47.173396    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9295da61_ea8c_4d37_993d_cac54a452cbe.slice/crio-2a2615e1422b12dd2e74c88225ed0a88cd5b72abb36c49478779b0045eb4469c WatchSource:0}: Error finding container 2a2615e1422b12dd2e74c88225ed0a88cd5b72abb36c49478779b0045eb4469c: Status 404 returned error can't find the container with id 2a2615e1422b12dd2e74c88225ed0a88cd5b72abb36c49478779b0045eb4469c
Jul 08 22:05:47.851721 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:47.851620    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr" event={"ID":"9295da61-ea8c-4d37-993d-cac54a452cbe","Type":"ContainerStarted","Data":"94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f"}
Jul 08 22:05:47.851721 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:47.851675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr" event={"ID":"9295da61-ea8c-4d37-993d-cac54a452cbe","Type":"ContainerStarted","Data":"2a2615e1422b12dd2e74c88225ed0a88cd5b72abb36c49478779b0045eb4469c"}
Jul 08 22:05:47.851721 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:47.851696    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:05:47.881558 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:47.881506    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr" podStartSLOduration=1.5341698049999999 podStartE2EDuration="1.88148859s" totalImagesPullingTime="347.318785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:05:47.879232476 +0000 UTC m=+1993.769013530" watchObservedRunningTime="2026-07-08 22:05:47.88148859 +0000 UTC m=+1993.771269623"
Jul 08 22:05:53.862327 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:05:53.862291    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:07:34.726406 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:07:34.726293    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 22:07:34.730464 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:07:34.728354    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 22:07:34.730464 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:07:34.729001    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 22:07:34.731067 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:07:34.731038    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4psz_afc4937a-3189-4a88-a51f-021bc1d7087f/ovn-acl-logging/0.log"
Jul 08 22:09:03.240731 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.240693    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"]
Jul 08 22:09:03.241323 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.241014    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr" podUID="9295da61-ea8c-4d37-993d-cac54a452cbe" containerName="maas-api" containerID="cri-o://94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f" gracePeriod=30
Jul 08 22:09:03.506613 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.506586    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:09:03.600026 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.599991    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cjb4\" (UniqueName: \"kubernetes.io/projected/9295da61-ea8c-4d37-993d-cac54a452cbe-kube-api-access-8cjb4\") pod \"9295da61-ea8c-4d37-993d-cac54a452cbe\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") "
Jul 08 22:09:03.600204 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.600045    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9295da61-ea8c-4d37-993d-cac54a452cbe-openshift-service-ca\") pod \"9295da61-ea8c-4d37-993d-cac54a452cbe\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") "
Jul 08 22:09:03.600204 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.600079    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls\") pod \"9295da61-ea8c-4d37-993d-cac54a452cbe\" (UID: \"9295da61-ea8c-4d37-993d-cac54a452cbe\") "
Jul 08 22:09:03.600488 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.600464    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9295da61-ea8c-4d37-993d-cac54a452cbe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9295da61-ea8c-4d37-993d-cac54a452cbe" (UID: "9295da61-ea8c-4d37-993d-cac54a452cbe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:09:03.602231 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.602201    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9295da61-ea8c-4d37-993d-cac54a452cbe-kube-api-access-8cjb4" (OuterVolumeSpecName: "kube-api-access-8cjb4") pod "9295da61-ea8c-4d37-993d-cac54a452cbe" (UID: "9295da61-ea8c-4d37-993d-cac54a452cbe"). InnerVolumeSpecName "kube-api-access-8cjb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:09:03.602231 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.602209    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9295da61-ea8c-4d37-993d-cac54a452cbe" (UID: "9295da61-ea8c-4d37-993d-cac54a452cbe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:09:03.701507 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.701467    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cjb4\" (UniqueName: \"kubernetes.io/projected/9295da61-ea8c-4d37-993d-cac54a452cbe-kube-api-access-8cjb4\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:09:03.701507 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.701498    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9295da61-ea8c-4d37-993d-cac54a452cbe-openshift-service-ca\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:09:03.701507 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.701511    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9295da61-ea8c-4d37-993d-cac54a452cbe-maas-api-tls\") on node \"ip-10-0-131-2.ec2.internal\" DevicePath \"\""
Jul 08 22:09:03.828724 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.828636    2568 generic.go:356] "Generic (PLEG): container finished" podID="9295da61-ea8c-4d37-993d-cac54a452cbe" containerID="94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f" exitCode=0
Jul 08 22:09:03.828724 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.828682    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"
Jul 08 22:09:03.828906 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.828716    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr" event={"ID":"9295da61-ea8c-4d37-993d-cac54a452cbe","Type":"ContainerDied","Data":"94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f"}
Jul 08 22:09:03.828906 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.828776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr" event={"ID":"9295da61-ea8c-4d37-993d-cac54a452cbe","Type":"ContainerDied","Data":"2a2615e1422b12dd2e74c88225ed0a88cd5b72abb36c49478779b0045eb4469c"}
Jul 08 22:09:03.828906 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.828801    2568 scope.go:117] "RemoveContainer" containerID="94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f"
Jul 08 22:09:03.838472 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.838453    2568 scope.go:117] "RemoveContainer" containerID="94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f"
Jul 08 22:09:03.838778 ip-10-0-131-2 kubenswrapper[2568]: E0708 22:09:03.838755    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f\": container with ID starting with 94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f not found: ID does not exist" containerID="94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f"
Jul 08 22:09:03.838860 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.838817    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f"} err="failed to get container status \"94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f\": rpc error: code = NotFound desc = could not find container \"94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f\": container with ID starting with 94d698bb8f9b73eaaf88eab5ac8f3aade1b35cb696de2609a5cc646b3d65860f not found: ID does not exist"
Jul 08 22:09:03.855731 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.855698    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"]
Jul 08 22:09:03.858456 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:03.858432    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4df112-86c8c68999-r5tzr"]
Jul 08 22:09:04.630668 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:04.630632    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9295da61-ea8c-4d37-993d-cac54a452cbe" path="/var/lib/kubelet/pods/9295da61-ea8c-4d37-993d-cac54a452cbe/volumes"
Jul 08 22:09:10.377063 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:10.377029    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b769d5575-5lj4z_7250f159-e94d-4e34-bd43-f45f1d0df14d/authorino/0.log"
Jul 08 22:09:15.227352 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:15.227318    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jgbxh_b3f44fcc-3775-4ee7-a975-6e1f2767326f/manager/0.log"
Jul 08 22:09:15.360132 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:15.360097    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c9fb9975-qwbff_8fd330ce-aab6-4b88-b087-801b3cb44e40/manager/0.log"
Jul 08 22:09:15.483584 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:15.483502    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zw4jm_31a0d1c8-3cbe-4199-82f1-4f86ef567f6b/server/0.log"
Jul 08 22:09:15.612301 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:15.612260    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nmtdn_6f3ce70a-4cfe-479f-9d8e-a223d0ca205d/manager/0.log"
Jul 08 22:09:15.728141 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:15.728113    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-hw2fl_bfaf6d10-e55b-4238-9f43-0e42dbbbae58/copy-manifests/0.log"
Jul 08 22:09:15.735457 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:15.735373    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-hw2fl_bfaf6d10-e55b-4238-9f43-0e42dbbbae58/manager/0.log"
Jul 08 22:09:17.402565 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:17.402524    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b769d5575-5lj4z_7250f159-e94d-4e34-bd43-f45f1d0df14d/authorino/0.log"
Jul 08 22:09:17.525436 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:17.525386    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cdkxw_965eb9e4-6d89-49ee-9a49-cff05e830049/manager/0.log"
Jul 08 22:09:17.894053 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:17.894020    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hlgpn_230261f0-1d10-4701-ba8a-fa2cee5d6235/registry-server/0.log"
Jul 08 22:09:18.274088 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:18.274047    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dwtls_8f67fa5e-75d3-4099-a7a9-e6a624a6a192/manager/0.log"
Jul 08 22:09:18.990922 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:18.990874    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589c8d496f-kxp2l_c43f8392-402b-44ad-8604-f99b8759ff27/kube-auth-proxy/0.log"
Jul 08 22:09:19.117679 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:19.117649    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2h5j_06173637-5786-4d73-b1d3-0c79b8ad7052/istio-proxy/1.log"
Jul 08 22:09:19.235738 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:19.235698    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x4dbx_6b901007-007c-4d5f-be4a-b6f8f05cba4c/payload-pre-processing/0.log"
Jul 08 22:09:19.361283 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:19.361250    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxvfs_4404e904-bceb-4256-80ab-f7491db3e51a/payload-processing/0.log"
Jul 08 22:09:19.477492 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:19.477465    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f696759-zrbhg_02e159d6-5bd4-49e5-b5a3-da70dea42bb6/router/0.log"
Jul 08 22:09:19.835285 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:19.835258    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cnq4l_a578b42b-c0dd-481c-897a-67a5b05d2823/main/0.log"
Jul 08 22:09:20.065647 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:20.065614    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-wrvqf_8327223b-5d46-43a4-ba3f-6246888f141d/main/0.log"
Jul 08 22:09:28.206929 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:28.206897    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gpv9z_7f6b1f15-6513-4c37-b92a-389ab8198f22/global-pull-secret-syncer/0.log"
Jul 08 22:09:28.420572 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:28.420541    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dswsm_eec9af02-8e2b-445c-b2e6-c30490033dca/konnectivity-agent/0.log"
Jul 08 22:09:28.487600 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:28.487513    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-2.ec2.internal_b879b5091a7ea1cbfad7b9a13d6cbe14/haproxy/0.log"
Jul 08 22:09:33.574937 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:33.574899    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b769d5575-5lj4z_7250f159-e94d-4e34-bd43-f45f1d0df14d/authorino/0.log"
Jul 08 22:09:33.601395 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:33.601366    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cdkxw_965eb9e4-6d89-49ee-9a49-cff05e830049/manager/0.log"
Jul 08 22:09:33.711337 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:33.711303    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hlgpn_230261f0-1d10-4701-ba8a-fa2cee5d6235/registry-server/0.log"
Jul 08 22:09:33.982882 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:33.982784    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dwtls_8f67fa5e-75d3-4099-a7a9-e6a624a6a192/manager/0.log"
Jul 08 22:09:35.703001 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:35.702967    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-mxn6k_2ca1c862-0bb7-4a32-8029-178e63da5bde/cluster-monitoring-operator/0.log"
Jul 08 22:09:35.982606 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:35.982513    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqjpg_795d40e0-faa8-4960-a2b9-5f91c7564410/node-exporter/0.log"
Jul 08 22:09:36.002025 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:36.001996    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqjpg_795d40e0-faa8-4960-a2b9-5f91c7564410/kube-rbac-proxy/0.log"
Jul 08 22:09:36.029806 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:36.029782    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqjpg_795d40e0-faa8-4960-a2b9-5f91c7564410/init-textfile/0.log"
Jul 08 22:09:36.450452 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:36.450422    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-z2gwp_67a93060-8513-4f8c-acaa-a08127da781c/prometheus-operator-admission-webhook/0.log"
Jul 08 22:09:37.862205 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:37.862180    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-vcqcs_09037241-09bb-44ca-9589-9784ab6f3aa5/networking-console-plugin/0.log"
Jul 08 22:09:38.448495 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.448460    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/1.log"
Jul 08 22:09:38.457500 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.457471    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tctgf_910bb007-8fa4-41af-9dd0-02e4907460f5/console-operator/2.log"
Jul 08 22:09:38.653546 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.653508    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"]
Jul 08 22:09:38.653980 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.653961    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9295da61-ea8c-4d37-993d-cac54a452cbe" containerName="maas-api"
Jul 08 22:09:38.654079 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.653983    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9295da61-ea8c-4d37-993d-cac54a452cbe" containerName="maas-api"
Jul 08 22:09:38.654139 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.654116    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9295da61-ea8c-4d37-993d-cac54a452cbe" containerName="maas-api"
Jul 08 22:09:38.658805 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.658782    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.661236 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.661208    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pfvkg\"/\"default-dockercfg-qjbz2\""
Jul 08 22:09:38.661347 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.661246    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfvkg\"/\"kube-root-ca.crt\""
Jul 08 22:09:38.662451 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.662433    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfvkg\"/\"openshift-service-ca.crt\""
Jul 08 22:09:38.667096 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.667075    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"]
Jul 08 22:09:38.812530 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.812495    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7b4h\" (UniqueName: \"kubernetes.io/projected/bb95a167-9075-4c8e-af89-2f1f73184983-kube-api-access-h7b4h\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.812740 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.812549    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-sys\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.812740 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.812632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-podres\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.812847 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.812741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-proc\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.812847 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.812763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-lib-modules\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914045 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-proc\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914045 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914042    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-lib-modules\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914562 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7b4h\" (UniqueName: \"kubernetes.io/projected/bb95a167-9075-4c8e-af89-2f1f73184983-kube-api-access-h7b4h\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914562 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-sys\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914562 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-podres\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914562 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914135    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-proc\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914562 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914193    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-sys\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914562 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914199    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-lib-modules\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.914562 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.914345    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb95a167-9075-4c8e-af89-2f1f73184983-podres\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.922300 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.922276    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7b4h\" (UniqueName: \"kubernetes.io/projected/bb95a167-9075-4c8e-af89-2f1f73184983-kube-api-access-h7b4h\") pod \"perf-node-gather-daemonset-9ct6z\" (UID: \"bb95a167-9075-4c8e-af89-2f1f73184983\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:38.970544 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:38.970513    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:39.067781 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:39.067103    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-qrphb_e2455135-ba65-4506-91f2-2e11b9bf5015/download-server/0.log"
Jul 08 22:09:39.115108 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:39.115086    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"]
Jul 08 22:09:39.117558 ip-10-0-131-2 kubenswrapper[2568]: W0708 22:09:39.117530    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb95a167_9075_4c8e_af89_2f1f73184983.slice/crio-71eff751f4718d25bc2ded551b8a7e71f3d1ea496def2025d6891f57998995a4 WatchSource:0}: Error finding container 71eff751f4718d25bc2ded551b8a7e71f3d1ea496def2025d6891f57998995a4: Status 404 returned error can't find the container with id 71eff751f4718d25bc2ded551b8a7e71f3d1ea496def2025d6891f57998995a4
Jul 08 22:09:39.751226 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:39.751197    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-gf2c5_276d05e1-a1f8-4271-be95-6e5e0532be97/volume-data-source-validator/0.log"
Jul 08 22:09:40.017917 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:40.017826    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z" event={"ID":"bb95a167-9075-4c8e-af89-2f1f73184983","Type":"ContainerStarted","Data":"e110c94e06f6858f6cf1d2483ff367b6f8f9e8151d7e50381a5d592b65e68411"}
Jul 08 22:09:40.017917 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:40.017882    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z" event={"ID":"bb95a167-9075-4c8e-af89-2f1f73184983","Type":"ContainerStarted","Data":"71eff751f4718d25bc2ded551b8a7e71f3d1ea496def2025d6891f57998995a4"}
Jul 08 22:09:40.018313 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:40.017960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:40.034237 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:40.034187    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z" podStartSLOduration=2.034174233 podStartE2EDuration="2.034174233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:09:40.032373433 +0000 UTC m=+2225.922154479" watchObservedRunningTime="2026-07-08 22:09:40.034174233 +0000 UTC m=+2225.923955259"
Jul 08 22:09:40.855118 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:40.855082    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d67sg_31ce4acd-44c3-45bf-bc7c-b334075b0a6d/dns/0.log"
Jul 08 22:09:40.875803 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:40.875780    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d67sg_31ce4acd-44c3-45bf-bc7c-b334075b0a6d/kube-rbac-proxy/0.log"
Jul 08 22:09:40.990011 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:40.989975    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jhhpd_73d3a9cf-cb53-47d7-96f1-0d108e3d3370/dns-node-resolver/0.log"
Jul 08 22:09:41.593265 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:41.593230    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5sdsh_8e2e803b-d842-42c3-93a7-2f8a6482bbd5/node-ca/0.log"
Jul 08 22:09:42.801848 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:42.801817    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589c8d496f-kxp2l_c43f8392-402b-44ad-8604-f99b8759ff27/kube-auth-proxy/0.log"
Jul 08 22:09:42.833434 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:42.833370    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2h5j_06173637-5786-4d73-b1d3-0c79b8ad7052/istio-proxy/0.log"
Jul 08 22:09:42.886826 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:42.886795    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2h5j_06173637-5786-4d73-b1d3-0c79b8ad7052/istio-proxy/1.log"
Jul 08 22:09:42.947683 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:42.947634    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x4dbx_6b901007-007c-4d5f-be4a-b6f8f05cba4c/payload-pre-processing/0.log"
Jul 08 22:09:43.018111 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:43.018086    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxvfs_4404e904-bceb-4256-80ab-f7491db3e51a/payload-processing/0.log"
Jul 08 22:09:43.070651 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:43.070565    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f696759-zrbhg_02e159d6-5bd4-49e5-b5a3-da70dea42bb6/router/0.log"
Jul 08 22:09:43.831348 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:43.831320    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wc4xn_95bcd5bd-d55d-4a13-86f2-a85f45855f0d/serve-healthcheck-canary/0.log"
Jul 08 22:09:44.329475 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:44.329440    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gqh2c_64b1542c-e26f-4e5c-97c8-67287f0229f6/insights-operator/0.log"
Jul 08 22:09:44.330217 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:44.330195    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gqh2c_64b1542c-e26f-4e5c-97c8-67287f0229f6/insights-operator/1.log"
Jul 08 22:09:44.499346 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:44.499313    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xlfz5_06487288-b864-4886-8928-5b19e82a1153/kube-rbac-proxy/0.log"
Jul 08 22:09:44.517954 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:44.517926    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xlfz5_06487288-b864-4886-8928-5b19e82a1153/exporter/0.log"
Jul 08 22:09:44.542934 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:44.542910    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xlfz5_06487288-b864-4886-8928-5b19e82a1153/extractor/0.log"
Jul 08 22:09:46.039223 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:46.039199    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-9ct6z"
Jul 08 22:09:46.847924 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:46.847886    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jgbxh_b3f44fcc-3775-4ee7-a975-6e1f2767326f/manager/0.log"
Jul 08 22:09:46.979155 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:46.979121    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c9fb9975-qwbff_8fd330ce-aab6-4b88-b087-801b3cb44e40/manager/0.log"
Jul 08 22:09:47.006827 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:47.006796    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zw4jm_31a0d1c8-3cbe-4199-82f1-4f86ef567f6b/server/0.log"
Jul 08 22:09:47.099788 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:47.099695    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nmtdn_6f3ce70a-4cfe-479f-9d8e-a223d0ca205d/manager/0.log"
Jul 08 22:09:47.149786 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:47.149759    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-hw2fl_bfaf6d10-e55b-4238-9f43-0e42dbbbae58/manager/0.log"
Jul 08 22:09:47.227083 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:47.227059    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-hw2fl_bfaf6d10-e55b-4238-9f43-0e42dbbbae58/copy-manifests/0.log"
Jul 08 22:09:49.567649 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:49.567618    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589c8d496f-kxp2l_c43f8392-402b-44ad-8604-f99b8759ff27/kube-auth-proxy/0.log"
Jul 08 22:09:49.589893 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:49.589867    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2h5j_06173637-5786-4d73-b1d3-0c79b8ad7052/istio-proxy/0.log"
Jul 08 22:09:49.647018 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:49.646989    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2h5j_06173637-5786-4d73-b1d3-0c79b8ad7052/istio-proxy/1.log"
Jul 08 22:09:49.694985 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:49.694958    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x4dbx_6b901007-007c-4d5f-be4a-b6f8f05cba4c/payload-pre-processing/0.log"
Jul 08 22:09:49.755564 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:49.755531    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxvfs_4404e904-bceb-4256-80ab-f7491db3e51a/payload-processing/0.log"
Jul 08 22:09:49.771865 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:49.771837    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f696759-zrbhg_02e159d6-5bd4-49e5-b5a3-da70dea42bb6/router/0.log"
Jul 08 22:09:51.224127 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:51.224090    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589c8d496f-kxp2l_c43f8392-402b-44ad-8604-f99b8759ff27/kube-auth-proxy/0.log"
Jul 08 22:09:51.247545 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:51.247510    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2h5j_06173637-5786-4d73-b1d3-0c79b8ad7052/istio-proxy/0.log"
Jul 08 22:09:51.298096 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:51.298063    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2h5j_06173637-5786-4d73-b1d3-0c79b8ad7052/istio-proxy/1.log"
Jul 08 22:09:51.346161 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:51.346132    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x4dbx_6b901007-007c-4d5f-be4a-b6f8f05cba4c/payload-pre-processing/0.log"
Jul 08 22:09:51.412858 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:51.412828    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxvfs_4404e904-bceb-4256-80ab-f7491db3e51a/payload-processing/0.log"
Jul 08 22:09:51.434284 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:51.434249    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-666f696759-zrbhg_02e159d6-5bd4-49e5-b5a3-da70dea42bb6/router/0.log"
Jul 08 22:09:53.989453 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:53.989406    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-752gl_fb97e13a-f4bc-498a-8ab2-c10fcb069f36/migrator/0.log"
Jul 08 22:09:54.009028 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:54.009000    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-752gl_fb97e13a-f4bc-498a-8ab2-c10fcb069f36/graceful-termination/0.log"
Jul 08 22:09:54.358652 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:54.358620    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-pmglp_1a85ea56-a77c-44f3-bef6-0ed26f0354ab/kube-storage-version-migrator-operator/1.log"
Jul 08 22:09:54.360373 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:54.360343    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-pmglp_1a85ea56-a77c-44f3-bef6-0ed26f0354ab/kube-storage-version-migrator-operator/0.log"
Jul 08 22:09:55.666918 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.666890    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-frtjk_9c9da1d0-5747-477e-9869-055395a27963/kube-multus-additional-cni-plugins/0.log"
Jul 08 22:09:55.688434 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.688382    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-frtjk_9c9da1d0-5747-477e-9869-055395a27963/egress-router-binary-copy/0.log"
Jul 08 22:09:55.706990 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.706969    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-frtjk_9c9da1d0-5747-477e-9869-055395a27963/cni-plugins/0.log"
Jul 08 22:09:55.725729 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.725709    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-frtjk_9c9da1d0-5747-477e-9869-055395a27963/bond-cni-plugin/0.log"
Jul 08 22:09:55.745197 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.745179    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-frtjk_9c9da1d0-5747-477e-9869-055395a27963/routeoverride-cni/0.log"
Jul 08 22:09:55.765668 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.765650    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-frtjk_9c9da1d0-5747-477e-9869-055395a27963/whereabouts-cni-bincopy/0.log"
Jul 08 22:09:55.785069 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.785051    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-frtjk_9c9da1d0-5747-477e-9869-055395a27963/whereabouts-cni/0.log"
Jul 08 22:09:55.890891 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:55.890861    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vw77r_5941eeef-b113-457c-97b8-dda635e45fda/kube-multus/0.log"
Jul 08 22:09:56.011726 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:56.011700    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sk6pm_00d98c92-dae5-494f-90e1-151bad0345c3/network-metrics-daemon/0.log"
Jul 08 22:09:56.032087 ip-10-0-131-2 kubenswrapper[2568]: I0708 22:09:56.032061    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sk6pm_00d98c92-dae5-494f-90e1-151bad0345c3/kube-rbac-proxy/0.log"