Jul 29 19:15:04.204701 ip-10-0-140-204 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 19:15:04.204713 ip-10-0-140-204 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 19:15:04.204725 ip-10-0-140-204 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 19:15:04.205068 ip-10-0-140-204 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 19:15:14.284885 ip-10-0-140-204 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 19:15:14.284901 ip-10-0-140-204 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 74706c7173984861842c42ec20d32ef5 --
Jul 29 19:17:08.333686 ip-10-0-140-204 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 19:17:08.700169 ip-10-0-140-204 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:17:08.700169 ip-10-0-140-204 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 19:17:08.700169 ip-10-0-140-204 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:17:08.700169 ip-10-0-140-204 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 19:17:08.700169 ip-10-0-140-204 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:17:08.701816 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.701722    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 19:17:08.706067 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706053    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706069    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706073    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706076    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706079    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706082    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706085    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706087    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706091    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706094    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706096    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706099    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706102    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706105    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706108    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:17:08.706104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706111    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706114    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706117    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706119    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706126    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706130    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706133    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706135    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706138    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706140    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706143    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706145    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706148    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706150    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706153    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706156    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706158    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706160    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706163    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706166    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:17:08.706481 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706168    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706171    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706173    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706175    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706178    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706180    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706183    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706185    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706188    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706191    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706193    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706196    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706198    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706203    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706208    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706213    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706216    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706219    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706222    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:17:08.706968 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706225    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706227    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706230    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706232    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706235    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706237    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706240    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706242    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706245    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706247    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706250    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706252    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706255    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706257    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706260    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706262    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706265    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706268    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706270    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706273    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:17:08.707442 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706275    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706278    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706282    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706285    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706288    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706291    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706294    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706297    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706299    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706303    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706305    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706308    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706311    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706313    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706316    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706318    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706321    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706323    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706326    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:17:08.707933 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706328    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706331    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706333    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706336    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706338    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.706341    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707081    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707088    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707092    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707095    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707098    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707101    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707104    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707107    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707111    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707114    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707117    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707120    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707123    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:17:08.708406 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707126    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707130    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707133    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707136    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707139    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707142    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707146    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707149    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707152    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707154    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707157    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707160    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707162    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707165    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707168    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707170    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707173    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707175    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707178    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:17:08.708920 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707182    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707185    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707188    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707190    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707193    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707195    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707199    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707202    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707205    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707209    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707212    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707216    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707219    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707222    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707225    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707228    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707231    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707234    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707237    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707240    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:17:08.709387 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707243    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707245    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707248    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707250    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707253    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707255    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707258    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707260    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707263    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707265    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707268    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707270    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707273    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707275    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707278    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707280    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707283    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707286    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707288    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707291    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:17:08.709999 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707293    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707296    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707299    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707302    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707305    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707308    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707311    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707313    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707316    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707318    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707321    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707323    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707326    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707328    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707331    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707333    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707336    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707338    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707340    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707343    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:17:08.710538 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707345    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707348    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707350    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707353    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707355    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707358    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.707361    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708430    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708437    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708440    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708443    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708447    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708450    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708453    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708456    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708459    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708462    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708464    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708467    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708470    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:17:08.711035 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708472    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708475    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708477    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708480    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708482    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708485    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708487    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708490    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708493    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708495    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708498    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708500    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708503    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708505    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708508    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708510    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708513    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708515    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708518    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708520    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:17:08.711546 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708523    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708526    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708528    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708531    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708534    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708536    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708540    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708542    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708545    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708547    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708550    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708552    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708555    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708557    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708560    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708562    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708564    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708567    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708570    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708572    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:17:08.712052 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708575    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708578    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708580    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708582    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708585    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708587    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708590    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708592    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708595    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708598    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708600    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708603    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708605    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708609    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708612    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708616    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708618    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708623    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708626    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:17:08.712593 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708629    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708631    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708635    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708638    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708641    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708643    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708647    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708650    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708652    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708655    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708657    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708659    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708662    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708665    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708667    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708669    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708672    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708674    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708677    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708679    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:17:08.713098 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708682    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708684    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708687    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708689    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708692    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708694    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.708697    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708756    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708762    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708768    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708772    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708777    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708782    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708788    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708794    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708798    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708803    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708808    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708812    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708814    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708817    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708820    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708823    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 29 19:17:08.713656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708826    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708828    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708832    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708835    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708838    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708840    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708844    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708850    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708855    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708858    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708861    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708864    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708867    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708869    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708872    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708875    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708888    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708891    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708894    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708897    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708900    2584 flags.go:64] FLAG: --enable-server="true"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708910    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708931    2584 flags.go:64] FLAG: --event-burst="100"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708935    2584 flags.go:64] FLAG: --event-qps="50"
Jul 29 19:17:08.714212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708938    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708941    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708944    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708948    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708951    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708954    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708957    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708960    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708963    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708966    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708968    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708971    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708974    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708977    2584 flags.go:64] FLAG: --feature-gates=""
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708980    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708983    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708987    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708990    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708993    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708996    2584 flags.go:64] FLAG: --help="false"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.708999    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-140-204.ec2.internal"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709003    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709006    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 19:17:08.714832 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709010    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709013    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709017    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709020    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709023    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709026    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709029    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709034    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709037    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709040    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709043    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709046    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709048    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709051    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709054    2584 flags.go:64] FLAG: --lock-file=""
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709057    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709060    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709063    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709068    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709071    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709074    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709077    2584 flags.go:64] FLAG: --logging-format="text"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709093    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709098    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 19:17:08.715434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709103    2584 flags.go:64] FLAG: --manifest-url=""
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709108    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709113    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709116    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709120    2584 flags.go:64] FLAG: --max-pods="110"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709122    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709126    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709128    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709131    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709134    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709137    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709140    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709148    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709151    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709154    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709157    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709160    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709166    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709169    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709172    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709174    2584 flags.go:64] FLAG: --port="10250"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709177    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709180    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04c838f437e59ca0c"
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709183    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 29 19:17:08.716064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709186    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709189    2584 flags.go:64] FLAG: --register-node="true"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709192    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709196    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709198    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709201    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709204    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709207    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709210    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709214    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709217    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709220    2584 flags.go:64] FLAG: --runonce="false"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709223    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709226    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709229    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709231    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709234    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709237    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709240    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709243    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709246    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709250    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709253    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709256    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709259    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 19:17:08.716663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709262    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709265    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709270    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709273    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709275    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709279    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709282    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709285    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709288    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709291    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709293    2584 flags.go:64] FLAG: --v="2"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709297    2584 flags.go:64] FLAG: --version="false"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709301    2584 flags.go:64] FLAG: --vmodule=""
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709304    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.709307    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709429    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709434    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709438    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709441    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709443    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709446    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709448    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709451    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:17:08.717294 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709454    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709456    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709459    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709462    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709465    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709469    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709471    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709474    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709476    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709479    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709482    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709485    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709487    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709490    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709492    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709495    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709498    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709500    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709503    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709505    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:17:08.717886 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709508    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709510    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709513    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709515    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709518    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709521    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709524    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709526    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709529    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709532    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709534    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709537    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709539    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709542    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709545    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709547    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709550    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709554    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709556    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709559    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:17:08.718385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709562    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709565    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709567    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709570    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709573    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709575    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709579    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709583    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709586    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709589    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709591    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709594    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709596    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709599    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709601    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709604    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709606    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709610    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709612    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709615    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:17:08.718901 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709617    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709620    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709622    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709625    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709628    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709630    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709632    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709635    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709638    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709642    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709644    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709647    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709649    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709652    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709654    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709657    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709660    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709664    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709667    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:17:08.719385 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709671    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709674    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709677    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709680    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709683    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709686    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709688    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709691    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709693    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709696    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709699    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.709702    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.710395    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.717143    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.717158    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 19:17:08.719872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.717177    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.717183    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717235    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717242    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717246    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717249    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717253    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717256    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717259    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717261    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717264    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717266    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717269    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717272    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717274    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717277    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717280    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717283    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:17:08.720263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717286    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717289    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717292    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717295    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717297    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717300    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717303    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717305    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717308    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717311    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717313    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717316    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717320    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717323    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717326    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717328    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717331    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717333    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717336    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717339    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:17:08.720978 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717341    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717343    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717346    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717348    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717352    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717354    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717357    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717359    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717362    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717365    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717367    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717370    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717372    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717375    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717377    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717380    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717382    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717386    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717388    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717391    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:17:08.721592 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717393    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717396    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717398    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717401    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717404    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717406    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717409    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717412    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717428    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717430    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717434    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717438    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717440    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717443    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717446    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717449    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717451    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717454    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717456    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:17:08.722086 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717459    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717462    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717464    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717467    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717469    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717472    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717474    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717476    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717479    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717481    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717484    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717487    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717489    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717492    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717495    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717497    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717500    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717502    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717505    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717507    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:17:08.722585 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717510    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717513    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717515    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717518    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.717523    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717626    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717630    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717633    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717636    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717639    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717641    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717644    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717646    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717649    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717652    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:17:08.723062 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717654    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717656    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717659    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717662    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717665    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717667    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717670    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717672    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717675    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717677    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717680    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717682    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717685    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717688    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717690    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717692    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717696    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717700    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717703    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:17:08.723499 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717706    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717709    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717711    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717714    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717718    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717721    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717724    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717727    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717729    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717732    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717735    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717737    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717740    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717743    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717745    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717748    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717750    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717753    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717756    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:17:08.723965 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717758    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717761    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717764    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717766    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717768    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717771    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717773    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717776    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717778    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717781    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717783    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717786    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717788    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717791    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717794    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717796    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717798    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717801    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717803    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717806    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:17:08.724444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717809    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717811    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717814    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717816    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717819    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717822    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717826    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717828    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717831    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717834    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717836    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717839    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717841    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717844    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717846    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717849    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717851    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717854    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717856    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717859    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:17:08.724980 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717861    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717864    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717866    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717869    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717871    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717874    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717877    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717879    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717882    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717884    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:08.717887    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.717892    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.717985    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.722873    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 19:17:08.725485 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.724383    2584 server.go:1019] "Starting client certificate rotation"
Jul 29 19:17:08.725835 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.724445    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:17:08.725835 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.724484    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:17:08.727557 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.727544    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:17:08.728637 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.728619    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:17:08.736125 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.736106    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 29 19:17:08.738115 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.738101    2584 log.go:25] "Validated CRI v1 image API"
Jul 29 19:17:08.741178 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.741163    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 19:17:08.744505 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.744483    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9222980c-bbc8-4899-9359-657a113ffa2c:/dev/nvme0n1p4 cb141e23-135a-4c60-abb4-6256878cd03f:/dev/nvme0n1p3]
Jul 29 19:17:08.744578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.744505    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 19:17:08.749683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.749570    2584 manager.go:216] Machine: {Timestamp:2026-07-29 19:17:08.748474286 +0000 UTC m=+0.311970972 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099858 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec234f2c759997ddca4587aac377ea1e SystemUUID:ec234f2c-7599-97dd-ca45-87aac377ea1e BootID:74706c71-7398-4861-842c-42ec20d32ef5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:28:f9:3a:1e:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:28:f9:3a:1e:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:45:16:4e:91:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 19:17:08.749683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.749675    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 19:17:08.749858 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.749824    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 19:17:08.752190 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.752171    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:17:08.752706 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.752684    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 19:17:08.752838 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.752710    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 19:17:08.753465 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.753454    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 19:17:08.753506 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.753466    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 19:17:08.753506 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.753473    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:17:08.753506 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.753492    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:17:08.755081 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.755070    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 19:17:08.758522 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.758511    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:17:08.758659 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.758649    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 19:17:08.758703 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.758678    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 19:17:08.758703 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.758687    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 19:17:08.758703 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.758703    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 19:17:08.758800 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.758714    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 29 19:17:08.758800 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.758724    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 19:17:08.759091 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.759080    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:17:08.759127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.759099    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:17:08.761157 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.761139    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 19:17:08.762916 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.762900    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 19:17:08.762990 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.762938    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 19:17:08.765773 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765741    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765778    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765789    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765795    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765805    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765811    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765820    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765826    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765833    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765839    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 19:17:08.765848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765850    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 19:17:08.766109 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.765857    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 19:17:08.767540 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.767522    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 19:17:08.767595 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.767545    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 19:17:08.770811 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.770789    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 19:17:08.770953 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.770941    2584 server.go:1268] "Started kubelet"
Jul 29 19:17:08.771009 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.770962    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 19:17:08.771009 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.770965    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 19:17:08.771105 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.771015    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 19:17:08.771105 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.771028    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 19:17:08.771105 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.771100    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 19:17:08.771744 ip-10-0-140-204 systemd[1]: Started Kubernetes Kubelet.
Jul 29 19:17:08.772062 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.772050    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 19:17:08.773228 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.773199    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 19:17:08.775429 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.775402    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnflv"
Jul 29 19:17:08.777291 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.777274    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 19:17:08.777524 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.776588    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-204.ec2.internal.18c6d8c1b4b35983  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-204.ec2.internal,UID:ip-10-0-140-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-204.ec2.internal,},FirstTimestamp:2026-07-29 19:17:08.770920835 +0000 UTC m=+0.334417574,LastTimestamp:2026-07-29 19:17:08.770920835 +0000 UTC m=+0.334417574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-204.ec2.internal,}"
Jul 29 19:17:08.781565 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.781548    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnflv"
Jul 29 19:17:08.782074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.782062    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 19:17:08.782135 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.782069    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 19:17:08.782135 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.782116    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:08.782679 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.782663    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 19:17:08.782744 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.782714    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 19:17:08.782744 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.782742    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 19:17:08.782889 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.782877    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 19:17:08.782889 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.782888    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 19:17:08.783210 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.783192    2584 factory.go:55] Registering systemd factory
Jul 29 19:17:08.783210 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.783212    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 29 19:17:08.783659 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.783644    2584 factory.go:153] Registering CRI-O factory
Jul 29 19:17:08.783724 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.783663    2584 factory.go:223] Registration of the crio container factory successfully
Jul 29 19:17:08.783724 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.783710    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 19:17:08.783813 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.783740    2584 factory.go:103] Registering Raw factory
Jul 29 19:17:08.783813 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.783756    2584 manager.go:1196] Started watching for new ooms in manager
Jul 29 19:17:08.784206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.784189    2584 manager.go:349] Starting recovery of all containers
Jul 29 19:17:08.785481 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.785456    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 19:17:08.785602 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.785570    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 19:17:08.794909 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.794893    2584 manager.go:354] Recovery completed
Jul 29 19:17:08.797349 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.797302    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 29 19:17:08.800652 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.800639    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:17:08.802161 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.802147    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:17:08.802232 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.802171    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:17:08.802232 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.802181    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:17:08.802749 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.802731    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 19:17:08.802749 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.802746    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 19:17:08.802749 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.802748    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:17:08.802893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.802761    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:17:08.803380 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.803360    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:17:08.803466 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.803396    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:17:08.803466 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.803426    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:17:08.803774 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.803763    2584 policy_none.go:49] "None policy: Start"
Jul 29 19:17:08.803808 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.803778    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 19:17:08.803808 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.803791    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 19:17:08.804701 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.804691    2584 policy_none.go:47] "Start"
Jul 29 19:17:08.839044 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.838913    2584 manager.go:337] "Starting Device Plugin manager"
Jul 29 19:17:08.839119 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.839078    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 19:17:08.839119 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.839088    2584 server.go:87] "Starting device plugin registration server"
Jul 29 19:17:08.839273 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.839261    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 19:17:08.839325 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.839273    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 19:17:08.839704 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.839382    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 19:17:08.839704 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.839469    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 19:17:08.839704 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.839478    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 19:17:08.839864 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.839825    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 19:17:08.839864 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.839859    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:08.939626 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.939605    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:17:08.940738 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.940590    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:17:08.940738 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.940621    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:17:08.940738 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.940635    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:17:08.940738 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.940665    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-204.ec2.internal"
Jul 29 19:17:08.942089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.942063    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 19:17:08.943180 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.943157    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 19:17:08.943248 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.943195    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 19:17:08.943248 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.943213    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 19:17:08.943248 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.943241    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 19:17:08.945660 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.945641    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:17:08.947307 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:08.947293    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-204.ec2.internal"
Jul 29 19:17:08.947358 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.947314    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-204.ec2.internal\": node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:08.994821 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:08.994775    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:09.044181 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.044141    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"]
Jul 29 19:17:09.044258 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.044221    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:17:09.049377 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.049356    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:17:09.049467 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.049384    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:17:09.049467 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.049394    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:17:09.050719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.050707    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:17:09.050844 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.050830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.050893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.050858    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:17:09.051402 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.051387    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:17:09.051488 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.051403    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:17:09.051488 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.051426    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:17:09.051488 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.051440    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:17:09.051488 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.051452    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:17:09.051488 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.051442    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:17:09.052767 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.052751    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.052821 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.052787    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:17:09.053575 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.053558    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:17:09.053652 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.053588    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:17:09.053652 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.053602    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:17:09.081939 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:09.081898    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-204.ec2.internal\" not found" node="ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.084233 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.084211    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7295309ad4081ebe57e8dce67fd9aa01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal\" (UID: \"7295309ad4081ebe57e8dce67fd9aa01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.084323 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.084248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7295309ad4081ebe57e8dce67fd9aa01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal\" (UID: \"7295309ad4081ebe57e8dce67fd9aa01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.084323 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.084275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d990f6501778c29228144bf34cfedd5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-204.ec2.internal\" (UID: \"7d990f6501778c29228144bf34cfedd5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.086182 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:09.086167    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-204.ec2.internal\" not found" node="ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.095445 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:09.095431    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:09.184875 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.184852    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7295309ad4081ebe57e8dce67fd9aa01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal\" (UID: \"7295309ad4081ebe57e8dce67fd9aa01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.184979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.184882    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d990f6501778c29228144bf34cfedd5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-204.ec2.internal\" (UID: \"7d990f6501778c29228144bf34cfedd5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.184979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.184906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7295309ad4081ebe57e8dce67fd9aa01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal\" (UID: \"7295309ad4081ebe57e8dce67fd9aa01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.184979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.184942    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7295309ad4081ebe57e8dce67fd9aa01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal\" (UID: \"7295309ad4081ebe57e8dce67fd9aa01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.184979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.184952    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d990f6501778c29228144bf34cfedd5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-204.ec2.internal\" (UID: \"7d990f6501778c29228144bf34cfedd5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.184979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:09.184959    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7295309ad4081ebe57e8dce67fd9aa01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal\" (UID: \"7295309ad4081ebe57e8dce67fd9aa01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:09.195980 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:09.195953    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:10.940018 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:10.939957    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:11.028348 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.028325    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:11.034058 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.034037    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:11.040629 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.040598    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:11.141152 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.141128    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:11.241636 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.241568    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:11.342286 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.342259    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-204.ec2.internal\" not found"
Jul 29 19:17:11.366388 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.366367    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 19:17:11.366784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.366519    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 19:17:11.377055 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.377030    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:17:11.401139 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.401116    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:17:11.402725 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.402711    2584 apiserver.go:52] "Watching apiserver"
Jul 29 19:17:11.408995 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.408978    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 19:17:11.411701 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.410429    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-hj4d7","openshift-multus/network-metrics-daemon-mtcn6","openshift-network-operator/iptables-alerter-bshdn","openshift-ovn-kubernetes/ovnkube-node-hwdpj","openshift-dns/node-resolver-p5gsl","openshift-multus/multus-additional-cni-plugins-nw4df","openshift-multus/multus-tgrrq","openshift-network-diagnostics/network-check-target-g5zrq","kube-system/global-pull-secret-syncer-fqssn","kube-system/konnectivity-agent-nf459","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9","openshift-cluster-node-tuning-operator/tuned-x8knh"]
Jul 29 19:17:11.412253 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.412233    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.413354 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.413331    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:11.413458 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.413398    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:11.414445 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.414424    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.414966 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.414944    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 19:17:11.415401 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.415378    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 19:17:11.415487 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.415440    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 19:17:11.415640 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.415623    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hbdfk\""
Jul 29 19:17:11.415716 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.415688    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.416841 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.416820    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.417006 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.416987    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bs74d\""
Jul 29 19:17:11.417086 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.417025    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 19:17:11.417294 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.417269    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 19:17:11.417373 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.417355    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:17:11.418100 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.418077    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 19:17:11.418100 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.418091    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.418336 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.418123    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zt8hq\""
Jul 29 19:17:11.418529 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.418503    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 19:17:11.418789 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.418770    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 19:17:11.418858 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.418798    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 19:17:11.418858 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.418814    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 19:17:11.419406 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.419388    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 19:17:11.419406 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.419401    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 19:17:11.419569 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.419404    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 19:17:11.419569 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.419495    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-njst7\""
Jul 29 19:17:11.419724 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.419683    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.420456 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.420436    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 19:17:11.420543 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.420466    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6rqgc\""
Jul 29 19:17:11.420864 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.420839    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 19:17:11.420864 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.420862    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 19:17:11.421003 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.420873    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 19:17:11.421083 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.421064    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:11.421161 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.421126    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:11.421161 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.421146    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 19:17:11.422090 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.422074    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 19:17:11.422334 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.422320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.422400 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.422364    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:11.422638 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.422622    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zpns\""
Jul 29 19:17:11.424145 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.424122    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.425447 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.425426    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 19:17:11.425519 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.425429    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:11.425580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.425544    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.426582 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.426565    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dg5pc\""
Jul 29 19:17:11.426698 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.426561    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 19:17:11.426797 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.426752    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 19:17:11.427448 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.426892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.428249 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.428233    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 19:17:11.428335 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.428319    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 19:17:11.428378 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.428344    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l8llc\""
Jul 29 19:17:11.428587 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.428571    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 19:17:11.429297 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.429281    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p8jqc\""
Jul 29 19:17:11.429529 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.429510    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:17:11.429628 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.429539    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 19:17:11.431130 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431072    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 19:12:10 +0000 UTC" deadline="2028-04-02 14:09:09.104468558 +0000 UTC"
Jul 29 19:17:11.431130 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431128    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14706h51m57.673344259s"
Jul 29 19:17:11.431272 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431132    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2tcg\" (UniqueName: \"kubernetes.io/projected/2f233854-e632-48e6-87e7-c80f05f74c93-kube-api-access-n2tcg\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.431272 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-env-overrides\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.431272 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431178    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm57q\" (UniqueName: \"kubernetes.io/projected/005fe08a-66f3-4973-884c-26ed86e6fa5f-kube-api-access-tm57q\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:11.431272 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9grc6\" (UniqueName: \"kubernetes.io/projected/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-kube-api-access-9grc6\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.431397 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431279    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-ovn\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.431397 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431305    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d82635f6-4578-42e2-9ea8-4183e286887c-hosts-file\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.431785 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431762    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysctl-conf\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.431855 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431802    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/388b2184-94cf-4f9f-89a9-8fbb36be29e5-serviceca\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.431855 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431831    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f233854-e632-48e6-87e7-c80f05f74c93-iptables-alerter-script\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.431931 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cnibin\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.431931 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431882    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.431931 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431905    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-ovnkube-config\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431929    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysconfig\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.432034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431951    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-system-cni-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.432034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.431974    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-kubelet\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.432034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432018    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.432206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-modprobe-d\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.432206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432064    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-var-lib-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432115    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-netns\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.432206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.432206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432161    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-sys-fs\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.432206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432186    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjt2r\" (UniqueName: \"kubernetes.io/projected/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-kube-api-access-vjt2r\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432213    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-lib-modules\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432235    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-var-lib-kubelet\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/388b2184-94cf-4f9f-89a9-8fbb36be29e5-host\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432281    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-etc-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-node-log\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432367    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-socket-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-registration-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432407    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-tmp\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432429    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-log-socket\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432498    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-cni-bin\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432527    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-os-release\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82635f6-4578-42e2-9ea8-4183e286887c-tmp-dir\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.432589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432571    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-kubernetes\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432592    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-systemd-units\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35798a80-22d7-418e-9748-7ddd7e64503c-ovn-node-metrics-cert\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432673    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-cnibin\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-k8s-cni-cncf-io\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432743    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-conf-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432769    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-multus-certs\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-run-netns\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-systemd\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432848    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96bd8941-f472-4650-99aa-0dd551105ee8-cni-binary-copy\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432876    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-etc-kubernetes\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z9vw\" (UniqueName: \"kubernetes.io/projected/96bd8941-f472-4650-99aa-0dd551105ee8-kube-api-access-2z9vw\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a07531d-5792-4873-941d-1887f0064274-kubelet-config\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432972    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a07531d-5792-4873-941d-1887f0064274-dbus\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.432996    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-host\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-ovnkube-script-lib\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-sys\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.433343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f233854-e632-48e6-87e7-c80f05f74c93-host-slash\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433127    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b6x5\" (UniqueName: \"kubernetes.io/projected/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-kube-api-access-9b6x5\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433178    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45sh\" (UniqueName: \"kubernetes.io/projected/35798a80-22d7-418e-9748-7ddd7e64503c-kube-api-access-j45sh\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433197    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-run\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvg2c\" (UniqueName: \"kubernetes.io/projected/d82635f6-4578-42e2-9ea8-4183e286887c-kube-api-access-gvg2c\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysctl-d\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433242    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-systemd\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7hd6\" (UniqueName: \"kubernetes.io/projected/388b2184-94cf-4f9f-89a9-8fbb36be29e5-kube-api-access-l7hd6\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433284    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-kubelet\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433308    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-slash\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433331    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433346    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-device-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-tuned\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.433878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-cni-netd\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-system-cni-dir\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433407    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-cni-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433435    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-socket-dir-parent\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433464    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-os-release\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433477    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-cni-bin\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433493    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-cni-multus\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-hostroot\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96bd8941-f472-4650-99aa-0dd551105ee8-multus-daemon-config\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433550    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c827d0c-9815-4704-9817-88506748f26d-agent-certs\") pod \"konnectivity-agent-nf459\" (UID: \"1c827d0c-9815-4704-9817-88506748f26d\") " pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433564    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c827d0c-9815-4704-9817-88506748f26d-konnectivity-ca\") pod \"konnectivity-agent-nf459\" (UID: \"1c827d0c-9815-4704-9817-88506748f26d\") " pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.434331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.433577    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:11.435260 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.435240    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal"]
Jul 29 19:17:11.435725 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.435703    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:17:11.435822 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.435793    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"
Jul 29 19:17:11.438194 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.438175    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:17:11.445747 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.445725    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:17:11.446016 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.445999    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal"]
Jul 29 19:17:11.457716 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.457698    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2v4t2"
Jul 29 19:17:11.465975 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.465943    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2v4t2"
Jul 29 19:17:11.526255 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.526236    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 19:17:11.533722 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-modprobe-d\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.533818 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-var-lib-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.533818 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533746    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.533818 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533765    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-netns\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.533987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533817    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.533987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533825    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-var-lib-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.533987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-netns\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.533987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533866    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.533987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-modprobe-d\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.533987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.533925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-sys-fs\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjt2r\" (UniqueName: \"kubernetes.io/projected/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-kube-api-access-vjt2r\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534031    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534038    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-sys-fs\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-lib-modules\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-var-lib-kubelet\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-lib-modules\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534186    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-var-lib-kubelet\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/388b2184-94cf-4f9f-89a9-8fbb36be29e5-host\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534212    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-etc-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-node-log\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534245    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-etc-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534289    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/388b2184-94cf-4f9f-89a9-8fbb36be29e5-host\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534290    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-node-log\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534308    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-socket-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.534316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-registration-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534332    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534345    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-tmp\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-log-socket\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-registration-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-cni-bin\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534412    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-cni-bin\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-os-release\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534432    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-socket-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534444    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-log-socket\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82635f6-4578-42e2-9ea8-4183e286887c-tmp-dir\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534469    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-openvswitch\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534482    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-kubernetes\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534491    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-os-release\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534506    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-systemd-units\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35798a80-22d7-418e-9748-7ddd7e64503c-ovn-node-metrics-cert\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534534    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-kubernetes\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.535151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-cnibin\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534570    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-systemd-units\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534579    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-k8s-cni-cncf-io\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-conf-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-cnibin\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-multus-certs\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-run-netns\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534669    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-k8s-cni-cncf-io\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-systemd\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-run-multus-certs\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96bd8941-f472-4650-99aa-0dd551105ee8-cni-binary-copy\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534726    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82635f6-4578-42e2-9ea8-4183e286887c-tmp-dir\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-etc-kubernetes\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-conf-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z9vw\" (UniqueName: \"kubernetes.io/projected/96bd8941-f472-4650-99aa-0dd551105ee8-kube-api-access-2z9vw\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534771    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a07531d-5792-4873-941d-1887f0064274-kubelet-config\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534794    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-systemd\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.535961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534792    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-run-netns\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534807    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a07531d-5792-4873-941d-1887f0064274-dbus\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-etc-kubernetes\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-host\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534857    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-ovnkube-script-lib\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534876    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-sys\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534893    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-host\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a07531d-5792-4873-941d-1887f0064274-dbus\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534898    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f233854-e632-48e6-87e7-c80f05f74c93-host-slash\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534949    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534958    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-sys\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534924    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f233854-e632-48e6-87e7-c80f05f74c93-host-slash\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.534975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535010    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a07531d-5792-4873-941d-1887f0064274-kubelet-config\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535038    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b6x5\" (UniqueName: \"kubernetes.io/projected/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-kube-api-access-9b6x5\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.536842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535115    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45sh\" (UniqueName: \"kubernetes.io/projected/35798a80-22d7-418e-9748-7ddd7e64503c-kube-api-access-j45sh\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-run\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535166    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvg2c\" (UniqueName: \"kubernetes.io/projected/d82635f6-4578-42e2-9ea8-4183e286887c-kube-api-access-gvg2c\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535188    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysctl-d\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535210    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-systemd\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7hd6\" (UniqueName: \"kubernetes.io/projected/388b2184-94cf-4f9f-89a9-8fbb36be29e5-kube-api-access-l7hd6\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-kubelet\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-slash\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535355    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-device-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535377    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-tuned\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535401    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-cni-netd\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535408    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysctl-d\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-system-cni-dir\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535471    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-cni-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-ovnkube-script-lib\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.538699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535496    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-socket-dir-parent\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-os-release\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535523    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535545    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-device-dir\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535566    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-run\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535578    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-systemd\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-cni-bin\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535647    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-slash\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-cni-multus\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535688    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-cni-netd\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535690    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-cni-bin\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535690    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-hostroot\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535727    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-hostroot\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96bd8941-f472-4650-99aa-0dd551105ee8-multus-daemon-config\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-host-kubelet\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-cni-multus\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535820    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-socket-dir-parent\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.539578 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c827d0c-9815-4704-9817-88506748f26d-agent-certs\") pod \"konnectivity-agent-nf459\" (UID: \"1c827d0c-9815-4704-9817-88506748f26d\") " pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c827d0c-9815-4704-9817-88506748f26d-konnectivity-ca\") pod \"konnectivity-agent-nf459\" (UID: \"1c827d0c-9815-4704-9817-88506748f26d\") " pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535940    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2tcg\" (UniqueName: \"kubernetes.io/projected/2f233854-e632-48e6-87e7-c80f05f74c93-kube-api-access-n2tcg\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535974    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-env-overrides\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.535999    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm57q\" (UniqueName: \"kubernetes.io/projected/005fe08a-66f3-4973-884c-26ed86e6fa5f-kube-api-access-tm57q\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.536014    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9grc6\" (UniqueName: \"kubernetes.io/projected/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-kube-api-access-9grc6\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536053    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96bd8941-f472-4650-99aa-0dd551105ee8-cni-binary-copy\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.536113    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:17:12.036070247 +0000 UTC m=+1.956380567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-ovn\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536148    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-os-release\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d82635f6-4578-42e2-9ea8-4183e286887c-hosts-file\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysctl-conf\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536186    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-system-cni-dir\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536209    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96bd8941-f472-4650-99aa-0dd551105ee8-multus-daemon-config\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.540353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d82635f6-4578-42e2-9ea8-4183e286887c-hosts-file\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536640    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-multus-cni-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536723    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/388b2184-94cf-4f9f-89a9-8fbb36be29e5-serviceca\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536735    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-env-overrides\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536783    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35798a80-22d7-418e-9748-7ddd7e64503c-run-ovn\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536829    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysctl-conf\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/388b2184-94cf-4f9f-89a9-8fbb36be29e5-serviceca\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.536871    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f233854-e632-48e6-87e7-c80f05f74c93-iptables-alerter-script\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cnibin\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537160    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-ovnkube-config\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537186    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysconfig\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-system-cni-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537240    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-kubelet\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537340    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-host-var-lib-kubelet\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.537390    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:11.540897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537398    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-sysconfig\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.537433    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret podName:9a07531d-5792-4873-941d-1887f0064274 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:12.037418521 +0000 UTC m=+1.957728824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret") pod "global-pull-secret-syncer-fqssn" (UID: "9a07531d-5792-4873-941d-1887f0064274") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c827d0c-9815-4704-9817-88506748f26d-konnectivity-ca\") pod \"konnectivity-agent-nf459\" (UID: \"1c827d0c-9815-4704-9817-88506748f26d\") " pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35798a80-22d7-418e-9748-7ddd7e64503c-ovnkube-config\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537913    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-cnibin\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.537967    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96bd8941-f472-4650-99aa-0dd551105ee8-system-cni-dir\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.538112    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f233854-e632-48e6-87e7-c80f05f74c93-iptables-alerter-script\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.538453    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.538568    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35798a80-22d7-418e-9748-7ddd7e64503c-ovn-node-metrics-cert\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.538829    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-etc-tuned\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.538835    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c827d0c-9815-4704-9817-88506748f26d-agent-certs\") pod \"konnectivity-agent-nf459\" (UID: \"1c827d0c-9815-4704-9817-88506748f26d\") " pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.541369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.539176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-tmp\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.542899 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.542877    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjt2r\" (UniqueName: \"kubernetes.io/projected/dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e-kube-api-access-vjt2r\") pod \"aws-ebs-csi-driver-node-z4xx9\" (UID: \"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.545732 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.545467    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:17:11.545732 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.545492    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:17:11.545732 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.545505    2584 projected.go:196] Error preparing data for projected volume kube-api-access-q4kr6 for pod openshift-network-diagnostics/network-check-target-g5zrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:11.545732 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:11.545554    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6 podName:5849f3b0-2a3d-4aa6-983f-7903849ea504 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:12.045543673 +0000 UTC m=+1.965853970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q4kr6" (UniqueName: "kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6") pod "network-check-target-g5zrq" (UID: "5849f3b0-2a3d-4aa6-983f-7903849ea504") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:11.547289 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.547267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm57q\" (UniqueName: \"kubernetes.io/projected/005fe08a-66f3-4973-884c-26ed86e6fa5f-kube-api-access-tm57q\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:11.547767 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.547746    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvg2c\" (UniqueName: \"kubernetes.io/projected/d82635f6-4578-42e2-9ea8-4183e286887c-kube-api-access-gvg2c\") pod \"node-resolver-p5gsl\" (UID: \"d82635f6-4578-42e2-9ea8-4183e286887c\") " pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.547980 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.547964    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45sh\" (UniqueName: \"kubernetes.io/projected/35798a80-22d7-418e-9748-7ddd7e64503c-kube-api-access-j45sh\") pod \"ovnkube-node-hwdpj\" (UID: \"35798a80-22d7-418e-9748-7ddd7e64503c\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.548143 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.548115    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z9vw\" (UniqueName: \"kubernetes.io/projected/96bd8941-f472-4650-99aa-0dd551105ee8-kube-api-access-2z9vw\") pod \"multus-tgrrq\" (UID: \"96bd8941-f472-4650-99aa-0dd551105ee8\") " pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.548246 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.548229    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7hd6\" (UniqueName: \"kubernetes.io/projected/388b2184-94cf-4f9f-89a9-8fbb36be29e5-kube-api-access-l7hd6\") pod \"node-ca-hj4d7\" (UID: \"388b2184-94cf-4f9f-89a9-8fbb36be29e5\") " pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.548338 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.548320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9grc6\" (UniqueName: \"kubernetes.io/projected/db6a5efb-e9b1-4c94-8bf0-35c83f977aa6-kube-api-access-9grc6\") pod \"tuned-x8knh\" (UID: \"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6\") " pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.548467 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.548454    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2tcg\" (UniqueName: \"kubernetes.io/projected/2f233854-e632-48e6-87e7-c80f05f74c93-kube-api-access-n2tcg\") pod \"iptables-alerter-bshdn\" (UID: \"2f233854-e632-48e6-87e7-c80f05f74c93\") " pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.548646 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.548620    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b6x5\" (UniqueName: \"kubernetes.io/projected/28dc1b0f-8979-4f98-b118-eb9741c6c1ca-kube-api-access-9b6x5\") pod \"multus-additional-cni-plugins-nw4df\" (UID: \"28dc1b0f-8979-4f98-b118-eb9741c6c1ca\") " pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.561513 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.561497    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:11.581970 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.581943    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c827d0c_9815_4704_9817_88506748f26d.slice/crio-11fd505c16b01c037d9b3d07c8a2dcfe6b8fb10e56175d01024dd3f583d726a4 WatchSource:0}: Error finding container 11fd505c16b01c037d9b3d07c8a2dcfe6b8fb10e56175d01024dd3f583d726a4: Status 404 returned error can't find the container with id 11fd505c16b01c037d9b3d07c8a2dcfe6b8fb10e56175d01024dd3f583d726a4
Jul 29 19:17:11.582198 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.582180    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7295309ad4081ebe57e8dce67fd9aa01.slice/crio-689d2f8117a2191873a921daf3b2eb21068102ce600284103326238ec160ba24 WatchSource:0}: Error finding container 689d2f8117a2191873a921daf3b2eb21068102ce600284103326238ec160ba24: Status 404 returned error can't find the container with id 689d2f8117a2191873a921daf3b2eb21068102ce600284103326238ec160ba24
Jul 29 19:17:11.584077 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.584048    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d990f6501778c29228144bf34cfedd5.slice/crio-e5af431522fb7b17885186742fb255b99fbb9784e90b22dc6ee8838c9491d3ee WatchSource:0}: Error finding container e5af431522fb7b17885186742fb255b99fbb9784e90b22dc6ee8838c9491d3ee: Status 404 returned error can't find the container with id e5af431522fb7b17885186742fb255b99fbb9784e90b22dc6ee8838c9491d3ee
Jul 29 19:17:11.589980 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.589965    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:17:11.590054 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.590014    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nf459" event={"ID":"1c827d0c-9815-4704-9817-88506748f26d","Type":"ContainerStarted","Data":"11fd505c16b01c037d9b3d07c8a2dcfe6b8fb10e56175d01024dd3f583d726a4"}
Jul 29 19:17:11.590969 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.590949    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9"
Jul 29 19:17:11.591433 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.591412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal" event={"ID":"7295309ad4081ebe57e8dce67fd9aa01","Type":"ContainerStarted","Data":"689d2f8117a2191873a921daf3b2eb21068102ce600284103326238ec160ba24"}
Jul 29 19:17:11.592626 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.592579    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal" event={"ID":"7d990f6501778c29228144bf34cfedd5","Type":"ContainerStarted","Data":"e5af431522fb7b17885186742fb255b99fbb9784e90b22dc6ee8838c9491d3ee"}
Jul 29 19:17:11.595580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.595553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x8knh"
Jul 29 19:17:11.598845 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.598822    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8d1b10_9e4f_413a_b2d5_074fb87b6a8e.slice/crio-2dbceabc903fabb6ab9feae44b2df4958de6db51145d7dfaa0a1b4adc7df70d1 WatchSource:0}: Error finding container 2dbceabc903fabb6ab9feae44b2df4958de6db51145d7dfaa0a1b4adc7df70d1: Status 404 returned error can't find the container with id 2dbceabc903fabb6ab9feae44b2df4958de6db51145d7dfaa0a1b4adc7df70d1
Jul 29 19:17:11.603463 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.603441    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6a5efb_e9b1_4c94_8bf0_35c83f977aa6.slice/crio-cc91a6875c6186408ac4c69ef1822fbf83dafb2fbc8bfc765478326238e1b50d WatchSource:0}: Error finding container cc91a6875c6186408ac4c69ef1822fbf83dafb2fbc8bfc765478326238e1b50d: Status 404 returned error can't find the container with id cc91a6875c6186408ac4c69ef1822fbf83dafb2fbc8bfc765478326238e1b50d
Jul 29 19:17:11.710686 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.710666    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:17:11.732726 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.732708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hj4d7"
Jul 29 19:17:11.739846 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.739823    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388b2184_94cf_4f9f_89a9_8fbb36be29e5.slice/crio-83c3149542a80dc2c2d84abab1bf2bd619774a8ba952faa6372d98539bffbee3 WatchSource:0}: Error finding container 83c3149542a80dc2c2d84abab1bf2bd619774a8ba952faa6372d98539bffbee3: Status 404 returned error can't find the container with id 83c3149542a80dc2c2d84abab1bf2bd619774a8ba952faa6372d98539bffbee3
Jul 29 19:17:11.751656 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.751640    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bshdn"
Jul 29 19:17:11.758019 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.758001    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f233854_e632_48e6_87e7_c80f05f74c93.slice/crio-3df83021c9ee016f039283c6e1ebdc1c67b755b981f33b28d2c857ad613c0429 WatchSource:0}: Error finding container 3df83021c9ee016f039283c6e1ebdc1c67b755b981f33b28d2c857ad613c0429: Status 404 returned error can't find the container with id 3df83021c9ee016f039283c6e1ebdc1c67b755b981f33b28d2c857ad613c0429
Jul 29 19:17:11.771549 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.771532    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:11.777934 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.777909    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35798a80_22d7_418e_9748_7ddd7e64503c.slice/crio-7b1fb04f9b7314e218c497377492de3c42637d37e2a5efd8b6921ee22bf700fd WatchSource:0}: Error finding container 7b1fb04f9b7314e218c497377492de3c42637d37e2a5efd8b6921ee22bf700fd: Status 404 returned error can't find the container with id 7b1fb04f9b7314e218c497377492de3c42637d37e2a5efd8b6921ee22bf700fd
Jul 29 19:17:11.794565 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.794548    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p5gsl"
Jul 29 19:17:11.800766 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.800747    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82635f6_4578_42e2_9ea8_4183e286887c.slice/crio-a484c2f0b0b2b5f33e498e63c7a95262c1d3c9030bdf8fb79611de3784957dee WatchSource:0}: Error finding container a484c2f0b0b2b5f33e498e63c7a95262c1d3c9030bdf8fb79611de3784957dee: Status 404 returned error can't find the container with id a484c2f0b0b2b5f33e498e63c7a95262c1d3c9030bdf8fb79611de3784957dee
Jul 29 19:17:11.817226 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.817208    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nw4df"
Jul 29 19:17:11.825233 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.825216    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28dc1b0f_8979_4f98_b118_eb9741c6c1ca.slice/crio-00cf89734163dc79af16b82da69b5e4008883c7f03e04f3aae3f034a6e4ef67b WatchSource:0}: Error finding container 00cf89734163dc79af16b82da69b5e4008883c7f03e04f3aae3f034a6e4ef67b: Status 404 returned error can't find the container with id 00cf89734163dc79af16b82da69b5e4008883c7f03e04f3aae3f034a6e4ef67b
Jul 29 19:17:11.833696 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:11.833681    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tgrrq"
Jul 29 19:17:11.840793 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:11.840774    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bd8941_f472_4650_99aa_0dd551105ee8.slice/crio-8e3f5d3a658196319fd45417079fb37bf4ccd49794d4b3939d05d6563d8015d9 WatchSource:0}: Error finding container 8e3f5d3a658196319fd45417079fb37bf4ccd49794d4b3939d05d6563d8015d9: Status 404 returned error can't find the container with id 8e3f5d3a658196319fd45417079fb37bf4ccd49794d4b3939d05d6563d8015d9
Jul 29 19:17:12.042478 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.042135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:12.042478 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.042223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:12.042478 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.042307    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:12.042478 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.042356    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:12.042478 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.042378    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret podName:9a07531d-5792-4873-941d-1887f0064274 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:13.042357939 +0000 UTC m=+2.962668242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret") pod "global-pull-secret-syncer-fqssn" (UID: "9a07531d-5792-4873-941d-1887f0064274") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:12.042478 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.042413    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:17:13.042390108 +0000 UTC m=+2.962700411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:12.143235 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.143110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:12.143393 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.143316    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:17:12.143393 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.143334    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:17:12.143393 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.143346    2584 projected.go:196] Error preparing data for projected volume kube-api-access-q4kr6 for pod openshift-network-diagnostics/network-check-target-g5zrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:12.143393 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:12.143395    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6 podName:5849f3b0-2a3d-4aa6-983f-7903849ea504 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:13.143378812 +0000 UTC m=+3.063689111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4kr6" (UniqueName: "kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6") pod "network-check-target-g5zrq" (UID: "5849f3b0-2a3d-4aa6-983f-7903849ea504") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:12.468947 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.468757    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:12:11 +0000 UTC" deadline="2028-03-08 23:25:07.791782897 +0000 UTC"
Jul 29 19:17:12.468947 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.468794    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14116h7m55.322993412s"
Jul 29 19:17:12.607774 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.607738    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p5gsl" event={"ID":"d82635f6-4578-42e2-9ea8-4183e286887c","Type":"ContainerStarted","Data":"a484c2f0b0b2b5f33e498e63c7a95262c1d3c9030bdf8fb79611de3784957dee"}
Jul 29 19:17:12.618551 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.618354    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:17:12.630363 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.630336    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bshdn" event={"ID":"2f233854-e632-48e6-87e7-c80f05f74c93","Type":"ContainerStarted","Data":"3df83021c9ee016f039283c6e1ebdc1c67b755b981f33b28d2c857ad613c0429"}
Jul 29 19:17:12.635721 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.635689    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8knh" event={"ID":"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6","Type":"ContainerStarted","Data":"cc91a6875c6186408ac4c69ef1822fbf83dafb2fbc8bfc765478326238e1b50d"}
Jul 29 19:17:12.652436 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.652408    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9" event={"ID":"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e","Type":"ContainerStarted","Data":"2dbceabc903fabb6ab9feae44b2df4958de6db51145d7dfaa0a1b4adc7df70d1"}
Jul 29 19:17:12.665770 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.665745    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerStarted","Data":"00cf89734163dc79af16b82da69b5e4008883c7f03e04f3aae3f034a6e4ef67b"}
Jul 29 19:17:12.683816 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.683727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"7b1fb04f9b7314e218c497377492de3c42637d37e2a5efd8b6921ee22bf700fd"}
Jul 29 19:17:12.719877 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.719814    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hj4d7" event={"ID":"388b2184-94cf-4f9f-89a9-8fbb36be29e5","Type":"ContainerStarted","Data":"83c3149542a80dc2c2d84abab1bf2bd619774a8ba952faa6372d98539bffbee3"}
Jul 29 19:17:12.742310 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:12.742285    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tgrrq" event={"ID":"96bd8941-f472-4650-99aa-0dd551105ee8","Type":"ContainerStarted","Data":"8e3f5d3a658196319fd45417079fb37bf4ccd49794d4b3939d05d6563d8015d9"}
Jul 29 19:17:13.051158 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.050964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:13.051158 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.051011    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:13.051366 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.051180    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:13.051366 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.051242    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret podName:9a07531d-5792-4873-941d-1887f0064274 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:15.05121827 +0000 UTC m=+4.971528582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret") pod "global-pull-secret-syncer-fqssn" (UID: "9a07531d-5792-4873-941d-1887f0064274") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:13.051717 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.051683    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:13.051802 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.051734    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:17:15.051718978 +0000 UTC m=+4.972029289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:13.152930 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.152381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:13.152930 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.152529    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:17:13.152930 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.152547    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:17:13.152930 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.152560    2584 projected.go:196] Error preparing data for projected volume kube-api-access-q4kr6 for pod openshift-network-diagnostics/network-check-target-g5zrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:13.152930 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.152625    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6 podName:5849f3b0-2a3d-4aa6-983f-7903849ea504 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:15.152593693 +0000 UTC m=+5.072903994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4kr6" (UniqueName: "kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6") pod "network-check-target-g5zrq" (UID: "5849f3b0-2a3d-4aa6-983f-7903849ea504") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:13.469671 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.469559    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:12:11 +0000 UTC" deadline="2028-01-23 22:24:38.987058285 +0000 UTC"
Jul 29 19:17:13.469671 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.469622    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13035h7m25.517440951s"
Jul 29 19:17:13.587638 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.586927    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:13.587638 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.587066    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:13.587638 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.587466    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:13.587638 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.587558    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:13.587638 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:13.587633    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:13.587933 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:13.587720    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:15.068426 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:15.068384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:15.069172 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:15.068488    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:15.069172 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.068635    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:15.069172 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.068716    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:15.069172 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.068720    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:17:19.068678726 +0000 UTC m=+8.988989027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:15.069172 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.068789    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret podName:9a07531d-5792-4873-941d-1887f0064274 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:19.068770756 +0000 UTC m=+8.989081060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret") pod "global-pull-secret-syncer-fqssn" (UID: "9a07531d-5792-4873-941d-1887f0064274") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:15.169701 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:15.169154    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:15.169701 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.169283    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:17:15.169701 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.169303    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:17:15.169701 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.169312    2584 projected.go:196] Error preparing data for projected volume kube-api-access-q4kr6 for pod openshift-network-diagnostics/network-check-target-g5zrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:15.169701 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.169359    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6 podName:5849f3b0-2a3d-4aa6-983f-7903849ea504 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:19.169346329 +0000 UTC m=+9.089656646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4kr6" (UniqueName: "kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6") pod "network-check-target-g5zrq" (UID: "5849f3b0-2a3d-4aa6-983f-7903849ea504") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:15.586639 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:15.586592    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:15.586822 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:15.586643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:15.586822 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.586753    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:15.587120 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:15.587100    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:15.587227 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.587207    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:15.587333 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:15.587288    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:17.587045 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:17.587013    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:17.587459 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:17.587050    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:17.587459 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:17.587152    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:17.587459 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:17.587223    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:17.587459 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:17.587270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:17.587459 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:17.587339    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:19.101909 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:19.101876    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:19.102397 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:19.101928    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:19.102397 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.102039    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:19.102397 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.102104    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret podName:9a07531d-5792-4873-941d-1887f0064274 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:27.102087022 +0000 UTC m=+17.022397322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret") pod "global-pull-secret-syncer-fqssn" (UID: "9a07531d-5792-4873-941d-1887f0064274") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:19.102397 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.102295    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:19.102397 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.102363    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:17:27.102343673 +0000 UTC m=+17.022653971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:19.203235 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:19.203175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:19.203409 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.203364    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:17:19.203409 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.203387    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:17:19.203409 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.203400    2584 projected.go:196] Error preparing data for projected volume kube-api-access-q4kr6 for pod openshift-network-diagnostics/network-check-target-g5zrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:19.203569 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.203517    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6 podName:5849f3b0-2a3d-4aa6-983f-7903849ea504 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:27.203435989 +0000 UTC m=+17.123746290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4kr6" (UniqueName: "kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6") pod "network-check-target-g5zrq" (UID: "5849f3b0-2a3d-4aa6-983f-7903849ea504") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:19.587558 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:19.587476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:19.587729 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.587623    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:19.587891 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:19.587868    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:19.587976 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:19.587963    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:19.588052 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.587961    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:19.588089 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:19.588035    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:21.587584 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:21.587549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:21.587584 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:21.587573    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:21.588109 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:21.587692    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:21.588109 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:21.587704    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:21.588109 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:21.587768    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:21.588109 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:21.587860    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:23.587250 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:23.587165    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:23.587250 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:23.587202    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:23.587250 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:23.587202    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:23.587723 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:23.587282    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:23.587723 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:23.587366    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:23.587723 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:23.587436    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:25.587182 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:25.587121    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:25.587182 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:25.587174    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:25.587676 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:25.587181    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:25.587676 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:25.587254    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:25.587676 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:25.587355    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:25.587676 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:25.587444    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:27.168483 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:27.168422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:27.168870 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.168583    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:27.168870 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:27.168641    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:27.168870 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.168665    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret podName:9a07531d-5792-4873-941d-1887f0064274 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:43.168645823 +0000 UTC m=+33.088956131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret") pod "global-pull-secret-syncer-fqssn" (UID: "9a07531d-5792-4873-941d-1887f0064274") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:27.168870 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.168730    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:27.168870 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.168783    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:17:43.168765491 +0000 UTC m=+33.089075794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:27.269905 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:27.269874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:27.270077 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.270060    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:17:27.270143 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.270085    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:17:27.270143 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.270097    2584 projected.go:196] Error preparing data for projected volume kube-api-access-q4kr6 for pod openshift-network-diagnostics/network-check-target-g5zrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:27.270241 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.270157    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6 podName:5849f3b0-2a3d-4aa6-983f-7903849ea504 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:43.270139512 +0000 UTC m=+33.190449817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4kr6" (UniqueName: "kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6") pod "network-check-target-g5zrq" (UID: "5849f3b0-2a3d-4aa6-983f-7903849ea504") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:27.587591 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:27.587510    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:27.587591 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:27.587541    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:27.587591 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:27.587549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:27.587879 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.587639    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:27.587879 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.587737    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:27.587879 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:27.587842    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:29.587275 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:29.587243    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:29.587731 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:29.587283    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:29.587731 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:29.587353    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:29.587731 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:29.587365    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:29.587731 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:29.587461    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:29.587731 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:29.587522    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:31.587182 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.586913    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:31.587535 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.586991    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:31.587535 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:31.587256    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:31.587535 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:31.587330    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:31.587535 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.586998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:31.587535 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:31.587404    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:31.787325 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.787301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x8knh" event={"ID":"db6a5efb-e9b1-4c94-8bf0-35c83f977aa6","Type":"ContainerStarted","Data":"e80794e7153c543061d65a135b60aeae7968cf86493484f197913257f7ef9f60"}
Jul 29 19:17:31.788775 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.788752    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9" event={"ID":"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e","Type":"ContainerStarted","Data":"4fe650a21222c461184af76017639d521708a2d5d4c9a9250b5e21f15bb32b6c"}
Jul 29 19:17:31.790020 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.789993    2584 generic.go:356] "Generic (PLEG): container finished" podID="7295309ad4081ebe57e8dce67fd9aa01" containerID="40f1ae626af2c02232abc068f12e506e30d29b200e6bcafca8866bf59466bcd5" exitCode=0
Jul 29 19:17:31.790118 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.790068    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal" event={"ID":"7295309ad4081ebe57e8dce67fd9aa01","Type":"ContainerDied","Data":"40f1ae626af2c02232abc068f12e506e30d29b200e6bcafca8866bf59466bcd5"}
Jul 29 19:17:31.794166 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.794145    2584 generic.go:356] "Generic (PLEG): container finished" podID="28dc1b0f-8979-4f98-b118-eb9741c6c1ca" containerID="fea19d5e6a91a8d62864ac0d14c8fb96607d5624ce0e90deb1773fe0c9502c3a" exitCode=0
Jul 29 19:17:31.794255 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.794210    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerDied","Data":"fea19d5e6a91a8d62864ac0d14c8fb96607d5624ce0e90deb1773fe0c9502c3a"}
Jul 29 19:17:31.796312 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.796287    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"0979c148cd0def9d00556b27f9dcb2a0d4a5aa3720fa4b9c10d14bc5d49d085d"}
Jul 29 19:17:31.796393 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.796375    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"d659e2c111afceecfd8efe30fb17e58b13300f30d661d0188f1be17749ff6783"}
Jul 29 19:17:31.796443 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.796412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"e56cb06e56657076769dd5f0de43c5f75f1c79006539b3cff2e95738435ada1c"}
Jul 29 19:17:31.797660 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.797635    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hj4d7" event={"ID":"388b2184-94cf-4f9f-89a9-8fbb36be29e5","Type":"ContainerStarted","Data":"33711fbd3609b9ee83a1e0e54030e1c50e6e6a69dbb629e9dd44f21df5114964"}
Jul 29 19:17:31.799037 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.799018    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nf459" event={"ID":"1c827d0c-9815-4704-9817-88506748f26d","Type":"ContainerStarted","Data":"3969d226cf5aa1285ce4efbdc146c42417bb8c4037674c1e7a89c822a79d405b"}
Jul 29 19:17:31.800402 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.800379    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal" event={"ID":"7d990f6501778c29228144bf34cfedd5","Type":"ContainerStarted","Data":"109dcb0196fa41794561ed64be01d57faa4ba4c379a8c18c1db9a818dcdd7fd8"}
Jul 29 19:17:31.801867 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.801843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tgrrq" event={"ID":"96bd8941-f472-4650-99aa-0dd551105ee8","Type":"ContainerStarted","Data":"c2c93676b06f1e9f6c7f6c5c962a0e355f14a8f421bf63dabe122bd0931135d3"}
Jul 29 19:17:31.803149 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.803114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p5gsl" event={"ID":"d82635f6-4578-42e2-9ea8-4183e286887c","Type":"ContainerStarted","Data":"64ac53687441b61a5a3c8f59e64cc3be976722c40b1ad6a30f1dc9066087e6c0"}
Jul 29 19:17:31.807688 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.807648    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x8knh" podStartSLOduration=2.39774836 podStartE2EDuration="21.807623497s" totalImagesPullingTime="19.409875137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:31.807223569 +0000 UTC m=+21.727533889" watchObservedRunningTime="2026-07-29 19:17:31.807623497 +0000 UTC m=+21.727933817"
Jul 29 19:17:31.821202 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.821040    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p5gsl" podStartSLOduration=2.654799972 podStartE2EDuration="21.821029395s" totalImagesPullingTime="19.166229423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:31.820698842 +0000 UTC m=+21.741009171" watchObservedRunningTime="2026-07-29 19:17:31.821029395 +0000 UTC m=+21.741339715"
Jul 29 19:17:31.860173 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.860140    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tgrrq" podStartSLOduration=2.6518437759999998 podStartE2EDuration="21.860128924s" totalImagesPullingTime="19.208285148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:31.859932493 +0000 UTC m=+21.780242811" watchObservedRunningTime="2026-07-29 19:17:31.860128924 +0000 UTC m=+21.780439243"
Jul 29 19:17:31.877044 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.877003    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nf459" podStartSLOduration=2.469695409 podStartE2EDuration="21.876986893s" totalImagesPullingTime="19.407291484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:31.876842094 +0000 UTC m=+21.797152415" watchObservedRunningTime="2026-07-29 19:17:31.876986893 +0000 UTC m=+21.797297209"
Jul 29 19:17:31.911893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.911859    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-204.ec2.internal" podStartSLOduration=20.91184796 podStartE2EDuration="20.91184796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:31.911323168 +0000 UTC m=+21.831633490" watchObservedRunningTime="2026-07-29 19:17:31.91184796 +0000 UTC m=+21.832158279"
Jul 29 19:17:31.933990 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:31.933957    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hj4d7" podStartSLOduration=2.689959595 podStartE2EDuration="21.933945442s" totalImagesPullingTime="19.243985847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:31.933796586 +0000 UTC m=+21.854106916" watchObservedRunningTime="2026-07-29 19:17:31.933945442 +0000 UTC m=+21.854255763"
Jul 29 19:17:32.807449 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:32.807266    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal" event={"ID":"7295309ad4081ebe57e8dce67fd9aa01","Type":"ContainerStarted","Data":"07cb0e768943f8811222c623c9af9f90a50aa80b99d98a0a4ee493d1cd0cde99"}
Jul 29 19:17:32.810575 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:32.810543    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"2058eea426cc14d47d89eb9449df204813f0712434c147c3f792aaddcd4e32fd"}
Jul 29 19:17:32.810721 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:32.810640    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"ad3a91fd59a104c35727eca61a98dea1e8431caa140b7ce3d502e0d16af3c55b"}
Jul 29 19:17:32.810721 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:32.810686    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"b2b20baadc7de62447a9434d4b8f56adf748723b072bb059b359f8f84fd90258"}
Jul 29 19:17:32.812311 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:32.812249    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bshdn" event={"ID":"2f233854-e632-48e6-87e7-c80f05f74c93","Type":"ContainerStarted","Data":"3dbc7022e301e2ad8661ae86a6f57064f97bb5e7fa42e200881047dfdff0c57a"}
Jul 29 19:17:32.822898 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:32.822856    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-204.ec2.internal" podStartSLOduration=21.822845374 podStartE2EDuration="21.822845374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:32.822442108 +0000 UTC m=+22.742752429" watchObservedRunningTime="2026-07-29 19:17:32.822845374 +0000 UTC m=+22.743155694"
Jul 29 19:17:32.837119 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:32.837087    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bshdn" podStartSLOduration=3.5820101319999997 podStartE2EDuration="22.837073069s" totalImagesPullingTime="19.255062937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:32.836635962 +0000 UTC m=+22.756946284" watchObservedRunningTime="2026-07-29 19:17:32.837073069 +0000 UTC m=+22.757383384"
Jul 29 19:17:33.257869 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.257845    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 19:17:33.495795 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.495662    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T19:17:33.25786546Z","UUID":"e1535f41-bce8-49b7-82ea-e40512f95f77","Handler":null,"Name":"","Endpoint":""}
Jul 29 19:17:33.497748 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.497547    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 19:17:33.497748 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.497597    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 19:17:33.587419 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.587394    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:33.587662 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.587403    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:33.587662 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:33.587487    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:33.587662 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:33.587554    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:33.587662 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.587408    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:33.587892 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:33.587680    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:33.816862 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:33.816777    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9" event={"ID":"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e","Type":"ContainerStarted","Data":"a14c63ff105ad6a8da68d834bc63b6c98509f8d62236b3aedcadbdc862962926"}
Jul 29 19:17:34.542434 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:34.542362    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:34.542972 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:34.542948    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:34.819279 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:34.819214    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:34.819765 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:34.819748    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nf459"
Jul 29 19:17:35.586664 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:35.586636    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:35.586822 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:35.586640    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:35.586822 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:35.586753    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:35.586822 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:35.586803    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:35.586822 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:35.586643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:35.586998 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:35.586895    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:36.825632 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:36.825416    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9" event={"ID":"dc8d1b10-9e4f-413a-b2d5-074fb87b6a8e","Type":"ContainerStarted","Data":"1fd13de0ecf10e6edba7b74c287f80dff05e42984556291cd0e02b41e42a60f0"}
Jul 29 19:17:36.827219 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:36.827189    2584 generic.go:356] "Generic (PLEG): container finished" podID="28dc1b0f-8979-4f98-b118-eb9741c6c1ca" containerID="f34ac63345dd5f88d4dce5b016661c362e5426f7b4c82ba1a314ac228ae9f3a0" exitCode=0
Jul 29 19:17:36.827365 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:36.827258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerDied","Data":"f34ac63345dd5f88d4dce5b016661c362e5426f7b4c82ba1a314ac228ae9f3a0"}
Jul 29 19:17:36.830653 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:36.830635    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"d3cf9791a3657f418657f928ffdf7ad36c4ea7009504f7289f7c5bd5e8e541bd"}
Jul 29 19:17:36.843448 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:36.843409    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z4xx9" podStartSLOduration=3.3071148949999998 podStartE2EDuration="26.843397492s" totalImagesPullingTime="23.536282597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:36.842411082 +0000 UTC m=+26.762721400" watchObservedRunningTime="2026-07-29 19:17:36.843397492 +0000 UTC m=+26.763707811"
Jul 29 19:17:37.586887 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:37.586865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:37.587026 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:37.586865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:37.587026 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:37.586974    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:37.587110 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:37.587093    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:37.587150 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:37.586865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:37.587205 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:37.587189    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:38.837153 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.836962    2584 generic.go:356] "Generic (PLEG): container finished" podID="28dc1b0f-8979-4f98-b118-eb9741c6c1ca" containerID="48848d343664f6fa1ff08185b6f97bda4631ead2a7446ac4e86cda0c53d5e758" exitCode=0
Jul 29 19:17:38.837845 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.837010    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerDied","Data":"48848d343664f6fa1ff08185b6f97bda4631ead2a7446ac4e86cda0c53d5e758"}
Jul 29 19:17:38.843526 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.843491    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" event={"ID":"35798a80-22d7-418e-9748-7ddd7e64503c","Type":"ContainerStarted","Data":"4348eca0c8908d2d44e58d24bf69b33eeacd70ab375e2ddd5de74ace7f31816f"}
Jul 29 19:17:38.843908 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.843887    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:38.843976 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.843967    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:38.844033 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.844020    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:38.859713 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.859694    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:38.859799 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.859789    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:17:38.898144 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:38.898104    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj" podStartSLOduration=9.309163827 podStartE2EDuration="28.898088645s" totalImagesPullingTime="19.588924818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:38.897580222 +0000 UTC m=+28.817890544" watchObservedRunningTime="2026-07-29 19:17:38.898088645 +0000 UTC m=+28.818398966"
Jul 29 19:17:39.587082 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:39.587051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:39.587230 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:39.587155    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:39.587230 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:39.587158    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:39.587230 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:39.587165    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:39.587402 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:39.587249    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:39.587402 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:39.587332    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:40.253207 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.253178    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g5zrq"]
Jul 29 19:17:40.253639 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.253352    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:40.253639 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:40.253493    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:40.257212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.256694    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fqssn"]
Jul 29 19:17:40.257212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.256775    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mtcn6"]
Jul 29 19:17:40.257212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.256886    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:40.257212 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:40.257088    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:40.257212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.257174    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:40.257570 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:40.257286    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:40.849880 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.849854    2584 generic.go:356] "Generic (PLEG): container finished" podID="28dc1b0f-8979-4f98-b118-eb9741c6c1ca" containerID="132dce205184f45e3313519f0252d13fbea94636f8d197163c24f1a1a4c5269f" exitCode=0
Jul 29 19:17:40.850000 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:40.849936    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerDied","Data":"132dce205184f45e3313519f0252d13fbea94636f8d197163c24f1a1a4c5269f"}
Jul 29 19:17:41.587591 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:41.587561    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:41.588024 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:41.587696    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:41.588024 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:41.587709    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:41.588024 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:41.587701    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:41.588024 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:41.587807    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:41.588024 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:41.587908    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:43.190377 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:43.190298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:43.190377 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:43.190342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:43.190833 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.190460    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:43.190833 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.190462    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:43.190833 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.190523    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret podName:9a07531d-5792-4873-941d-1887f0064274 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:15.190505524 +0000 UTC m=+65.110815825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret") pod "global-pull-secret-syncer-fqssn" (UID: "9a07531d-5792-4873-941d-1887f0064274") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:17:43.190833 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.190542    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:18:15.190532069 +0000 UTC m=+65.110842370 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:17:43.291267 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:43.291228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:43.291427 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.291406    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:17:43.291485 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.291435    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:17:43.291485 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.291446    2584 projected.go:196] Error preparing data for projected volume kube-api-access-q4kr6 for pod openshift-network-diagnostics/network-check-target-g5zrq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:43.291569 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.291501    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6 podName:5849f3b0-2a3d-4aa6-983f-7903849ea504 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:15.291480139 +0000 UTC m=+65.211790437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4kr6" (UniqueName: "kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6") pod "network-check-target-g5zrq" (UID: "5849f3b0-2a3d-4aa6-983f-7903849ea504") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:17:43.587314 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:43.587241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:43.587454 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:43.587350    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:43.587454 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.587355    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5zrq" podUID="5849f3b0-2a3d-4aa6-983f-7903849ea504"
Jul 29 19:17:43.587454 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:43.587385    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:43.587573 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.587474    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mtcn6" podUID="005fe08a-66f3-4973-884c-26ed86e6fa5f"
Jul 29 19:17:43.587573 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:43.587533    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqssn" podUID="9a07531d-5792-4873-941d-1887f0064274"
Jul 29 19:17:44.942531 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:44.942355    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-204.ec2.internal" event="NodeReady"
Jul 29 19:17:44.942859 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:44.942643    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 19:17:44.987979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:44.987919    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v8h5x"]
Jul 29 19:17:45.001551 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.001531    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j8552"]
Jul 29 19:17:45.001696 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.001679    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.004287 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.004262    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 19:17:45.004375 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.004312    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 19:17:45.004428 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.004381    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74g8d\""
Jul 29 19:17:45.015301 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.015284    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v8h5x"]
Jul 29 19:17:45.015369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.015313    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j8552"]
Jul 29 19:17:45.015401 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.015375    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.018577 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.018558    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 19:17:45.018884 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.018868    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 19:17:45.019074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.019059    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 19:17:45.019121 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.019064    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2gz5l\""
Jul 29 19:17:45.105998 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.105980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/030f3207-da35-4ddf-95ba-4913da56f008-cert\") pod \"ingress-canary-j8552\" (UID: \"030f3207-da35-4ddf-95ba-4913da56f008\") " pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.106094 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.106012    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/589ae4b3-0f85-479b-af86-4e5dc69766e2-config-volume\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.106094 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.106034    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589ae4b3-0f85-479b-af86-4e5dc69766e2-tmp-dir\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.106182 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.106113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.106182 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.106154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vztk8\" (UniqueName: \"kubernetes.io/projected/030f3207-da35-4ddf-95ba-4913da56f008-kube-api-access-vztk8\") pod \"ingress-canary-j8552\" (UID: \"030f3207-da35-4ddf-95ba-4913da56f008\") " pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.106182 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.106173    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cdv\" (UniqueName: \"kubernetes.io/projected/589ae4b3-0f85-479b-af86-4e5dc69766e2-kube-api-access-84cdv\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.206747 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.206727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/589ae4b3-0f85-479b-af86-4e5dc69766e2-config-volume\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.206836 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.206752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589ae4b3-0f85-479b-af86-4e5dc69766e2-tmp-dir\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.206836 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.206778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.206836 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.206805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vztk8\" (UniqueName: \"kubernetes.io/projected/030f3207-da35-4ddf-95ba-4913da56f008-kube-api-access-vztk8\") pod \"ingress-canary-j8552\" (UID: \"030f3207-da35-4ddf-95ba-4913da56f008\") " pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.206836 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.206820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84cdv\" (UniqueName: \"kubernetes.io/projected/589ae4b3-0f85-479b-af86-4e5dc69766e2-kube-api-access-84cdv\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.207021 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.206857    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/030f3207-da35-4ddf-95ba-4913da56f008-cert\") pod \"ingress-canary-j8552\" (UID: \"030f3207-da35-4ddf-95ba-4913da56f008\") " pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.207021 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:45.206898    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:17:45.207021 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:45.206997    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls podName:589ae4b3-0f85-479b-af86-4e5dc69766e2 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:45.70697778 +0000 UTC m=+35.627288078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls") pod "dns-default-v8h5x" (UID: "589ae4b3-0f85-479b-af86-4e5dc69766e2") : secret "dns-default-metrics-tls" not found
Jul 29 19:17:45.207161 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.207117    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/589ae4b3-0f85-479b-af86-4e5dc69766e2-tmp-dir\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.207337 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.207320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/589ae4b3-0f85-479b-af86-4e5dc69766e2-config-volume\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.211074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.211056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/030f3207-da35-4ddf-95ba-4913da56f008-cert\") pod \"ingress-canary-j8552\" (UID: \"030f3207-da35-4ddf-95ba-4913da56f008\") " pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.217445 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.217427    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cdv\" (UniqueName: \"kubernetes.io/projected/589ae4b3-0f85-479b-af86-4e5dc69766e2-kube-api-access-84cdv\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.217680 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.217653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vztk8\" (UniqueName: \"kubernetes.io/projected/030f3207-da35-4ddf-95ba-4913da56f008-kube-api-access-vztk8\") pod \"ingress-canary-j8552\" (UID: \"030f3207-da35-4ddf-95ba-4913da56f008\") " pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.333231 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.333213    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j8552"
Jul 29 19:17:45.526004 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.525975    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j8552"]
Jul 29 19:17:45.529749 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:17:45.529723    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030f3207_da35_4ddf_95ba_4913da56f008.slice/crio-a3fc88f86d7899cfa2b7ba93ec9c7831af1bb02bf8b45ebd16297f74dea4eceb WatchSource:0}: Error finding container a3fc88f86d7899cfa2b7ba93ec9c7831af1bb02bf8b45ebd16297f74dea4eceb: Status 404 returned error can't find the container with id a3fc88f86d7899cfa2b7ba93ec9c7831af1bb02bf8b45ebd16297f74dea4eceb
Jul 29 19:17:45.586760 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.586708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:17:45.586843 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.586806    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:17:45.586843 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.586814    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:17:45.589417 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.589391    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:17:45.589417 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.589413    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:17:45.589550 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.589457    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:17:45.589550 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.589487    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bfbzc\""
Jul 29 19:17:45.590580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.590564    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgbwc\""
Jul 29 19:17:45.590672 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.590585    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:17:45.711103 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.711078    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:45.711191 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:45.711180    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:17:45.711264 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:45.711252    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls podName:589ae4b3-0f85-479b-af86-4e5dc69766e2 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:46.711231424 +0000 UTC m=+36.631541740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls") pod "dns-default-v8h5x" (UID: "589ae4b3-0f85-479b-af86-4e5dc69766e2") : secret "dns-default-metrics-tls" not found
Jul 29 19:17:45.863430 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.863382    2584 generic.go:356] "Generic (PLEG): container finished" podID="28dc1b0f-8979-4f98-b118-eb9741c6c1ca" containerID="99d6bc71f462c0d4c1b911d5598e46669093784752cbf7d62086a6da41f5c96e" exitCode=0
Jul 29 19:17:45.863512 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.863464    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerDied","Data":"99d6bc71f462c0d4c1b911d5598e46669093784752cbf7d62086a6da41f5c96e"}
Jul 29 19:17:45.864502 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:45.864461    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j8552" event={"ID":"030f3207-da35-4ddf-95ba-4913da56f008","Type":"ContainerStarted","Data":"a3fc88f86d7899cfa2b7ba93ec9c7831af1bb02bf8b45ebd16297f74dea4eceb"}
Jul 29 19:17:46.718901 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:46.718710    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:46.719667 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:46.718852    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:17:46.719667 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:46.719007    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls podName:589ae4b3-0f85-479b-af86-4e5dc69766e2 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:48.718986984 +0000 UTC m=+38.639297285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls") pod "dns-default-v8h5x" (UID: "589ae4b3-0f85-479b-af86-4e5dc69766e2") : secret "dns-default-metrics-tls" not found
Jul 29 19:17:46.869887 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:46.869852    2584 generic.go:356] "Generic (PLEG): container finished" podID="28dc1b0f-8979-4f98-b118-eb9741c6c1ca" containerID="3936b6df0df7bfc1f9060ed62866275a56aa69a86ab0ff4d7fc7e0a680a38d68" exitCode=0
Jul 29 19:17:46.870025 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:46.869918    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerDied","Data":"3936b6df0df7bfc1f9060ed62866275a56aa69a86ab0ff4d7fc7e0a680a38d68"}
Jul 29 19:17:47.875834 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:47.875798    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nw4df" event={"ID":"28dc1b0f-8979-4f98-b118-eb9741c6c1ca","Type":"ContainerStarted","Data":"1c101d8548a675ec502207aca75a5e14351e01168cad7a3706eee3455aa68296"}
Jul 29 19:17:47.897499 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:47.897461    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nw4df" podStartSLOduration=8.133417807 podStartE2EDuration="37.89744673s" totalImagesPullingTime="29.764028923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:47.896555985 +0000 UTC m=+37.816866305" watchObservedRunningTime="2026-07-29 19:17:47.89744673 +0000 UTC m=+37.817757043"
Jul 29 19:17:48.733380 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:48.733351    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:48.733562 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:48.733479    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:17:48.733562 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:48.733534    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls podName:589ae4b3-0f85-479b-af86-4e5dc69766e2 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:52.733519878 +0000 UTC m=+42.653830177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls") pod "dns-default-v8h5x" (UID: "589ae4b3-0f85-479b-af86-4e5dc69766e2") : secret "dns-default-metrics-tls" not found
Jul 29 19:17:48.878946 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:48.878909    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j8552" event={"ID":"030f3207-da35-4ddf-95ba-4913da56f008","Type":"ContainerStarted","Data":"813cc83a19fe242097448d38eb710cdde31baa64b0667eadc0970ced3f419bba"}
Jul 29 19:17:48.896885 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:48.896837    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j8552" podStartSLOduration=2.352684986 podStartE2EDuration="4.896823183s" totalImagesPullingTime="2.544138197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:48.896215961 +0000 UTC m=+38.816526284" watchObservedRunningTime="2026-07-29 19:17:48.896823183 +0000 UTC m=+38.817133502"
Jul 29 19:17:52.760486 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:17:52.760445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:17:52.760946 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:52.760554    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:17:52.760946 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:17:52.760631    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls podName:589ae4b3-0f85-479b-af86-4e5dc69766e2 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:00.760596712 +0000 UTC m=+50.680907011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls") pod "dns-default-v8h5x" (UID: "589ae4b3-0f85-479b-af86-4e5dc69766e2") : secret "dns-default-metrics-tls" not found
Jul 29 19:18:00.813101 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:00.813061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:18:00.813541 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:00.813206    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:18:00.813541 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:00.813268    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls podName:589ae4b3-0f85-479b-af86-4e5dc69766e2 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:16.813252376 +0000 UTC m=+66.733562673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls") pod "dns-default-v8h5x" (UID: "589ae4b3-0f85-479b-af86-4e5dc69766e2") : secret "dns-default-metrics-tls" not found
Jul 29 19:18:09.241793 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.241750    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"]
Jul 29 19:18:09.244343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.244323    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"]
Jul 29 19:18:09.244479 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.244455    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.246460 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.246432    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"]
Jul 29 19:18:09.246577 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.246533    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"
Jul 29 19:18:09.248187 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248165    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 19:18:09.248187 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248177    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c9nbg\""
Jul 29 19:18:09.248348 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248202    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 19:18:09.248348 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248215    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 19:18:09.248348 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248170    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 19:18:09.248554 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248533    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dgbql"]
Jul 29 19:18:09.248659 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248643    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-547r5\""
Jul 29 19:18:09.248704 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.248656    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.249070 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.249049    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:18:09.249164 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.249126    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 19:18:09.250542 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.250525    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.251935 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.251909    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 29 19:18:09.252051 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.251933    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:18:09.252051 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.251948    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 29 19:18:09.252213 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.252194    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 29 19:18:09.252581 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.252566    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ck8w7\""
Jul 29 19:18:09.252819 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.252801    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 19:18:09.253368 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.253353    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7v4pg\""
Jul 29 19:18:09.253835 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.253817    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 19:18:09.254415 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.254390    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 19:18:09.254521 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.254502    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:18:09.255948 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.255923    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"]
Jul 29 19:18:09.260523 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.260482    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"]
Jul 29 19:18:09.261972 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.261745    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 19:18:09.263108 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.263053    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dgbql"]
Jul 29 19:18:09.263868 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.263844    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"]
Jul 29 19:18:09.346718 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.346697    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"]
Jul 29 19:18:09.348808 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.348791    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-947484964-kdbbn"]
Jul 29 19:18:09.348908 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.348895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.350492 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.350476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.352902 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.352884    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 19:18:09.355240 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355219    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:18:09.355336 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355256    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 19:18:09.355336 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355265    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 19:18:09.355448 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355378    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 19:18:09.355495 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355448    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 19:18:09.355583 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355568    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 19:18:09.355655 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355630    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nrwfk\""
Jul 29 19:18:09.355701 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.355671    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k7njp\""
Jul 29 19:18:09.361580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.361560    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 19:18:09.367463 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.367445    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"]
Jul 29 19:18:09.368772 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368752    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f22d7a19-633e-42ad-b50a-e36e5036da59-config\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.368852 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdt9v\" (UniqueName: \"kubernetes.io/projected/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-kube-api-access-xdt9v\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.368852 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368836    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b81d897c-042e-449b-a56f-333ab4d4728e-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.368923 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.368923 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-trusted-ca\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.369034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-serving-cert\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.369034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368950    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mmx7\" (UniqueName: \"kubernetes.io/projected/b81d897c-042e-449b-a56f-333ab4d4728e-kube-api-access-4mmx7\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.369034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368967    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f22d7a19-633e-42ad-b50a-e36e5036da59-serving-cert\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.369034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.368981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc2z7\" (UniqueName: \"kubernetes.io/projected/678d1584-4ebe-4820-b648-28dc34191b40-kube-api-access-dc2z7\") pod \"volume-data-source-validator-549c6d54cf-7gjb7\" (UID: \"678d1584-4ebe-4820-b648-28dc34191b40\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"
Jul 29 19:18:09.369034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.369020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m646m\" (UniqueName: \"kubernetes.io/projected/f22d7a19-633e-42ad-b50a-e36e5036da59-kube-api-access-m646m\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.369238 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.369113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-config\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.372569 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.372550    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-947484964-kdbbn"]
Jul 29 19:18:09.469864 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.469842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54ec48ae-0e5c-408a-a398-8f1d3faa5516-ca-trust-extracted\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.469957 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.469868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32a75a3f-4a90-42e5-b202-d487db4bfc3f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.469957 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.469892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-trusted-ca\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.469957 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.469909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmkjp\" (UniqueName: \"kubernetes.io/projected/32a75a3f-4a90-42e5-b202-d487db4bfc3f-kube-api-access-xmkjp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.469957 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.469944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.469985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-serving-cert\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470013    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f22d7a19-633e-42ad-b50a-e36e5036da59-serving-cert\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m646m\" (UniqueName: \"kubernetes.io/projected/f22d7a19-633e-42ad-b50a-e36e5036da59-kube-api-access-m646m\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-config\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:09.470051    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f22d7a19-633e-42ad-b50a-e36e5036da59-config\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-certificates\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:09.470102    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls podName:b81d897c-042e-449b-a56f-333ab4d4728e nodeName:}" failed. No retries permitted until 2026-07-29 19:18:09.970085491 +0000 UTC m=+59.890395788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ghm2l" (UID: "b81d897c-042e-449b-a56f-333ab4d4728e") : secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:09.470152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470128    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-installation-pull-secrets\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mmx7\" (UniqueName: \"kubernetes.io/projected/b81d897c-042e-449b-a56f-333ab4d4728e-kube-api-access-4mmx7\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b81d897c-042e-449b-a56f-333ab4d4728e-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-bound-sa-token\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470241    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44kkm\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-kube-api-access-44kkm\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470265    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc2z7\" (UniqueName: \"kubernetes.io/projected/678d1584-4ebe-4820-b648-28dc34191b40-kube-api-access-dc2z7\") pod \"volume-data-source-validator-549c6d54cf-7gjb7\" (UID: \"678d1584-4ebe-4820-b648-28dc34191b40\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470486    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-image-registry-private-configuration\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-trusted-ca\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdt9v\" (UniqueName: \"kubernetes.io/projected/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-kube-api-access-xdt9v\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.470647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32a75a3f-4a90-42e5-b202-d487db4bfc3f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.471102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470811    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f22d7a19-633e-42ad-b50a-e36e5036da59-config\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.471102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.470829    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-config\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.471102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.471031    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-trusted-ca\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.471102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.471046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b81d897c-042e-449b-a56f-333ab4d4728e-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.474153 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.474130    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f22d7a19-633e-42ad-b50a-e36e5036da59-serving-cert\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.474223 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.474138    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-serving-cert\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.482588 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.482562    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m646m\" (UniqueName: \"kubernetes.io/projected/f22d7a19-633e-42ad-b50a-e36e5036da59-kube-api-access-m646m\") pod \"service-ca-operator-5d6c75f84f-vhccg\" (UID: \"f22d7a19-633e-42ad-b50a-e36e5036da59\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.486065 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.486036    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc2z7\" (UniqueName: \"kubernetes.io/projected/678d1584-4ebe-4820-b648-28dc34191b40-kube-api-access-dc2z7\") pod \"volume-data-source-validator-549c6d54cf-7gjb7\" (UID: \"678d1584-4ebe-4820-b648-28dc34191b40\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"
Jul 29 19:18:09.487179 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.487162    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mmx7\" (UniqueName: \"kubernetes.io/projected/b81d897c-042e-449b-a56f-333ab4d4728e-kube-api-access-4mmx7\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.487691 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.487674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdt9v\" (UniqueName: \"kubernetes.io/projected/3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b-kube-api-access-xdt9v\") pod \"console-operator-584dcb6b54-dgbql\" (UID: \"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.566564 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.566474    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"
Jul 29 19:18:09.571958 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.571940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-image-registry-private-configuration\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572002 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.571970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-trusted-ca\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572002 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.571992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32a75a3f-4a90-42e5-b202-d487db4bfc3f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.572087 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54ec48ae-0e5c-408a-a398-8f1d3faa5516-ca-trust-extracted\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572087 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572045    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32a75a3f-4a90-42e5-b202-d487db4bfc3f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.572158 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572083    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkjp\" (UniqueName: \"kubernetes.io/projected/32a75a3f-4a90-42e5-b202-d487db4bfc3f-kube-api-access-xmkjp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.572194 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-certificates\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572234 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-installation-pull-secrets\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572267 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-bound-sa-token\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572313 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572273    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44kkm\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-kube-api-access-44kkm\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572313 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572299    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.572408 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572348    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"
Jul 29 19:18:09.572408 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572396    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54ec48ae-0e5c-408a-a398-8f1d3faa5516-ca-trust-extracted\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.573270 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.572950    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32a75a3f-4a90-42e5-b202-d487db4bfc3f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.573270 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.573015    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-certificates\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.573270 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.573191    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-trusted-ca\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.573270 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:09.573242    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:18:09.573270 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:09.573256    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947484964-kdbbn: secret "image-registry-tls" not found
Jul 29 19:18:09.573562 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:09.573320    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls podName:54ec48ae-0e5c-408a-a398-8f1d3faa5516 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:10.073302508 +0000 UTC m=+59.993612806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls") pod "image-registry-947484964-kdbbn" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516") : secret "image-registry-tls" not found
Jul 29 19:18:09.574554 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.574508    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-installation-pull-secrets\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.574554 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.574529    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32a75a3f-4a90-42e5-b202-d487db4bfc3f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.574683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.574656    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-image-registry-private-configuration\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.577575 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.577553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:09.587199 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.587168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44kkm\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-kube-api-access-44kkm\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.587420 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.587403    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-bound-sa-token\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:09.588557 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.588514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkjp\" (UniqueName: \"kubernetes.io/projected/32a75a3f-4a90-42e5-b202-d487db4bfc3f-kube-api-access-xmkjp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98\" (UID: \"32a75a3f-4a90-42e5-b202-d487db4bfc3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.660721 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.659881    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"
Jul 29 19:18:09.723479 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.723452    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7"]
Jul 29 19:18:09.730580 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:09.730540    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678d1584_4ebe_4820_b648_28dc34191b40.slice/crio-ad043c02bb1122dedb4ff7374dfb025db1ff945020cda47ab86611bccf22c29d WatchSource:0}: Error finding container ad043c02bb1122dedb4ff7374dfb025db1ff945020cda47ab86611bccf22c29d: Status 404 returned error can't find the container with id ad043c02bb1122dedb4ff7374dfb025db1ff945020cda47ab86611bccf22c29d
Jul 29 19:18:09.761712 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.761687    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dgbql"]
Jul 29 19:18:09.765290 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:09.765267    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f28a200_de12_4d8c_9cdd_3f2fbe64ce3b.slice/crio-f3c73a1eb1f7dd3741ca4b2e1431397bc7537326e2aff1877805aeb79718712d WatchSource:0}: Error finding container f3c73a1eb1f7dd3741ca4b2e1431397bc7537326e2aff1877805aeb79718712d: Status 404 returned error can't find the container with id f3c73a1eb1f7dd3741ca4b2e1431397bc7537326e2aff1877805aeb79718712d
Jul 29 19:18:09.805728 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.805707    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98"]
Jul 29 19:18:09.808808 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:09.808785    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a75a3f_4a90_42e5_b202_d487db4bfc3f.slice/crio-ac49684d62534616a7efbcc472c5cb9190067f1c2126d081ce1f0a592e2153e4 WatchSource:0}: Error finding container ac49684d62534616a7efbcc472c5cb9190067f1c2126d081ce1f0a592e2153e4: Status 404 returned error can't find the container with id ac49684d62534616a7efbcc472c5cb9190067f1c2126d081ce1f0a592e2153e4
Jul 29 19:18:09.930524 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.930495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98" event={"ID":"32a75a3f-4a90-42e5-b202-d487db4bfc3f","Type":"ContainerStarted","Data":"ac49684d62534616a7efbcc472c5cb9190067f1c2126d081ce1f0a592e2153e4"}
Jul 29 19:18:09.931517 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.931495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7" event={"ID":"678d1584-4ebe-4820-b648-28dc34191b40","Type":"ContainerStarted","Data":"ad043c02bb1122dedb4ff7374dfb025db1ff945020cda47ab86611bccf22c29d"}
Jul 29 19:18:09.932442 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.932422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" event={"ID":"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b","Type":"ContainerStarted","Data":"f3c73a1eb1f7dd3741ca4b2e1431397bc7537326e2aff1877805aeb79718712d"}
Jul 29 19:18:09.933994 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.933975    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg"]
Jul 29 19:18:09.936621 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:09.936589    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22d7a19_633e_42ad_b50a_e36e5036da59.slice/crio-ae8fcdfca17aefb73a9c52fa48647d2d9053e86a7bb7b384450a7a11a593c2a9 WatchSource:0}: Error finding container ae8fcdfca17aefb73a9c52fa48647d2d9053e86a7bb7b384450a7a11a593c2a9: Status 404 returned error can't find the container with id ae8fcdfca17aefb73a9c52fa48647d2d9053e86a7bb7b384450a7a11a593c2a9
Jul 29 19:18:09.977348 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:09.977327    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:09.977478 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:09.977461    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:09.977526 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:09.977520    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls podName:b81d897c-042e-449b-a56f-333ab4d4728e nodeName:}" failed. No retries permitted until 2026-07-29 19:18:10.977501766 +0000 UTC m=+60.897812067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ghm2l" (UID: "b81d897c-042e-449b-a56f-333ab4d4728e") : secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:10.077900 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:10.077877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:10.078024 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:10.078006    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:18:10.078074 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:10.078025    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947484964-kdbbn: secret "image-registry-tls" not found
Jul 29 19:18:10.078115 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:10.078078    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls podName:54ec48ae-0e5c-408a-a398-8f1d3faa5516 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:11.078064617 +0000 UTC m=+60.998374914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls") pod "image-registry-947484964-kdbbn" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516") : secret "image-registry-tls" not found
Jul 29 19:18:10.861987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:10.861956    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwdpj"
Jul 29 19:18:10.936777 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:10.936712    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg" event={"ID":"f22d7a19-633e-42ad-b50a-e36e5036da59","Type":"ContainerStarted","Data":"ae8fcdfca17aefb73a9c52fa48647d2d9053e86a7bb7b384450a7a11a593c2a9"}
Jul 29 19:18:10.986970 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:10.986273    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:10.986970 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:10.986737    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:10.986970 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:10.986805    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls podName:b81d897c-042e-449b-a56f-333ab4d4728e nodeName:}" failed. No retries permitted until 2026-07-29 19:18:12.986785629 +0000 UTC m=+62.907095928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ghm2l" (UID: "b81d897c-042e-449b-a56f-333ab4d4728e") : secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:11.087746 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:11.087706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:11.087907 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:11.087896    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:18:11.087961 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:11.087913    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947484964-kdbbn: secret "image-registry-tls" not found
Jul 29 19:18:11.088017 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:11.087970    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls podName:54ec48ae-0e5c-408a-a398-8f1d3faa5516 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:13.087950253 +0000 UTC m=+63.008260552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls") pod "image-registry-947484964-kdbbn" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516") : secret "image-registry-tls" not found
Jul 29 19:18:11.942131 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:11.942069    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7" event={"ID":"678d1584-4ebe-4820-b648-28dc34191b40","Type":"ContainerStarted","Data":"42c0fb6d3ea00b86df2fd5afb41ce7e91d2e38d53959710351c957291338b222"}
Jul 29 19:18:11.960978 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:11.960925    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7gjb7" podStartSLOduration=1.4694901599999999 podStartE2EDuration="2.960905403s" totalImagesPullingTime="1.491415243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:11.960068069 +0000 UTC m=+61.880378391" watchObservedRunningTime="2026-07-29 19:18:11.960905403 +0000 UTC m=+61.881215726"
Jul 29 19:18:13.003898 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.003872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:13.004258 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.004025    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:13.004258 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.004096    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls podName:b81d897c-042e-449b-a56f-333ab4d4728e nodeName:}" failed. No retries permitted until 2026-07-29 19:18:17.004074903 +0000 UTC m=+66.924385219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ghm2l" (UID: "b81d897c-042e-449b-a56f-333ab4d4728e") : secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:13.089283 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.089127    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mrjst"]
Jul 29 19:18:13.091798 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.091775    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.094641 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.094581    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-mrjst\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7" pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.094785 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.094683    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Jul 29 19:18:13.094966 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.094936    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-knhpr\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-knhpr\"" type="*v1.Secret"
Jul 29 19:18:13.095090 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.095067    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 29 19:18:13.095090 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.095075    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 29 19:18:13.095290 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.095260    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 29 19:18:13.104285 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.104258    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-data-volume\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.104375 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.104296    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2pl9\" (UniqueName: \"kubernetes.io/projected/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-api-access-m2pl9\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.104375 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.104334    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:13.104375 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.104358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.104514 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.104447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-crio-socket\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.104514 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.104471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.104653 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.104638    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:18:13.104707 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.104655    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947484964-kdbbn: secret "image-registry-tls" not found
Jul 29 19:18:13.104741 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:13.104710    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls podName:54ec48ae-0e5c-408a-a398-8f1d3faa5516 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:17.104693271 +0000 UTC m=+67.025003575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls") pod "image-registry-947484964-kdbbn" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516") : secret "image-registry-tls" not found
Jul 29 19:18:13.112146 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.112125    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mrjst"]
Jul 29 19:18:13.205416 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.205391    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-crio-socket\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.205518 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.205423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.205518 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.205486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-data-volume\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.205518 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.205513    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pl9\" (UniqueName: \"kubernetes.io/projected/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-api-access-m2pl9\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.205682 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.205540    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-crio-socket\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.205682 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.205558    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.205818 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.205802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-data-volume\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:13.949118 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.949088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg" event={"ID":"f22d7a19-633e-42ad-b50a-e36e5036da59","Type":"ContainerStarted","Data":"37dd8255e0810e935c16231d3be5bd0aa00b406aa58459052398547a795f5b1c"}
Jul 29 19:18:13.951064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.951028    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/0.log"
Jul 29 19:18:13.951176 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.951074    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b" containerID="2422c6ede763ee2ff76a6f0d27064e1ee01913bc387cce4ad34569f5af6e3b29" exitCode=255
Jul 29 19:18:13.951176 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.951160    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" event={"ID":"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b","Type":"ContainerDied","Data":"2422c6ede763ee2ff76a6f0d27064e1ee01913bc387cce4ad34569f5af6e3b29"}
Jul 29 19:18:13.951381 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.951335    2584 scope.go:117] "RemoveContainer" containerID="2422c6ede763ee2ff76a6f0d27064e1ee01913bc387cce4ad34569f5af6e3b29"
Jul 29 19:18:13.954414 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.954384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98" event={"ID":"32a75a3f-4a90-42e5-b202-d487db4bfc3f","Type":"ContainerStarted","Data":"2fc2ed4f091472a65e8fce6de7660cbb2e7211bc01d4d5b33c8ab6e33ce38488"}
Jul 29 19:18:13.965280 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:13.965231    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg" podStartSLOduration=1.9211449470000002 podStartE2EDuration="4.96521567s" totalImagesPullingTime="3.044070723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:13.964347557 +0000 UTC m=+63.884657889" watchObservedRunningTime="2026-07-29 19:18:13.96521567 +0000 UTC m=+63.885525991"
Jul 29 19:18:14.015873 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.015815    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98" podStartSLOduration=1.845892707 podStartE2EDuration="5.015796595s" totalImagesPullingTime="3.169903888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:14.015247584 +0000 UTC m=+63.935557904" watchObservedRunningTime="2026-07-29 19:18:14.015796595 +0000 UTC m=+63.936106917"
Jul 29 19:18:14.206289 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.206230    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition
Jul 29 19:18:14.206400 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.206316    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:14.706296707 +0000 UTC m=+64.626607018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : failed to sync configmap cache: timed out waiting for the condition
Jul 29 19:18:14.206400 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.206235    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition
Jul 29 19:18:14.206400 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.206375    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:14.706361894 +0000 UTC m=+64.626672196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : failed to sync secret cache: timed out waiting for the condition
Jul 29 19:18:14.212278 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.212255    2584 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 29 19:18:14.271140 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.271122    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 19:18:14.358160 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.358136    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-knhpr\""
Jul 29 19:18:14.443472 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.443444    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 19:18:14.678313 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.678287    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 19:18:14.683250 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.683234    2584 projected.go:196] Error preparing data for projected volume kube-api-access-m2pl9 for pod openshift-insights/insights-runtime-extractor-mrjst: failed to sync configmap cache: timed out waiting for the condition
Jul 29 19:18:14.683354 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.683291    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-api-access-m2pl9 podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:15.183272863 +0000 UTC m=+65.103583161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m2pl9" (UniqueName: "kubernetes.io/projected/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-api-access-m2pl9") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : failed to sync configmap cache: timed out waiting for the condition
Jul 29 19:18:14.693152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.693128    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 19:18:14.717696 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.717675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:14.717781 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.717748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:14.717819 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.717787    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:18:14.717852 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.717836    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:15.717823764 +0000 UTC m=+65.638134061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : configmap "kube-rbac-proxy" not found
Jul 29 19:18:14.717890 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.717858    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:14.717922 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.717899    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:15.71788821 +0000 UTC m=+65.638198508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:14.933014 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.932947    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p5gsl_d82635f6-4578-42e2-9ea8-4183e286887c/dns-node-resolver/0.log"
Jul 29 19:18:14.958887 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.958869    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:18:14.959258 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.959244    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/0.log"
Jul 29 19:18:14.959325 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.959277    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b" containerID="1edc099a91d6382fc68f03eeff07c003b19b89771dc8e357af6b836b10d2f4d9" exitCode=255
Jul 29 19:18:14.959362 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.959346    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" event={"ID":"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b","Type":"ContainerDied","Data":"1edc099a91d6382fc68f03eeff07c003b19b89771dc8e357af6b836b10d2f4d9"}
Jul 29 19:18:14.964377 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.964356    2584 scope.go:117] "RemoveContainer" containerID="2422c6ede763ee2ff76a6f0d27064e1ee01913bc387cce4ad34569f5af6e3b29"
Jul 29 19:18:14.964463 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:14.964444    2584 scope.go:117] "RemoveContainer" containerID="1edc099a91d6382fc68f03eeff07c003b19b89771dc8e357af6b836b10d2f4d9"
Jul 29 19:18:14.964643 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:14.964619    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgbql_openshift-console-operator(3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" podUID="3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b"
Jul 29 19:18:15.221461 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.221402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pl9\" (UniqueName: \"kubernetes.io/projected/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-api-access-m2pl9\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:15.221461 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.221457    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:18:15.221944 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.221503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:18:15.223708 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.223691    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2pl9\" (UniqueName: \"kubernetes.io/projected/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-api-access-m2pl9\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:15.224629 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.224597    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:18:15.224690 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.224641    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:18:15.232434 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:15.232416    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 19:18:15.232527 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:15.232467    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs podName:005fe08a-66f3-4973-884c-26ed86e6fa5f nodeName:}" failed. No retries permitted until 2026-07-29 19:19:19.232453838 +0000 UTC m=+129.152764136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs") pod "network-metrics-daemon-mtcn6" (UID: "005fe08a-66f3-4973-884c-26ed86e6fa5f") : secret "metrics-daemon-secret" not found
Jul 29 19:18:15.234248 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.234230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a07531d-5792-4873-941d-1887f0064274-original-pull-secret\") pod \"global-pull-secret-syncer-fqssn\" (UID: \"9a07531d-5792-4873-941d-1887f0064274\") " pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:18:15.302548 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.302523    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqssn"
Jul 29 19:18:15.322050 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.322029    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:18:15.325052 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.325037    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:18:15.334773 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.334753    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:18:15.345175 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.345149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4kr6\" (UniqueName: \"kubernetes.io/projected/5849f3b0-2a3d-4aa6-983f-7903849ea504-kube-api-access-q4kr6\") pod \"network-check-target-g5zrq\" (UID: \"5849f3b0-2a3d-4aa6-983f-7903849ea504\") " pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:18:15.455643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.455597    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fqssn"]
Jul 29 19:18:15.459476 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:15.459445    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a07531d_5792_4873_941d_1887f0064274.slice/crio-44ef8781e6ad9e88b180a0c7a997b1a3609fd630ff56d6bdf380cadd001ef5b4 WatchSource:0}: Error finding container 44ef8781e6ad9e88b180a0c7a997b1a3609fd630ff56d6bdf380cadd001ef5b4: Status 404 returned error can't find the container with id 44ef8781e6ad9e88b180a0c7a997b1a3609fd630ff56d6bdf380cadd001ef5b4
Jul 29 19:18:15.611642 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.611620    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bfbzc\""
Jul 29 19:18:15.617666 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.617646    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:18:15.726126 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.726098    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:15.726259 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.726192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:15.726314 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:15.726288    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:15.726314 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:15.726305    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:18:15.726382 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:15.726364    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:17.726343649 +0000 UTC m=+67.646653951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:15.726431 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:15.726386    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:17.726374948 +0000 UTC m=+67.646685255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : configmap "kube-rbac-proxy" not found
Jul 29 19:18:15.766095 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.766059    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g5zrq"]
Jul 29 19:18:15.770198 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:15.770173    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5849f3b0_2a3d_4aa6_983f_7903849ea504.slice/crio-fe55f697354a586a47c62a81bfe43c9935ad1ebd518ed4e3497597bae245ef17 WatchSource:0}: Error finding container fe55f697354a586a47c62a81bfe43c9935ad1ebd518ed4e3497597bae245ef17: Status 404 returned error can't find the container with id fe55f697354a586a47c62a81bfe43c9935ad1ebd518ed4e3497597bae245ef17
Jul 29 19:18:15.963435 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.963376    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:18:15.963742 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.963725    2584 scope.go:117] "RemoveContainer" containerID="1edc099a91d6382fc68f03eeff07c003b19b89771dc8e357af6b836b10d2f4d9"
Jul 29 19:18:15.963935 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:15.963910    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgbql_openshift-console-operator(3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" podUID="3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b"
Jul 29 19:18:15.964790 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.964732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g5zrq" event={"ID":"5849f3b0-2a3d-4aa6-983f-7903849ea504","Type":"ContainerStarted","Data":"fe55f697354a586a47c62a81bfe43c9935ad1ebd518ed4e3497597bae245ef17"}
Jul 29 19:18:15.965976 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:15.965950    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fqssn" event={"ID":"9a07531d-5792-4873-941d-1887f0064274","Type":"ContainerStarted","Data":"44ef8781e6ad9e88b180a0c7a997b1a3609fd630ff56d6bdf380cadd001ef5b4"}
Jul 29 19:18:16.132622 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:16.132588    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hj4d7_388b2184-94cf-4f9f-89a9-8fbb36be29e5/node-ca/0.log"
Jul 29 19:18:16.533053 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:16.532977    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j8552_030f3207-da35-4ddf-95ba-4913da56f008/serve-healthcheck-canary/0.log"
Jul 29 19:18:16.835311 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:16.835278    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:18:16.835473 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:16.835413    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:18:16.835519 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:16.835479    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls podName:589ae4b3-0f85-479b-af86-4e5dc69766e2 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:48.835460523 +0000 UTC m=+98.755770824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls") pod "dns-default-v8h5x" (UID: "589ae4b3-0f85-479b-af86-4e5dc69766e2") : secret "dns-default-metrics-tls" not found
Jul 29 19:18:17.036787 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:17.036751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:17.036966 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.036882    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:17.036966 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.036963    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls podName:b81d897c-042e-449b-a56f-333ab4d4728e nodeName:}" failed. No retries permitted until 2026-07-29 19:18:25.036940685 +0000 UTC m=+74.957250998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ghm2l" (UID: "b81d897c-042e-449b-a56f-333ab4d4728e") : secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:17.137452 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:17.137373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:17.137595 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.137524    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:18:17.137595 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.137544    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947484964-kdbbn: secret "image-registry-tls" not found
Jul 29 19:18:17.137746 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.137627    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls podName:54ec48ae-0e5c-408a-a398-8f1d3faa5516 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:25.137590501 +0000 UTC m=+75.057900824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls") pod "image-registry-947484964-kdbbn" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516") : secret "image-registry-tls" not found
Jul 29 19:18:17.742297 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:17.742253    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:17.742746 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:17.742363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:17.742746 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.742426    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:17.742746 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.742497    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:21.742478588 +0000 UTC m=+71.662788891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:17.742746 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.742510    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:18:17.742746 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:17.742654    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:21.742639714 +0000 UTC m=+71.662950030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : configmap "kube-rbac-proxy" not found
Jul 29 19:18:19.578685 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:19.578646    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:19.579097 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:19.578738    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:19.579097 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:19.579084    2584 scope.go:117] "RemoveContainer" containerID="1edc099a91d6382fc68f03eeff07c003b19b89771dc8e357af6b836b10d2f4d9"
Jul 29 19:18:19.579246 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:19.579225    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgbql_openshift-console-operator(3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" podUID="3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b"
Jul 29 19:18:20.986382 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:20.986348    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g5zrq" event={"ID":"5849f3b0-2a3d-4aa6-983f-7903849ea504","Type":"ContainerStarted","Data":"1ff188f6d8df58b56fcc075d1d2590c50e6bc3073bc50b3bab1cc32617ef6026"}
Jul 29 19:18:20.986833 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:20.986430    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:18:20.987767 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:20.987745    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fqssn" event={"ID":"9a07531d-5792-4873-941d-1887f0064274","Type":"ContainerStarted","Data":"9b531534eb57995e3300bd340c7c4c0d5c0ad5586aa886b8673ef07be94d1ab8"}
Jul 29 19:18:21.004679 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:21.004635    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g5zrq" podStartSLOduration=66.814193289 podStartE2EDuration="1m11.004623121s" totalImagesPullingTime="4.190429832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:21.003716431 +0000 UTC m=+70.924026750" watchObservedRunningTime="2026-07-29 19:18:21.004623121 +0000 UTC m=+70.924933449"
Jul 29 19:18:21.019943 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:21.019906    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fqssn" podStartSLOduration=66.513548209 podStartE2EDuration="1m11.019894817s" totalImagesPullingTime="4.506346608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:21.019419582 +0000 UTC m=+70.939729902" watchObservedRunningTime="2026-07-29 19:18:21.019894817 +0000 UTC m=+70.940205134"
Jul 29 19:18:21.772091 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:21.772047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:21.772250 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:21.772120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:21.772250 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:21.772197    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:18:21.772343 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:21.772274    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:29.772255806 +0000 UTC m=+79.692566104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : configmap "kube-rbac-proxy" not found
Jul 29 19:18:21.772343 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:21.772286    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:21.772481 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:21.772344    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:29.772329942 +0000 UTC m=+79.692640240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:25.097872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:25.097833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:25.098260 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:25.097977    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:25.098260 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:25.098037    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls podName:b81d897c-042e-449b-a56f-333ab4d4728e nodeName:}" failed. No retries permitted until 2026-07-29 19:18:41.098022829 +0000 UTC m=+91.018333126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-ghm2l" (UID: "b81d897c-042e-449b-a56f-333ab4d4728e") : secret "cluster-monitoring-operator-tls" not found
Jul 29 19:18:25.198130 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:25.198096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") pod \"image-registry-947484964-kdbbn\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") " pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:25.198261 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:25.198244    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:18:25.198314 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:25.198262    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947484964-kdbbn: secret "image-registry-tls" not found
Jul 29 19:18:25.198349 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:25.198313    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls podName:54ec48ae-0e5c-408a-a398-8f1d3faa5516 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:41.198298302 +0000 UTC m=+91.118608601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls") pod "image-registry-947484964-kdbbn" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516") : secret "image-registry-tls" not found
Jul 29 19:18:29.834380 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:29.834278    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:29.834380 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:29.834380    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:29.834876 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:29.834459    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:29.834876 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:29.834556    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls podName:9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:45.83453198 +0000 UTC m=+95.754842282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mrjst" (UID: "9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:18:29.834972 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:29.834950    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:32.587975 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:32.587839    2584 scope.go:117] "RemoveContainer" containerID="1edc099a91d6382fc68f03eeff07c003b19b89771dc8e357af6b836b10d2f4d9"
Jul 29 19:18:33.028491 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:33.028423    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:18:33.028491 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:33.028464    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" event={"ID":"3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b","Type":"ContainerStarted","Data":"1d4b1b575d7462d54702fbc09b3747a3583af43d60b48b889a2cb2456d6c5184"}
Jul 29 19:18:33.028753 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:33.028734    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:33.047246 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:33.047202    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql" podStartSLOduration=20.839015841 podStartE2EDuration="24.047189054s" totalImagesPullingTime="3.208173213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:33.046543276 +0000 UTC m=+82.966853597" watchObservedRunningTime="2026-07-29 19:18:33.047189054 +0000 UTC m=+82.967499401"
Jul 29 19:18:33.115277 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:33.115255    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-dgbql"
Jul 29 19:18:39.613471 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.613432    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"]
Jul 29 19:18:39.616558 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.616537    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.619328 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.619305    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 19:18:39.620522 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.620499    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 19:18:39.620643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.620560    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 19:18:39.620643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.620499    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 19:18:39.630717 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.630692    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"]
Jul 29 19:18:39.661758 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.661735    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-947484964-kdbbn"]
Jul 29 19:18:39.661972 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:39.661951    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-947484964-kdbbn" podUID="54ec48ae-0e5c-408a-a398-8f1d3faa5516"
Jul 29 19:18:39.706715 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.706693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b9a8a698-4528-47b0-95e4-b2657993f5a7-klusterlet-config\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.706816 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.706762    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nc96\" (UniqueName: \"kubernetes.io/projected/b9a8a698-4528-47b0-95e4-b2657993f5a7-kube-api-access-8nc96\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.706858 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.706815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9a8a698-4528-47b0-95e4-b2657993f5a7-tmp\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.716584 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.716557    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dc6cc454f-59dcj"]
Jul 29 19:18:39.719332 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.719317    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.740846 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.740815    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc6cc454f-59dcj"]
Jul 29 19:18:39.807169 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-registry-tls\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807256 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b363d194-6b82-43dd-899b-8114d9b70dd7-registry-certificates\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807256 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807194    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b9a8a698-4528-47b0-95e4-b2657993f5a7-klusterlet-config\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.807256 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807213    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfznb\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-kube-api-access-dfznb\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807361 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807280    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b363d194-6b82-43dd-899b-8114d9b70dd7-trusted-ca\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807361 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807329    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nc96\" (UniqueName: \"kubernetes.io/projected/b9a8a698-4528-47b0-95e4-b2657993f5a7-kube-api-access-8nc96\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.807361 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807357    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b363d194-6b82-43dd-899b-8114d9b70dd7-ca-trust-extracted\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807448 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b363d194-6b82-43dd-899b-8114d9b70dd7-image-registry-private-configuration\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807448 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807429    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9a8a698-4528-47b0-95e4-b2657993f5a7-tmp\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.807513 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807451    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b363d194-6b82-43dd-899b-8114d9b70dd7-installation-pull-secrets\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807513 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807479    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-bound-sa-token\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.807753 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.807735    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9a8a698-4528-47b0-95e4-b2657993f5a7-tmp\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.809649 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.809630    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b9a8a698-4528-47b0-95e4-b2657993f5a7-klusterlet-config\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.818728 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.818708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nc96\" (UniqueName: \"kubernetes.io/projected/b9a8a698-4528-47b0-95e4-b2657993f5a7-kube-api-access-8nc96\") pod \"klusterlet-addon-workmgr-794b7db668-ksq29\" (UID: \"b9a8a698-4528-47b0-95e4-b2657993f5a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:39.908757 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.908702    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfznb\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-kube-api-access-dfznb\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.908757 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.908748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b363d194-6b82-43dd-899b-8114d9b70dd7-trusted-ca\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.908878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.908784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b363d194-6b82-43dd-899b-8114d9b70dd7-ca-trust-extracted\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.908878 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.908815    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b363d194-6b82-43dd-899b-8114d9b70dd7-image-registry-private-configuration\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.908990 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.908971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b363d194-6b82-43dd-899b-8114d9b70dd7-installation-pull-secrets\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.909056 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.909023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-bound-sa-token\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.909107 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.909067    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-registry-tls\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.909107 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.909094    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b363d194-6b82-43dd-899b-8114d9b70dd7-registry-certificates\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.909223 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.909198    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b363d194-6b82-43dd-899b-8114d9b70dd7-ca-trust-extracted\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.909883 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.909862    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b363d194-6b82-43dd-899b-8114d9b70dd7-trusted-ca\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.909986 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.909895    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b363d194-6b82-43dd-899b-8114d9b70dd7-registry-certificates\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.911048 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.911031    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b363d194-6b82-43dd-899b-8114d9b70dd7-image-registry-private-configuration\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.911128 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.911068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b363d194-6b82-43dd-899b-8114d9b70dd7-installation-pull-secrets\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.911491 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.911475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-registry-tls\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.917074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.917055    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-bound-sa-token\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.917734 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.917716    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfznb\" (UniqueName: \"kubernetes.io/projected/b363d194-6b82-43dd-899b-8114d9b70dd7-kube-api-access-dfznb\") pod \"image-registry-5dc6cc454f-59dcj\" (UID: \"b363d194-6b82-43dd-899b-8114d9b70dd7\") " pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:39.926490 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:39.926468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:40.031754 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.031731    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k7njp\""
Jul 29 19:18:40.038216 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.038195    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:40.052666 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.052643    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"]
Jul 29 19:18:40.053407 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.053390    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:40.056167 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:40.056143    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a8a698_4528_47b0_95e4_b2657993f5a7.slice/crio-19385c74707637766fa3a93a0783d9964f5ad85f96831c16ce69cabf3687d618 WatchSource:0}: Error finding container 19385c74707637766fa3a93a0783d9964f5ad85f96831c16ce69cabf3687d618: Status 404 returned error can't find the container with id 19385c74707637766fa3a93a0783d9964f5ad85f96831c16ce69cabf3687d618
Jul 29 19:18:40.062246 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.062227    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:40.110913 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.110891    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44kkm\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-kube-api-access-44kkm\") pod \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") "
Jul 29 19:18:40.111027 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.110927    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54ec48ae-0e5c-408a-a398-8f1d3faa5516-ca-trust-extracted\") pod \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") "
Jul 29 19:18:40.111027 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.110943    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-bound-sa-token\") pod \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") "
Jul 29 19:18:40.111027 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.110978    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-certificates\") pod \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") "
Jul 29 19:18:40.111159 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.111026    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-installation-pull-secrets\") pod \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") "
Jul 29 19:18:40.111159 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.111073    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-trusted-ca\") pod \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") "
Jul 29 19:18:40.111159 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.111116    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-image-registry-private-configuration\") pod \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\" (UID: \"54ec48ae-0e5c-408a-a398-8f1d3faa5516\") "
Jul 29 19:18:40.111306 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.111153    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ec48ae-0e5c-408a-a398-8f1d3faa5516-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "54ec48ae-0e5c-408a-a398-8f1d3faa5516" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:18:40.111485 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.111442    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54ec48ae-0e5c-408a-a398-8f1d3faa5516-ca-trust-extracted\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:40.111580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.111529    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "54ec48ae-0e5c-408a-a398-8f1d3faa5516" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:18:40.111580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.111537    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "54ec48ae-0e5c-408a-a398-8f1d3faa5516" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:18:40.113221 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.113195    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-kube-api-access-44kkm" (OuterVolumeSpecName: "kube-api-access-44kkm") pod "54ec48ae-0e5c-408a-a398-8f1d3faa5516" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516"). InnerVolumeSpecName "kube-api-access-44kkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:18:40.113305 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.113219    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "54ec48ae-0e5c-408a-a398-8f1d3faa5516" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:18:40.113305 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.113248    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "54ec48ae-0e5c-408a-a398-8f1d3faa5516" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:18:40.113439 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.113420    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "54ec48ae-0e5c-408a-a398-8f1d3faa5516" (UID: "54ec48ae-0e5c-408a-a398-8f1d3faa5516"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:18:40.163764 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.163747    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc6cc454f-59dcj"]
Jul 29 19:18:40.166063 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:40.166032    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb363d194_6b82_43dd_899b_8114d9b70dd7.slice/crio-079c223a28fc303e625f428ca31830629a11242e034c0b0c7fa006137aa162e1 WatchSource:0}: Error finding container 079c223a28fc303e625f428ca31830629a11242e034c0b0c7fa006137aa162e1: Status 404 returned error can't find the container with id 079c223a28fc303e625f428ca31830629a11242e034c0b0c7fa006137aa162e1
Jul 29 19:18:40.211790 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.211769    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-certificates\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:40.211790 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.211790    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-installation-pull-secrets\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:40.211893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.211799    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54ec48ae-0e5c-408a-a398-8f1d3faa5516-trusted-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:40.211893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.211808    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54ec48ae-0e5c-408a-a398-8f1d3faa5516-image-registry-private-configuration\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:40.211893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.211817    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44kkm\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-kube-api-access-44kkm\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:40.211893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:40.211825    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-bound-sa-token\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:41.058543 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.058453    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29" event={"ID":"b9a8a698-4528-47b0-95e4-b2657993f5a7","Type":"ContainerStarted","Data":"19385c74707637766fa3a93a0783d9964f5ad85f96831c16ce69cabf3687d618"}
Jul 29 19:18:41.063971 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.063947    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947484964-kdbbn"
Jul 29 19:18:41.064094 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.063939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj" event={"ID":"b363d194-6b82-43dd-899b-8114d9b70dd7","Type":"ContainerStarted","Data":"cbb5e73083652ba1962575dda9e08b0a4a7c328de450e09720b80ceb4f761fa4"}
Jul 29 19:18:41.064234 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.064095    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj" event={"ID":"b363d194-6b82-43dd-899b-8114d9b70dd7","Type":"ContainerStarted","Data":"079c223a28fc303e625f428ca31830629a11242e034c0b0c7fa006137aa162e1"}
Jul 29 19:18:41.095077 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.095054    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-947484964-kdbbn"]
Jul 29 19:18:41.097174 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.097154    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-947484964-kdbbn"]
Jul 29 19:18:41.118923 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.118883    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj" podStartSLOduration=2.118870709 podStartE2EDuration="2.118870709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:41.118146777 +0000 UTC m=+91.038457108" watchObservedRunningTime="2026-07-29 19:18:41.118870709 +0000 UTC m=+91.039181006"
Jul 29 19:18:41.120422 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.120401    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:41.122907 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.122885    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81d897c-042e-449b-a56f-333ab4d4728e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-ghm2l\" (UID: \"b81d897c-042e-449b-a56f-333ab4d4728e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:41.221575 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.221543    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54ec48ae-0e5c-408a-a398-8f1d3faa5516-registry-tls\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:18:41.361042 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.361014    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c9nbg\""
Jul 29 19:18:41.367392 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.367370    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"
Jul 29 19:18:41.490890 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:41.490862    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l"]
Jul 29 19:18:41.493452 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:41.493427    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81d897c_042e_449b_a56f_333ab4d4728e.slice/crio-9267603e17734f57ff12b8d73f911dc2cacc4d62c24884ecd1dd78dbff5fff43 WatchSource:0}: Error finding container 9267603e17734f57ff12b8d73f911dc2cacc4d62c24884ecd1dd78dbff5fff43: Status 404 returned error can't find the container with id 9267603e17734f57ff12b8d73f911dc2cacc4d62c24884ecd1dd78dbff5fff43
Jul 29 19:18:42.070353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:42.070314    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l" event={"ID":"b81d897c-042e-449b-a56f-333ab4d4728e","Type":"ContainerStarted","Data":"9267603e17734f57ff12b8d73f911dc2cacc4d62c24884ecd1dd78dbff5fff43"}
Jul 29 19:18:42.070740 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:42.070465    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:18:42.592209 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:42.592180    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ec48ae-0e5c-408a-a398-8f1d3faa5516" path="/var/lib/kubelet/pods/54ec48ae-0e5c-408a-a398-8f1d3faa5516/volumes"
Jul 29 19:18:43.620521 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.620493    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6777d689db-8cq9b"]
Jul 29 19:18:43.647226 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.647205    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6777d689db-8cq9b"]
Jul 29 19:18:43.647346 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.647295    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.652226 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.652203    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 19:18:43.652345 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.652205    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v8zkg\""
Jul 29 19:18:43.652719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.652700    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 19:18:43.653175 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.653157    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 19:18:43.653265 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.653161    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 19:18:43.656507 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.656493    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 19:18:43.660838 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.660823    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 19:18:43.660946 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.660929    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 19:18:43.741641 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.741620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-serving-cert\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.741729 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.741666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-console-config\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.741729 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.741697    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-service-ca\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.741824 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.741755    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-oauth-config\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.741824 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.741779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-oauth-serving-cert\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.741824 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.741797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqcs7\" (UniqueName: \"kubernetes.io/projected/b69fb03d-4901-4839-822b-e5fbc0adba67-kube-api-access-rqcs7\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.842489 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.842466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-console-config\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.842572 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.842503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-service-ca\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.842572 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.842534    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-oauth-config\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.842572 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.842550    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-oauth-serving-cert\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.842572 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.842567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqcs7\" (UniqueName: \"kubernetes.io/projected/b69fb03d-4901-4839-822b-e5fbc0adba67-kube-api-access-rqcs7\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.842747 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.842636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-serving-cert\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.843192 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.843170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-service-ca\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.843273 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.843220    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-console-config\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.843273 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.843240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-oauth-serving-cert\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.844999 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.844976    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-oauth-config\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.845080 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.845011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-serving-cert\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.850847 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.850827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqcs7\" (UniqueName: \"kubernetes.io/projected/b69fb03d-4901-4839-822b-e5fbc0adba67-kube-api-access-rqcs7\") pod \"console-6777d689db-8cq9b\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") " pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:43.956192 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:43.956146    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:44.168974 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.168919    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6777d689db-8cq9b"]
Jul 29 19:18:44.619622 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.619563    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"]
Jul 29 19:18:44.621957 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.621934    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:44.625515 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.625490    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 19:18:44.625662 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.625532    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5ngrh\""
Jul 29 19:18:44.632508 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.632485    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"]
Jul 29 19:18:44.750713 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.750675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/71179293-1931-424a-9e76-08cd2c6bbb52-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-hfp9q\" (UID: \"71179293-1931-424a-9e76-08cd2c6bbb52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:44.852881 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:44.852828    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/71179293-1931-424a-9e76-08cd2c6bbb52-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-hfp9q\" (UID: \"71179293-1931-424a-9e76-08cd2c6bbb52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:44.853088 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:44.852982    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 19:18:44.853088 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:18:44.853078    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71179293-1931-424a-9e76-08cd2c6bbb52-tls-certificates podName:71179293-1931-424a-9e76-08cd2c6bbb52 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:45.35305556 +0000 UTC m=+95.273365873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/71179293-1931-424a-9e76-08cd2c6bbb52-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-hfp9q" (UID: "71179293-1931-424a-9e76-08cd2c6bbb52") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 19:18:45.092672 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.092632    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777d689db-8cq9b" event={"ID":"b69fb03d-4901-4839-822b-e5fbc0adba67","Type":"ContainerStarted","Data":"1742da6098a8edb6f733c173d5ee9998ca882a2c7a5895fa4073ca5cb891a792"}
Jul 29 19:18:45.095119 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.095065    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l" event={"ID":"b81d897c-042e-449b-a56f-333ab4d4728e","Type":"ContainerStarted","Data":"109786d082a6604c83db80f93ff7a71d84ba0b8b21e4dc13b12d2c344fce62a7"}
Jul 29 19:18:45.114443 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.114389    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-ghm2l" podStartSLOduration=33.577755658 podStartE2EDuration="36.114371124s" totalImagesPullingTime="2.536615466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:45.112214612 +0000 UTC m=+95.032524927" watchObservedRunningTime="2026-07-29 19:18:45.114371124 +0000 UTC m=+95.034681442"
Jul 29 19:18:45.357349 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.357266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/71179293-1931-424a-9e76-08cd2c6bbb52-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-hfp9q\" (UID: \"71179293-1931-424a-9e76-08cd2c6bbb52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:45.359872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.359844    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/71179293-1931-424a-9e76-08cd2c6bbb52-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-hfp9q\" (UID: \"71179293-1931-424a-9e76-08cd2c6bbb52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:45.531887 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.531828    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:45.685693 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.685656    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"]
Jul 29 19:18:45.689789 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:45.689759    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71179293_1931_424a_9e76_08cd2c6bbb52.slice/crio-4cefc66c37ea104f3259d2397a5944ef7f44a8a91dd2cf6078ce59e0eab4980d WatchSource:0}: Error finding container 4cefc66c37ea104f3259d2397a5944ef7f44a8a91dd2cf6078ce59e0eab4980d: Status 404 returned error can't find the container with id 4cefc66c37ea104f3259d2397a5944ef7f44a8a91dd2cf6078ce59e0eab4980d
Jul 29 19:18:45.861459 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.861379    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:45.864741 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:45.864687    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrjst\" (UID: \"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7\") " pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:46.101735 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:46.101698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q" event={"ID":"71179293-1931-424a-9e76-08cd2c6bbb52","Type":"ContainerStarted","Data":"4cefc66c37ea104f3259d2397a5944ef7f44a8a91dd2cf6078ce59e0eab4980d"}
Jul 29 19:18:46.103352 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:46.103109    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mrjst"
Jul 29 19:18:46.269711 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:46.269478    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mrjst"]
Jul 29 19:18:46.273010 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:46.272982    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c478e14_80ad_47b4_8bac_5ddaf7a7b8f7.slice/crio-c716b0ce9d25809da7e9464d5310307a536fd548f3346d08079fc50ecb58fe17 WatchSource:0}: Error finding container c716b0ce9d25809da7e9464d5310307a536fd548f3346d08079fc50ecb58fe17: Status 404 returned error can't find the container with id c716b0ce9d25809da7e9464d5310307a536fd548f3346d08079fc50ecb58fe17
Jul 29 19:18:47.107646 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:47.107586    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjst" event={"ID":"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7","Type":"ContainerStarted","Data":"c716b0ce9d25809da7e9464d5310307a536fd548f3346d08079fc50ecb58fe17"}
Jul 29 19:18:48.886425 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:48.886394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:18:48.889268 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:48.889244    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/589ae4b3-0f85-479b-af86-4e5dc69766e2-metrics-tls\") pod \"dns-default-v8h5x\" (UID: \"589ae4b3-0f85-479b-af86-4e5dc69766e2\") " pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:18:48.932775 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:48.932720    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74g8d\""
Jul 29 19:18:48.939872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:48.939848    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:18:49.475189 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:49.474623    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v8h5x"]
Jul 29 19:18:49.477595 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:18:49.477564    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589ae4b3_0f85_479b_af86_4e5dc69766e2.slice/crio-77efbaf697549a66f26e76c68d7c4f591e560edc7a82c62febfc768dea77a0e0 WatchSource:0}: Error finding container 77efbaf697549a66f26e76c68d7c4f591e560edc7a82c62febfc768dea77a0e0: Status 404 returned error can't find the container with id 77efbaf697549a66f26e76c68d7c4f591e560edc7a82c62febfc768dea77a0e0
Jul 29 19:18:50.120807 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.120768    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q" event={"ID":"71179293-1931-424a-9e76-08cd2c6bbb52","Type":"ContainerStarted","Data":"68cf485f063b2aa8c3fab811a7d161ece94e5314d1da7552d87b675784857839"}
Jul 29 19:18:50.121265 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.120937    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:50.122861 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.122634    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29" event={"ID":"b9a8a698-4528-47b0-95e4-b2657993f5a7","Type":"ContainerStarted","Data":"1e941e448573fb7cf2f68967485e4ec1bdaf897ee15505ba956a46d72708510b"}
Jul 29 19:18:50.122861 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.122686    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:50.124391 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.124371    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29"
Jul 29 19:18:50.124840 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.124812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777d689db-8cq9b" event={"ID":"b69fb03d-4901-4839-822b-e5fbc0adba67","Type":"ContainerStarted","Data":"fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c"}
Jul 29 19:18:50.126061 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.126037    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v8h5x" event={"ID":"589ae4b3-0f85-479b-af86-4e5dc69766e2","Type":"ContainerStarted","Data":"77efbaf697549a66f26e76c68d7c4f591e560edc7a82c62febfc768dea77a0e0"}
Jul 29 19:18:50.126468 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.126438    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q"
Jul 29 19:18:50.137248 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.137212    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hfp9q" podStartSLOduration=2.539223889 podStartE2EDuration="6.137199935s" totalImagesPullingTime="3.597976046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:50.136767633 +0000 UTC m=+100.057077954" watchObservedRunningTime="2026-07-29 19:18:50.137199935 +0000 UTC m=+100.057510254"
Jul 29 19:18:50.171419 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.171366    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6777d689db-8cq9b" podStartSLOduration=2.040995027 podStartE2EDuration="7.171346964s" totalImagesPullingTime="5.130351937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:50.170428873 +0000 UTC m=+100.090739193" watchObservedRunningTime="2026-07-29 19:18:50.171346964 +0000 UTC m=+100.091657283"
Jul 29 19:18:50.185849 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:50.185789    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794b7db668-ksq29" podStartSLOduration=1.936403077 podStartE2EDuration="11.185769783s" totalImagesPullingTime="9.249366706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:50.184592624 +0000 UTC m=+100.104902938" watchObservedRunningTime="2026-07-29 19:18:50.185769783 +0000 UTC m=+100.106080103"
Jul 29 19:18:51.994797 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:51.994771    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g5zrq"
Jul 29 19:18:53.957206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:53.957164    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:53.958271 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:53.957352    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:18:53.958664 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:53.958593    2584 patch_prober.go:28] interesting pod/console-6777d689db-8cq9b container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
Jul 29 19:18:53.958775 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:53.958667    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6777d689db-8cq9b" podUID="b69fb03d-4901-4839-822b-e5fbc0adba67" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
Jul 29 19:18:54.144974 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:54.144945    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjst" event={"ID":"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7","Type":"ContainerStarted","Data":"19945743782c22137311cea1632674e3e2b7034a8505423b6f41965bc74de364"}
Jul 29 19:18:54.146309 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:54.146287    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v8h5x" event={"ID":"589ae4b3-0f85-479b-af86-4e5dc69766e2","Type":"ContainerStarted","Data":"4a910eacef00afffe3cc50c2f81ae2e108703ed7e1d4e4b47a968cdf7fd6a50e"}
Jul 29 19:18:55.152635 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:55.152538    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v8h5x" event={"ID":"589ae4b3-0f85-479b-af86-4e5dc69766e2","Type":"ContainerStarted","Data":"af1acceebc0c40145cea2af8a38547ccd90f081478486ae44118dd80fa95446f"}
Jul 29 19:18:55.153074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:55.152647    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:18:55.171852 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:55.171799    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v8h5x" podStartSLOduration=66.653137814 podStartE2EDuration="1m11.171781442s" totalImagesPullingTime="4.518643628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:55.170132513 +0000 UTC m=+105.090442832" watchObservedRunningTime="2026-07-29 19:18:55.171781442 +0000 UTC m=+105.092091807"
Jul 29 19:18:58.164858 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:18:58.164820    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjst" event={"ID":"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7","Type":"ContainerStarted","Data":"416d7b24e8bfd83740064b07a70935130af3cd41e9cf572894b604a97b40430d"}
Jul 29 19:19:00.044193 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:00.044154    2584 patch_prober.go:28] interesting pod/image-registry-5dc6cc454f-59dcj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 19:19:00.044571 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:00.044217    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj" podUID="b363d194-6b82-43dd-899b-8114d9b70dd7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:19:01.177100 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:01.177025    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrjst" event={"ID":"9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7","Type":"ContainerStarted","Data":"3810ba3349f086afbf25f0814bf7c180fed8985ece6d18fac16e7bf28d1b79b2"}
Jul 29 19:19:01.196512 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:01.196471    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mrjst" podStartSLOduration=33.682986722 podStartE2EDuration="48.196457607s" totalImagesPullingTime="14.513470885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:18:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:01.195172822 +0000 UTC m=+111.115483144" watchObservedRunningTime="2026-07-29 19:19:01.196457607 +0000 UTC m=+111.116767927"
Jul 29 19:19:03.078195 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:03.078166    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dc6cc454f-59dcj"
Jul 29 19:19:03.960974 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:03.960943    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:19:03.964864 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:03.964833    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:19:05.158404 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:05.158371    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v8h5x"
Jul 29 19:19:09.107417 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.107389    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"]
Jul 29 19:19:09.109744 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.109728    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.112738 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.112710    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 19:19:09.112871 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.112718    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 19:19:09.113000 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.112986    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 19:19:09.113077 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.113037    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x27fl\""
Jul 29 19:19:09.120416 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.120394    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8dkkd"]
Jul 29 19:19:09.122498 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.122476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.123053 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.123034    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"]
Jul 29 19:19:09.130097 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.130080    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 19:19:09.130332 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.130315    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 19:19:09.130518 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.130505    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2pdcd\""
Jul 29 19:19:09.130812 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.130799    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 19:19:09.245833 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-textfile\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.245925 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245836    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-sys\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.245925 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245852    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.245925 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.245925 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.245925 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245922    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-wtmp\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.246104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.246104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245959    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-tls\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.246104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-root\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.246104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.245999    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.246104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.246014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qlp\" (UniqueName: \"kubernetes.io/projected/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-kube-api-access-s6qlp\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.246104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.246037    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lx8\" (UniqueName: \"kubernetes.io/projected/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-kube-api-access-m5lx8\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.246104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.246089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-metrics-client-ca\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347046 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-metrics-client-ca\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347137 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347059    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-textfile\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347137 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-sys\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347137 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347094    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.347137 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347137    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-wtmp\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-sys\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347224    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-tls\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-root\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qlp\" (UniqueName: \"kubernetes.io/projected/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-kube-api-access-s6qlp\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-wtmp\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347773 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347432    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-textfile\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347773 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lx8\" (UniqueName: \"kubernetes.io/projected/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-kube-api-access-m5lx8\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.347882 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347839    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-root\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.347882 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.347835    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.348033 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.348004    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.348209 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.348189    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-metrics-client-ca\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.349635 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.349596    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.349724 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.349654    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.349949 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.349928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-node-exporter-tls\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.350010 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.349952    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.355017 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.354992    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qlp\" (UniqueName: \"kubernetes.io/projected/b33220c0-48e3-4cb0-8c25-1d4cf40e3d85-kube-api-access-s6qlp\") pod \"node-exporter-8dkkd\" (UID: \"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85\") " pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.355527 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.355504    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lx8\" (UniqueName: \"kubernetes.io/projected/e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d-kube-api-access-m5lx8\") pod \"openshift-state-metrics-b8f49f5c6-tm9d6\" (UID: \"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.418445 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.418383    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"
Jul 29 19:19:09.430763 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.430747    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dkkd"
Jul 29 19:19:09.439706 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:19:09.439675    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33220c0_48e3_4cb0_8c25_1d4cf40e3d85.slice/crio-1c2869db53fe90eef88b021f859bea3fbc3573af248850d17e2ad5d0b39bd522 WatchSource:0}: Error finding container 1c2869db53fe90eef88b021f859bea3fbc3573af248850d17e2ad5d0b39bd522: Status 404 returned error can't find the container with id 1c2869db53fe90eef88b021f859bea3fbc3573af248850d17e2ad5d0b39bd522
Jul 29 19:19:09.542617 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:09.542572    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6"]
Jul 29 19:19:09.545104 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:19:09.545077    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05ddb6d_5fb2_4f47_a5cd_21f41e89df6d.slice/crio-3f0fabc7c9da01526da417b47b0e890912f8e873ea6babf9e44ab0b0efce2c00 WatchSource:0}: Error finding container 3f0fabc7c9da01526da417b47b0e890912f8e873ea6babf9e44ab0b0efce2c00: Status 404 returned error can't find the container with id 3f0fabc7c9da01526da417b47b0e890912f8e873ea6babf9e44ab0b0efce2c00
Jul 29 19:19:10.123837 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.123760    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:19:10.129072 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.129039    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.132643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.132089    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 19:19:10.132643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.132290    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 19:19:10.132643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.132338    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 19:19:10.132643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.132352    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 19:19:10.133784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.132645    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 19:19:10.133784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.132850    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 19:19:10.133784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.133014    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 19:19:10.133784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.133181    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d4gzx\""
Jul 29 19:19:10.133784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.133333    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 19:19:10.133784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.133447    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 19:19:10.146664 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.146640    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:19:10.212514 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.212482    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6" event={"ID":"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d","Type":"ContainerStarted","Data":"f80ea820c748ac0ff9e1e53348a29f07d484c9246d86c186ef9d2ceb85b43376"}
Jul 29 19:19:10.212669 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.212546    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6" event={"ID":"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d","Type":"ContainerStarted","Data":"0779665af6537ecac98ae90edba5734528c8cde3265764bbfa72e55e475bb7ad"}
Jul 29 19:19:10.212669 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.212577    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6" event={"ID":"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d","Type":"ContainerStarted","Data":"3f0fabc7c9da01526da417b47b0e890912f8e873ea6babf9e44ab0b0efce2c00"}
Jul 29 19:19:10.213943 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.213913    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dkkd" event={"ID":"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85","Type":"ContainerStarted","Data":"1c2869db53fe90eef88b021f859bea3fbc3573af248850d17e2ad5d0b39bd522"}
Jul 29 19:19:10.255401 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255511 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255404    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255511 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255658 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255517    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n6k6\" (UniqueName: \"kubernetes.io/projected/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-kube-api-access-4n6k6\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255658 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255550    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255658 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255571    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255658 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255863 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255863 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255761    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255863 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-config-out\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255863 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.255863 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255839    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-web-config\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.256103 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.255885    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.356966 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.356932    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-web-config\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.356985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357104    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n6k6\" (UniqueName: \"kubernetes.io/projected/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-kube-api-access-4n6k6\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357575 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357550    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357686 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357686 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357664    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357796 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357730    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357854 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357780    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357854 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-config-out\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.357960 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.357850    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.358153 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.358124    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.358316 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:19:10.358298    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-trusted-ca-bundle podName:2b0077aa-7862-4d41-ad7e-dfe327c5da4c nodeName:}" failed. No retries permitted until 2026-07-29 19:19:10.858272986 +0000 UTC m=+120.778583290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2b0077aa-7862-4d41-ad7e-dfe327c5da4c") : configmap references non-existent config key: ca-bundle.crt
Jul 29 19:19:10.359347 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.359301    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.360402 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.360377    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.360950 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.360921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-config-out\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.361044 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.360922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.361337 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.361317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-web-config\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.361408 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.361352    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.361932 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.361903    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.362342 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.362322    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.362627 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.362592    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.363105 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.363085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.366866 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.366845    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n6k6\" (UniqueName: \"kubernetes.io/projected/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-kube-api-access-4n6k6\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.861529 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.861467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:10.862231 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:10.862212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0077aa-7862-4d41-ad7e-dfe327c5da4c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2b0077aa-7862-4d41-ad7e-dfe327c5da4c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:11.044363 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.044335    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d4gzx\""
Jul 29 19:19:11.052225 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.052211    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 19:19:11.184435 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.184387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 19:19:11.186567 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:19:11.186536    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0077aa_7862_4d41_ad7e_dfe327c5da4c.slice/crio-67c648ddb48a946868c8c9a3a2e11ca0273f9a420335582541883bf0a51b460b WatchSource:0}: Error finding container 67c648ddb48a946868c8c9a3a2e11ca0273f9a420335582541883bf0a51b460b: Status 404 returned error can't find the container with id 67c648ddb48a946868c8c9a3a2e11ca0273f9a420335582541883bf0a51b460b
Jul 29 19:19:11.219513 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.219488    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6" event={"ID":"e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d","Type":"ContainerStarted","Data":"e5ddf302e42c80ae5f79cfe7dbcd23932f1b03d7373fe9312cf8e8f853b45a5e"}
Jul 29 19:19:11.220981 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.220961    2584 generic.go:356] "Generic (PLEG): container finished" podID="b33220c0-48e3-4cb0-8c25-1d4cf40e3d85" containerID="19390c3c15239c5bb2bf5d6231ce0d04c49a8e9213d6a358a79f499fed5f34c8" exitCode=0
Jul 29 19:19:11.221067 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.221030    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dkkd" event={"ID":"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85","Type":"ContainerDied","Data":"19390c3c15239c5bb2bf5d6231ce0d04c49a8e9213d6a358a79f499fed5f34c8"}
Jul 29 19:19:11.222149 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.222126    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerStarted","Data":"67c648ddb48a946868c8c9a3a2e11ca0273f9a420335582541883bf0a51b460b"}
Jul 29 19:19:11.238509 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:11.238464    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tm9d6" podStartSLOduration=1.248966729 podStartE2EDuration="2.238447405s" totalImagesPullingTime="989.480676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:11.236186754 +0000 UTC m=+121.156497087" watchObservedRunningTime="2026-07-29 19:19:11.238447405 +0000 UTC m=+121.158757727"
Jul 29 19:19:12.029622 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.029561    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bd5649c67-db6kz"]
Jul 29 19:19:12.033150 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.033131    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.035868 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.035802    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 19:19:12.035972 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.035894    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dbki0uto4bjuo\""
Jul 29 19:19:12.036187 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.036164    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 19:19:12.036187 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.036179    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 19:19:12.036187 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.036183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 19:19:12.036382 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.036204    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vzvgg\""
Jul 29 19:19:12.036526 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.036505    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 19:19:12.049059 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.049030    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bd5649c67-db6kz"]
Jul 29 19:19:12.173387 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173357    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26178a4e-af3b-4f7b-88c5-3f002abee89a-metrics-client-ca\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.173536 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-grpc-tls\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.173536 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxft9\" (UniqueName: \"kubernetes.io/projected/26178a4e-af3b-4f7b-88c5-3f002abee89a-kube-api-access-bxft9\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.173536 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173525    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-tls\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.173705 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173558    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.173705 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173580    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.173705 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173684    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.173831 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.173719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.228360 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.228325    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dkkd" event={"ID":"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85","Type":"ContainerStarted","Data":"a273a63e1951fe35962222ef4ca59e75131fc412ec0944147257cf52255895a0"}
Jul 29 19:19:12.228761 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.228389    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dkkd" event={"ID":"b33220c0-48e3-4cb0-8c25-1d4cf40e3d85","Type":"ContainerStarted","Data":"97ba88c9698e6a1a03136738c45653ae7eebb92b554e5a0240cb815c91b52314"}
Jul 29 19:19:12.250454 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.250405    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8dkkd" podStartSLOduration=2.031432403 podStartE2EDuration="3.250388611s" totalImagesPullingTime="1.147804353s" totalInitContainerRuntime="71.151855ms" isStatefulPod=true podCreationTimestamp="2026-07-29 19:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:12.249074655 +0000 UTC m=+122.169384979" watchObservedRunningTime="2026-07-29 19:19:12.250388611 +0000 UTC m=+122.170698923"
Jul 29 19:19:12.274647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.274593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.274776 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.274664    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.274776 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.274722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.274776 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.274761    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.274948 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.274798    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26178a4e-af3b-4f7b-88c5-3f002abee89a-metrics-client-ca\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.274948 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.274826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-grpc-tls\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.274948 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.274888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxft9\" (UniqueName: \"kubernetes.io/projected/26178a4e-af3b-4f7b-88c5-3f002abee89a-kube-api-access-bxft9\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.275570 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.275192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-tls\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.275699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.275622    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26178a4e-af3b-4f7b-88c5-3f002abee89a-metrics-client-ca\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.278062 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.278037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-tls\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.278710 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.278499    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.278710 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.278572    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-grpc-tls\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.278710 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.278593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.278710 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.278668    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.279065 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.279048    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26178a4e-af3b-4f7b-88c5-3f002abee89a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.295178 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.295130    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxft9\" (UniqueName: \"kubernetes.io/projected/26178a4e-af3b-4f7b-88c5-3f002abee89a-kube-api-access-bxft9\") pod \"thanos-querier-7bd5649c67-db6kz\" (UID: \"26178a4e-af3b-4f7b-88c5-3f002abee89a\") " pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.344085 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.344065    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:12.502064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:12.502032    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bd5649c67-db6kz"]
Jul 29 19:19:12.521404 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:19:12.521371    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26178a4e_af3b_4f7b_88c5_3f002abee89a.slice/crio-e1c478cdd570cbb00184c119d81b7a75c4f1f2bb47062646e6332dce56907f3c WatchSource:0}: Error finding container e1c478cdd570cbb00184c119d81b7a75c4f1f2bb47062646e6332dce56907f3c: Status 404 returned error can't find the container with id e1c478cdd570cbb00184c119d81b7a75c4f1f2bb47062646e6332dce56907f3c
Jul 29 19:19:13.234165 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.234124    2584 generic.go:356] "Generic (PLEG): container finished" podID="2b0077aa-7862-4d41-ad7e-dfe327c5da4c" containerID="33e20f472188d0e4d4afa5208c2efacb847707d377813078eaf0f80c38885f9d" exitCode=0
Jul 29 19:19:13.234628 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.234210    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerDied","Data":"33e20f472188d0e4d4afa5208c2efacb847707d377813078eaf0f80c38885f9d"}
Jul 29 19:19:13.235554 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.235531    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" event={"ID":"26178a4e-af3b-4f7b-88c5-3f002abee89a","Type":"ContainerStarted","Data":"e1c478cdd570cbb00184c119d81b7a75c4f1f2bb47062646e6332dce56907f3c"}
Jul 29 19:19:13.361452 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.361422    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6577d77d4f-hn76d"]
Jul 29 19:19:13.364992 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.364973    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.367743 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.367662    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b2reus6ovltmj\""
Jul 29 19:19:13.367853 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.367663    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 19:19:13.367954 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.367932    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n55x9\""
Jul 29 19:19:13.367954 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.367953    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 19:19:13.368120 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.367962    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 19:19:13.368120 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.367936    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 19:19:13.374700 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.374677    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6577d77d4f-hn76d"]
Jul 29 19:19:13.485757 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.485681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-secret-metrics-server-client-certs\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.485757 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.485714    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7fe204f-2b4b-46d0-a671-899d4d3e0619-audit-log\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.485757 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.485745    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzf5q\" (UniqueName: \"kubernetes.io/projected/e7fe204f-2b4b-46d0-a671-899d4d3e0619-kube-api-access-kzf5q\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.486078 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.485820    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7fe204f-2b4b-46d0-a671-899d4d3e0619-metrics-server-audit-profiles\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.486078 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.485854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-client-ca-bundle\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.486078 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.485881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7fe204f-2b4b-46d0-a671-899d4d3e0619-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.486078 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.485993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-secret-metrics-server-tls\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.586855 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.586823    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-secret-metrics-server-tls\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.586982 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.586877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-secret-metrics-server-client-certs\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.586982 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.586930    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7fe204f-2b4b-46d0-a671-899d4d3e0619-audit-log\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.586982 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.586967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzf5q\" (UniqueName: \"kubernetes.io/projected/e7fe204f-2b4b-46d0-a671-899d4d3e0619-kube-api-access-kzf5q\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.587102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.587011    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7fe204f-2b4b-46d0-a671-899d4d3e0619-metrics-server-audit-profiles\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.587102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.587031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-client-ca-bundle\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.587102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.587050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7fe204f-2b4b-46d0-a671-899d4d3e0619-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.587438 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.587407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7fe204f-2b4b-46d0-a671-899d4d3e0619-audit-log\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.587798 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.587773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7fe204f-2b4b-46d0-a671-899d4d3e0619-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.587969 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.587950    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7fe204f-2b4b-46d0-a671-899d4d3e0619-metrics-server-audit-profiles\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.589471 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.589448    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-client-ca-bundle\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.589722 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.589705    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-secret-metrics-server-client-certs\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.589819 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.589788    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7fe204f-2b4b-46d0-a671-899d4d3e0619-secret-metrics-server-tls\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.595155 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.595131    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzf5q\" (UniqueName: \"kubernetes.io/projected/e7fe204f-2b4b-46d0-a671-899d4d3e0619-kube-api-access-kzf5q\") pod \"metrics-server-6577d77d4f-hn76d\" (UID: \"e7fe204f-2b4b-46d0-a671-899d4d3e0619\") " pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.678065 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.678038    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:13.833268 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.833240    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6577d77d4f-hn76d"]
Jul 29 19:19:13.834079 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:19:13.834056    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fe204f_2b4b_46d0_a671_899d4d3e0619.slice/crio-6aad129ef727631d0be104f42af1c9c35322aed1ba79ce69f0d7d7df08fcc0ea WatchSource:0}: Error finding container 6aad129ef727631d0be104f42af1c9c35322aed1ba79ce69f0d7d7df08fcc0ea: Status 404 returned error can't find the container with id 6aad129ef727631d0be104f42af1c9c35322aed1ba79ce69f0d7d7df08fcc0ea
Jul 29 19:19:13.893734 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.893706    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d784c858-gl7zj"]
Jul 29 19:19:13.898110 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.898071    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:13.907679 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.907653    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 19:19:13.911278 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.911252    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d784c858-gl7zj"]
Jul 29 19:19:13.991386 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.991352    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-service-ca\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:13.991386 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.991386    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-oauth-config\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:13.991586 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.991402    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8ltt\" (UniqueName: \"kubernetes.io/projected/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-kube-api-access-x8ltt\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:13.991586 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.991421    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-serving-cert\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:13.991586 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.991541    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-config\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:13.991586 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.991578    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-trusted-ca-bundle\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:13.991757 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:13.991657    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-oauth-serving-cert\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.092355 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.092325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-oauth-serving-cert\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.092496 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.092428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-service-ca\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.092496 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.092460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-oauth-config\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.092496 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.092485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8ltt\" (UniqueName: \"kubernetes.io/projected/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-kube-api-access-x8ltt\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.092644 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.092514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-serving-cert\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.092644 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.092559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-config\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.092644 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.092582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-trusted-ca-bundle\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.093206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.093178    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-service-ca\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.093326 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.093214    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-oauth-serving-cert\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.093569 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.093486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-config\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.093824 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.093798    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-trusted-ca-bundle\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.095455 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.095437    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-oauth-config\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.096090 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.096072    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-serving-cert\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.100872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.100840    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8ltt\" (UniqueName: \"kubernetes.io/projected/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-kube-api-access-x8ltt\") pod \"console-78d784c858-gl7zj\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") " pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.211179 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.211153    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:14.241370 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.241330    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d" event={"ID":"e7fe204f-2b4b-46d0-a671-899d4d3e0619","Type":"ContainerStarted","Data":"6aad129ef727631d0be104f42af1c9c35322aed1ba79ce69f0d7d7df08fcc0ea"}
Jul 29 19:19:14.498824 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:14.498798    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d784c858-gl7zj"]
Jul 29 19:19:14.501084 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:19:14.501046    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c67c9b0_ddb2_4bc5_b584_83a06a08dadb.slice/crio-8dc36c371fd02035085d652d27d58bbeb244cc5f04c0b9da1dbc5b4da836c859 WatchSource:0}: Error finding container 8dc36c371fd02035085d652d27d58bbeb244cc5f04c0b9da1dbc5b4da836c859: Status 404 returned error can't find the container with id 8dc36c371fd02035085d652d27d58bbeb244cc5f04c0b9da1dbc5b4da836c859
Jul 29 19:19:15.247184 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:15.247145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d784c858-gl7zj" event={"ID":"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb","Type":"ContainerStarted","Data":"eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29"}
Jul 29 19:19:15.247647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:15.247212    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d784c858-gl7zj" event={"ID":"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb","Type":"ContainerStarted","Data":"8dc36c371fd02035085d652d27d58bbeb244cc5f04c0b9da1dbc5b4da836c859"}
Jul 29 19:19:15.249881 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:15.249843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" event={"ID":"26178a4e-af3b-4f7b-88c5-3f002abee89a","Type":"ContainerStarted","Data":"a49fa396960f414c04aebf2f1692e4b925b21057383071eb8e041043ae75feec"}
Jul 29 19:19:15.249981 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:15.249928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" event={"ID":"26178a4e-af3b-4f7b-88c5-3f002abee89a","Type":"ContainerStarted","Data":"9fc7f6a494f67efccaa68d6d3d5645dae079ec3ff228666fd173d7f4371b599b"}
Jul 29 19:19:15.249981 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:15.249972    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" event={"ID":"26178a4e-af3b-4f7b-88c5-3f002abee89a","Type":"ContainerStarted","Data":"ae289c2b5f640239f3e386a3862ac705305eecef03f8995cf0f7f77a378db02e"}
Jul 29 19:19:15.270852 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:15.270809    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d784c858-gl7zj" podStartSLOduration=2.270791059 podStartE2EDuration="2.270791059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:15.269946999 +0000 UTC m=+125.190257318" watchObservedRunningTime="2026-07-29 19:19:15.270791059 +0000 UTC m=+125.191101384"
Jul 29 19:19:16.263588 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.263549    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerStarted","Data":"5b9e2d58d12db99ebd225880b580ab77ec5e43699420a7d51140cdff1689ab3d"}
Jul 29 19:19:16.263983 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.263702    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerStarted","Data":"007cc3bbf860f54a8e71996f555888b710c37a33ff05656c3d51df38d918dfd8"}
Jul 29 19:19:16.263983 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.263752    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerStarted","Data":"6d806437a82c1805ea57ee3450c54b2b189994b737acfba075f44205d1ac4002"}
Jul 29 19:19:16.268250 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.268148    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" event={"ID":"26178a4e-af3b-4f7b-88c5-3f002abee89a","Type":"ContainerStarted","Data":"8a4225ac246d38b78242d3a19ee3cae8f4803a7afd2a3e2413b08137f81bc418"}
Jul 29 19:19:16.268250 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.268218    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" event={"ID":"26178a4e-af3b-4f7b-88c5-3f002abee89a","Type":"ContainerStarted","Data":"1142de3ab3e4e3cdc93ec821b07db2887fff62efb8629469b3464dad97542863"}
Jul 29 19:19:16.268371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.268255    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" event={"ID":"26178a4e-af3b-4f7b-88c5-3f002abee89a","Type":"ContainerStarted","Data":"77fc6d1b37fe327bdf27e8f7219a54bd3b19798c25a3c461535d6757ea4f1108"}
Jul 29 19:19:16.268579 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.268528    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:16.270365 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.270341    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d" event={"ID":"e7fe204f-2b4b-46d0-a671-899d4d3e0619","Type":"ContainerStarted","Data":"46f965321f9eea89c739b042c8d72e2bee8d53e361c2d63314f424833d778479"}
Jul 29 19:19:16.323224 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:16.323180    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz" podStartSLOduration=1.06807183 podStartE2EDuration="4.323165403s" totalImagesPullingTime="3.255093573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:16.322763999 +0000 UTC m=+126.243074319" watchObservedRunningTime="2026-07-29 19:19:16.323165403 +0000 UTC m=+126.243475722"
Jul 29 19:19:17.277646 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:17.277595    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerStarted","Data":"f75310f03874f2c5b1e0d46b231a00d98311ae736bfe4c343c068ef5127850b4"}
Jul 29 19:19:17.278013 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:17.277678    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerStarted","Data":"9baff915467f6e6dc81804bfc0bc71b690d3d34f1809ce0a5a9fbbe9df7f5b69"}
Jul 29 19:19:17.278013 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:17.277706    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2b0077aa-7862-4d41-ad7e-dfe327c5da4c","Type":"ContainerStarted","Data":"93bd82c183c9ed1bdfb80886e547adf859ce0343e19f29608e15b69f4bc8c7cc"}
Jul 29 19:19:17.310157 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:17.310109    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d" podStartSLOduration=2.134292955 podStartE2EDuration="4.310093549s" totalImagesPullingTime="2.175800594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:16.359854796 +0000 UTC m=+126.280165117" watchObservedRunningTime="2026-07-29 19:19:17.310093549 +0000 UTC m=+127.230403929"
Jul 29 19:19:17.310433 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:17.310413    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.328637307 podStartE2EDuration="7.310405925s" totalImagesPullingTime="3.961231241s" totalInitContainerRuntime="20.537377ms" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:17.307779976 +0000 UTC m=+127.228090296" watchObservedRunningTime="2026-07-29 19:19:17.310405925 +0000 UTC m=+127.230716245"
Jul 29 19:19:19.236347 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:19.236301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:19:19.238822 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:19.238792    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/005fe08a-66f3-4973-884c-26ed86e6fa5f-metrics-certs\") pod \"network-metrics-daemon-mtcn6\" (UID: \"005fe08a-66f3-4973-884c-26ed86e6fa5f\") " pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:19:19.499941 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:19.499875    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgbwc\""
Jul 29 19:19:19.508136 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:19.508118    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mtcn6"
Jul 29 19:19:19.636198 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:19.636158    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mtcn6"]
Jul 29 19:19:19.641176 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:19:19.641149    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005fe08a_66f3_4973_884c_26ed86e6fa5f.slice/crio-6a68e56346b9f5b6eaf1efd35f635f8740a5170d2addecdd4f96c1640fc5e43d WatchSource:0}: Error finding container 6a68e56346b9f5b6eaf1efd35f635f8740a5170d2addecdd4f96c1640fc5e43d: Status 404 returned error can't find the container with id 6a68e56346b9f5b6eaf1efd35f635f8740a5170d2addecdd4f96c1640fc5e43d
Jul 29 19:19:20.291529 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:20.291494    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mtcn6" event={"ID":"005fe08a-66f3-4973-884c-26ed86e6fa5f","Type":"ContainerStarted","Data":"6a68e56346b9f5b6eaf1efd35f635f8740a5170d2addecdd4f96c1640fc5e43d"}
Jul 29 19:19:21.296955 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:21.296886    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mtcn6" event={"ID":"005fe08a-66f3-4973-884c-26ed86e6fa5f","Type":"ContainerStarted","Data":"90eed0af2049b947a5590151ecd29a034242f9fc006f81f6fbed12adf409788f"}
Jul 29 19:19:21.296955 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:21.296938    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mtcn6" event={"ID":"005fe08a-66f3-4973-884c-26ed86e6fa5f","Type":"ContainerStarted","Data":"ba4089379f627f9d6d7f0165149f4376c823dbd057a69c2d131fbc9d02b86e84"}
Jul 29 19:19:21.315508 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:21.315461    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mtcn6" podStartSLOduration=130.190376322 podStartE2EDuration="2m11.315448181s" totalImagesPullingTime="1.125071859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:21.314138936 +0000 UTC m=+131.234449258" watchObservedRunningTime="2026-07-29 19:19:21.315448181 +0000 UTC m=+131.235758501"
Jul 29 19:19:22.283546 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:22.283518    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bd5649c67-db6kz"
Jul 29 19:19:24.211983 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:24.211946    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:24.212363 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:24.212004    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:24.216555 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:24.216534    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:24.313125 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:24.313105    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:19:24.360335 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:24.360313    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6777d689db-8cq9b"]
Jul 29 19:19:33.678363 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:33.678319    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:33.678926 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:33.678382    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:34.351913 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:34.351886    2584 generic.go:356] "Generic (PLEG): container finished" podID="f22d7a19-633e-42ad-b50a-e36e5036da59" containerID="37dd8255e0810e935c16231d3be5bd0aa00b406aa58459052398547a795f5b1c" exitCode=0
Jul 29 19:19:34.352061 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:34.351963    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg" event={"ID":"f22d7a19-633e-42ad-b50a-e36e5036da59","Type":"ContainerDied","Data":"37dd8255e0810e935c16231d3be5bd0aa00b406aa58459052398547a795f5b1c"}
Jul 29 19:19:34.352314 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:34.352296    2584 scope.go:117] "RemoveContainer" containerID="37dd8255e0810e935c16231d3be5bd0aa00b406aa58459052398547a795f5b1c"
Jul 29 19:19:35.357700 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:35.357664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-vhccg" event={"ID":"f22d7a19-633e-42ad-b50a-e36e5036da59","Type":"ContainerStarted","Data":"4f95349199a969007c890110ddbe03e8f94156d8bae5a0c1c0372ac1e2cbc25c"}
Jul 29 19:19:44.399753 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:44.399716    2584 generic.go:356] "Generic (PLEG): container finished" podID="32a75a3f-4a90-42e5-b202-d487db4bfc3f" containerID="2fc2ed4f091472a65e8fce6de7660cbb2e7211bc01d4d5b33c8ab6e33ce38488" exitCode=0
Jul 29 19:19:44.400246 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:44.399808    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98" event={"ID":"32a75a3f-4a90-42e5-b202-d487db4bfc3f","Type":"ContainerDied","Data":"2fc2ed4f091472a65e8fce6de7660cbb2e7211bc01d4d5b33c8ab6e33ce38488"}
Jul 29 19:19:44.400246 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:44.400197    2584 scope.go:117] "RemoveContainer" containerID="2fc2ed4f091472a65e8fce6de7660cbb2e7211bc01d4d5b33c8ab6e33ce38488"
Jul 29 19:19:45.405660 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:45.405598    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98" event={"ID":"32a75a3f-4a90-42e5-b202-d487db4bfc3f","Type":"ContainerStarted","Data":"0f369576ac6d4c496cde67316878306d608eac96331fdf3fa9561cbd6a815887"}
Jul 29 19:19:49.380201 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.380154    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6777d689db-8cq9b" podUID="b69fb03d-4901-4839-822b-e5fbc0adba67" containerName="console" containerID="cri-o://fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c" gracePeriod=15
Jul 29 19:19:49.658965 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.658905    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:19:49.764281 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764263    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-oauth-config\") pod \"b69fb03d-4901-4839-822b-e5fbc0adba67\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") "
Jul 29 19:19:49.764365 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764348    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqcs7\" (UniqueName: \"kubernetes.io/projected/b69fb03d-4901-4839-822b-e5fbc0adba67-kube-api-access-rqcs7\") pod \"b69fb03d-4901-4839-822b-e5fbc0adba67\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") "
Jul 29 19:19:49.764402 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764367    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-oauth-serving-cert\") pod \"b69fb03d-4901-4839-822b-e5fbc0adba67\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") "
Jul 29 19:19:49.764402 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764386    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-serving-cert\") pod \"b69fb03d-4901-4839-822b-e5fbc0adba67\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") "
Jul 29 19:19:49.764477 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764402    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-service-ca\") pod \"b69fb03d-4901-4839-822b-e5fbc0adba67\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") "
Jul 29 19:19:49.764477 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764436    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-console-config\") pod \"b69fb03d-4901-4839-822b-e5fbc0adba67\" (UID: \"b69fb03d-4901-4839-822b-e5fbc0adba67\") "
Jul 29 19:19:49.764861 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764829    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b69fb03d-4901-4839-822b-e5fbc0adba67" (UID: "b69fb03d-4901-4839-822b-e5fbc0adba67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:19:49.764861 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764846    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-service-ca" (OuterVolumeSpecName: "service-ca") pod "b69fb03d-4901-4839-822b-e5fbc0adba67" (UID: "b69fb03d-4901-4839-822b-e5fbc0adba67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:19:49.765040 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.764965    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-console-config" (OuterVolumeSpecName: "console-config") pod "b69fb03d-4901-4839-822b-e5fbc0adba67" (UID: "b69fb03d-4901-4839-822b-e5fbc0adba67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:19:49.766507 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.766485    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69fb03d-4901-4839-822b-e5fbc0adba67-kube-api-access-rqcs7" (OuterVolumeSpecName: "kube-api-access-rqcs7") pod "b69fb03d-4901-4839-822b-e5fbc0adba67" (UID: "b69fb03d-4901-4839-822b-e5fbc0adba67"). InnerVolumeSpecName "kube-api-access-rqcs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:19:49.766623 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.766513    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b69fb03d-4901-4839-822b-e5fbc0adba67" (UID: "b69fb03d-4901-4839-822b-e5fbc0adba67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:19:49.766623 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.766562    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b69fb03d-4901-4839-822b-e5fbc0adba67" (UID: "b69fb03d-4901-4839-822b-e5fbc0adba67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:19:49.865132 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.865111    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqcs7\" (UniqueName: \"kubernetes.io/projected/b69fb03d-4901-4839-822b-e5fbc0adba67-kube-api-access-rqcs7\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:19:49.865132 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.865132    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-oauth-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:19:49.865251 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.865141    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:19:49.865251 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.865151    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:19:49.865251 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.865161    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69fb03d-4901-4839-822b-e5fbc0adba67-console-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:19:49.865251 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:49.865168    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69fb03d-4901-4839-822b-e5fbc0adba67-console-oauth-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:19:50.428277 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.428241    2584 generic.go:356] "Generic (PLEG): container finished" podID="b69fb03d-4901-4839-822b-e5fbc0adba67" containerID="fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c" exitCode=0
Jul 29 19:19:50.428694 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.428287    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6777d689db-8cq9b"
Jul 29 19:19:50.428694 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.428322    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777d689db-8cq9b" event={"ID":"b69fb03d-4901-4839-822b-e5fbc0adba67","Type":"ContainerDied","Data":"fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c"}
Jul 29 19:19:50.428694 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.428371    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6777d689db-8cq9b" event={"ID":"b69fb03d-4901-4839-822b-e5fbc0adba67","Type":"ContainerDied","Data":"1742da6098a8edb6f733c173d5ee9998ca882a2c7a5895fa4073ca5cb891a792"}
Jul 29 19:19:50.428694 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.428391    2584 scope.go:117] "RemoveContainer" containerID="fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c"
Jul 29 19:19:50.437312 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.437296    2584 scope.go:117] "RemoveContainer" containerID="fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c"
Jul 29 19:19:50.437534 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:19:50.437514    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c\": container with ID starting with fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c not found: ID does not exist" containerID="fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c"
Jul 29 19:19:50.437618 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.437545    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c"} err="failed to get container status \"fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c\": rpc error: code = NotFound desc = could not find container \"fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c\": container with ID starting with fc2613ceb51808f1453926c367f3edbe101a0334b4914719c302c9ee925a204c not found: ID does not exist"
Jul 29 19:19:50.449152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.449128    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6777d689db-8cq9b"]
Jul 29 19:19:50.452999 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.452977    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6777d689db-8cq9b"]
Jul 29 19:19:50.591279 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:50.591251    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69fb03d-4901-4839-822b-e5fbc0adba67" path="/var/lib/kubelet/pods/b69fb03d-4901-4839-822b-e5fbc0adba67/volumes"
Jul 29 19:19:53.683958 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:53.683923    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:19:53.687947 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:19:53.687919    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6577d77d4f-hn76d"
Jul 29 19:20:33.363410 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.363373    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c97565c75-jpntk"]
Jul 29 19:20:33.363904 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.363840    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69fb03d-4901-4839-822b-e5fbc0adba67" containerName="console"
Jul 29 19:20:33.363904 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.363855    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69fb03d-4901-4839-822b-e5fbc0adba67" containerName="console"
Jul 29 19:20:33.363990 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.363908    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69fb03d-4901-4839-822b-e5fbc0adba67" containerName="console"
Jul 29 19:20:33.366841 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.366824    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.369483 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.369460    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 19:20:33.369645 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.369553    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 19:20:33.369726 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.369640    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 19:20:33.369726 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.369710    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 19:20:33.369872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.369855    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7v88g\""
Jul 29 19:20:33.369937 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.369923    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 19:20:33.375374 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.375352    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 19:20:33.382040 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.382017    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c97565c75-jpntk"]
Jul 29 19:20:33.489188 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489166    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-secret-telemeter-client\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.489291 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489201    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-telemeter-client-tls\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.489291 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489222    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9plq\" (UniqueName: \"kubernetes.io/projected/77ba0ef7-ba88-437c-8f50-dbb8090b849f-kube-api-access-x9plq\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.489371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489306    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-serving-certs-ca-bundle\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.489371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-metrics-client-ca\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.489371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.489459 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-federate-client-tls\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.489459 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.489418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590592 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590566    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-federate-client-tls\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590720 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590720 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-secret-telemeter-client\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590720 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-telemeter-client-tls\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590720 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590702    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9plq\" (UniqueName: \"kubernetes.io/projected/77ba0ef7-ba88-437c-8f50-dbb8090b849f-kube-api-access-x9plq\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590931 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-serving-certs-ca-bundle\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590931 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590786    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-metrics-client-ca\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.590931 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.590805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.591555 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.591509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-serving-certs-ca-bundle\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.591674 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.591653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-metrics-client-ca\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.591845 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.591823    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77ba0ef7-ba88-437c-8f50-dbb8090b849f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.593278 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.593253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-secret-telemeter-client\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.593461 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.593440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-telemeter-client-tls\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.593543 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.593521    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.593583 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.593574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/77ba0ef7-ba88-437c-8f50-dbb8090b849f-federate-client-tls\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.599789 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.599772    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9plq\" (UniqueName: \"kubernetes.io/projected/77ba0ef7-ba88-437c-8f50-dbb8090b849f-kube-api-access-x9plq\") pod \"telemeter-client-7c97565c75-jpntk\" (UID: \"77ba0ef7-ba88-437c-8f50-dbb8090b849f\") " pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.677340 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.677287    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk"
Jul 29 19:20:33.810696 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:33.810664    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c97565c75-jpntk"]
Jul 29 19:20:33.814255 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:20:33.814228    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ba0ef7_ba88_437c_8f50_dbb8090b849f.slice/crio-f2a2cc9d8d5229cd3c98815d59428aa781d74347fcb2b29ea49da31c1a8cb8f6 WatchSource:0}: Error finding container f2a2cc9d8d5229cd3c98815d59428aa781d74347fcb2b29ea49da31c1a8cb8f6: Status 404 returned error can't find the container with id f2a2cc9d8d5229cd3c98815d59428aa781d74347fcb2b29ea49da31c1a8cb8f6
Jul 29 19:20:34.615670 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:34.615630    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk" event={"ID":"77ba0ef7-ba88-437c-8f50-dbb8090b849f","Type":"ContainerStarted","Data":"f2a2cc9d8d5229cd3c98815d59428aa781d74347fcb2b29ea49da31c1a8cb8f6"}
Jul 29 19:20:35.622585 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:35.622561    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk" event={"ID":"77ba0ef7-ba88-437c-8f50-dbb8090b849f","Type":"ContainerStarted","Data":"43d2a9bd15e5c421116b27c47a4f3c70d5d8795eccd15da851071d83657df6a2"}
Jul 29 19:20:35.622871 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:35.622629    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk" event={"ID":"77ba0ef7-ba88-437c-8f50-dbb8090b849f","Type":"ContainerStarted","Data":"1635737d98e564a7cbb9f17356da032fdf7a28d255831bab1c4218584858f211"}
Jul 29 19:20:36.628784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:36.628744    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk" event={"ID":"77ba0ef7-ba88-437c-8f50-dbb8090b849f","Type":"ContainerStarted","Data":"ea6c13c0d2e5c5be1eb81255aaa957be6d6bfd6c3f6f72fff995aa0361a41f94"}
Jul 29 19:20:36.652579 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:36.652526    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c97565c75-jpntk" podStartSLOduration=1.976225444 podStartE2EDuration="3.652511123s" totalImagesPullingTime="1.676285679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:36.651786719 +0000 UTC m=+206.572097050" watchObservedRunningTime="2026-07-29 19:20:36.652511123 +0000 UTC m=+206.572821442"
Jul 29 19:20:38.071629 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.071583    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb7bdf97c-nmhkp"]
Jul 29 19:20:38.075228 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.075203    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.085887 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.085861    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb7bdf97c-nmhkp"]
Jul 29 19:20:38.126291 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.126262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-console-config\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.126428 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.126296    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shtnt\" (UniqueName: \"kubernetes.io/projected/42b9c169-2d73-42ab-937d-b2c6790343b8-kube-api-access-shtnt\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.126428 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.126316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-oauth-config\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.126428 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.126344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-serving-cert\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.126587 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.126424    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-service-ca\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.126587 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.126449    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-oauth-serving-cert\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.126587 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.126483    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-trusted-ca-bundle\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.227283 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.227245    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-console-config\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.227283 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.227287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shtnt\" (UniqueName: \"kubernetes.io/projected/42b9c169-2d73-42ab-937d-b2c6790343b8-kube-api-access-shtnt\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.227474 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.227314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-oauth-config\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.227474 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.227343    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-serving-cert\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.227474 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.227390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-service-ca\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.227474 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.227413    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-oauth-serving-cert\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.227474 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.227455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-trusted-ca-bundle\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.228077 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.228054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-service-ca\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.228189 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.228147    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-console-config\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.228189 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.228167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-oauth-serving-cert\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.228299 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.228260    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-trusted-ca-bundle\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.229861 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.229831    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-oauth-config\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.229957 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.229915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-serving-cert\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.235106 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.235085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shtnt\" (UniqueName: \"kubernetes.io/projected/42b9c169-2d73-42ab-937d-b2c6790343b8-kube-api-access-shtnt\") pod \"console-fb7bdf97c-nmhkp\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") " pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.386161 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.386136    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:38.515267 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.515231    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb7bdf97c-nmhkp"]
Jul 29 19:20:38.517429 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:20:38.517403    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b9c169_2d73_42ab_937d_b2c6790343b8.slice/crio-7ef183e950c131f6a866254869b48c8952b34a8eb06ee312065362292dbdad09 WatchSource:0}: Error finding container 7ef183e950c131f6a866254869b48c8952b34a8eb06ee312065362292dbdad09: Status 404 returned error can't find the container with id 7ef183e950c131f6a866254869b48c8952b34a8eb06ee312065362292dbdad09
Jul 29 19:20:38.640127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.640039    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb7bdf97c-nmhkp" event={"ID":"42b9c169-2d73-42ab-937d-b2c6790343b8","Type":"ContainerStarted","Data":"42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171"}
Jul 29 19:20:38.640127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.640092    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb7bdf97c-nmhkp" event={"ID":"42b9c169-2d73-42ab-937d-b2c6790343b8","Type":"ContainerStarted","Data":"7ef183e950c131f6a866254869b48c8952b34a8eb06ee312065362292dbdad09"}
Jul 29 19:20:38.661681 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:38.661634    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb7bdf97c-nmhkp" podStartSLOduration=0.661620341 podStartE2EDuration="661.620341ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:38.659854315 +0000 UTC m=+208.580164660" watchObservedRunningTime="2026-07-29 19:20:38.661620341 +0000 UTC m=+208.581930660"
Jul 29 19:20:45.127222 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.127188    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb7bdf97c-nmhkp"]
Jul 29 19:20:45.163439 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.163408    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f95db7766-v29kr"]
Jul 29 19:20:45.167638 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.167617    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.180064 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.180040    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-oauth-config\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.180186 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.180089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-console-config\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.180186 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.180131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-service-ca\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.180186 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.180175    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-oauth-serving-cert\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.180326 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.180253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-serving-cert\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.180326 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.180292    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwk8d\" (UniqueName: \"kubernetes.io/projected/3299ddde-d332-498d-b72b-bda67835772c-kube-api-access-qwk8d\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.180402 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.180324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-trusted-ca-bundle\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.181102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.181073    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f95db7766-v29kr"]
Jul 29 19:20:45.281017 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.280988    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-serving-cert\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.281017 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.281019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwk8d\" (UniqueName: \"kubernetes.io/projected/3299ddde-d332-498d-b72b-bda67835772c-kube-api-access-qwk8d\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.281171 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.281039    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-trusted-ca-bundle\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.281171 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.281098    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-oauth-config\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.281171 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.281134    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-console-config\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.281353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.281334    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-service-ca\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.281426 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.281386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-oauth-serving-cert\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.281961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.281933    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-console-config\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.282087 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.282048    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-trusted-ca-bundle\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.282154 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.282080    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-service-ca\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.282154 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.282085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-oauth-serving-cert\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.283362 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.283342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-serving-cert\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.283717 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.283701    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-oauth-config\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.289020 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.289001    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwk8d\" (UniqueName: \"kubernetes.io/projected/3299ddde-d332-498d-b72b-bda67835772c-kube-api-access-qwk8d\") pod \"console-f95db7766-v29kr\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") " pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.478216 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.478140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:45.606484 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.606463    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f95db7766-v29kr"]
Jul 29 19:20:45.608558 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:20:45.608532    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3299ddde_d332_498d_b72b_bda67835772c.slice/crio-407b5a77d7db4dc62a4179d6199f9d6426bcd2f3335ee085fa17f2fc4cbb8c73 WatchSource:0}: Error finding container 407b5a77d7db4dc62a4179d6199f9d6426bcd2f3335ee085fa17f2fc4cbb8c73: Status 404 returned error can't find the container with id 407b5a77d7db4dc62a4179d6199f9d6426bcd2f3335ee085fa17f2fc4cbb8c73
Jul 29 19:20:45.673571 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.673542    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95db7766-v29kr" event={"ID":"3299ddde-d332-498d-b72b-bda67835772c","Type":"ContainerStarted","Data":"b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5"}
Jul 29 19:20:45.673712 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.673590    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95db7766-v29kr" event={"ID":"3299ddde-d332-498d-b72b-bda67835772c","Type":"ContainerStarted","Data":"407b5a77d7db4dc62a4179d6199f9d6426bcd2f3335ee085fa17f2fc4cbb8c73"}
Jul 29 19:20:45.693580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:45.693539    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f95db7766-v29kr" podStartSLOduration=0.693524063 podStartE2EDuration="693.524063ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:20:45.692255416 +0000 UTC m=+215.612565737" watchObservedRunningTime="2026-07-29 19:20:45.693524063 +0000 UTC m=+215.613834382"
Jul 29 19:20:48.386754 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:48.386708    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:20:55.479284 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:55.479250    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:55.479721 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:55.479299    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:55.483971 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:55.483947    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:55.721450 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:55.721425    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:20:55.770770 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:20:55.770694    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d784c858-gl7zj"]
Jul 29 19:21:10.147015 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.146966    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fb7bdf97c-nmhkp" podUID="42b9c169-2d73-42ab-937d-b2c6790343b8" containerName="console" containerID="cri-o://42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171" gracePeriod=15
Jul 29 19:21:10.388156 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.388132    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:21:10.474395 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474326    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-trusted-ca-bundle\") pod \"42b9c169-2d73-42ab-937d-b2c6790343b8\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") "
Jul 29 19:21:10.474395 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474361    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-oauth-config\") pod \"42b9c169-2d73-42ab-937d-b2c6790343b8\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") "
Jul 29 19:21:10.474395 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474384    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-oauth-serving-cert\") pod \"42b9c169-2d73-42ab-937d-b2c6790343b8\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") "
Jul 29 19:21:10.474671 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474437    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-console-config\") pod \"42b9c169-2d73-42ab-937d-b2c6790343b8\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") "
Jul 29 19:21:10.474671 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474463    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shtnt\" (UniqueName: \"kubernetes.io/projected/42b9c169-2d73-42ab-937d-b2c6790343b8-kube-api-access-shtnt\") pod \"42b9c169-2d73-42ab-937d-b2c6790343b8\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") "
Jul 29 19:21:10.474671 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474489    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-serving-cert\") pod \"42b9c169-2d73-42ab-937d-b2c6790343b8\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") "
Jul 29 19:21:10.474671 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474589    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-service-ca\") pod \"42b9c169-2d73-42ab-937d-b2c6790343b8\" (UID: \"42b9c169-2d73-42ab-937d-b2c6790343b8\") "
Jul 29 19:21:10.474876 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474842    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42b9c169-2d73-42ab-937d-b2c6790343b8" (UID: "42b9c169-2d73-42ab-937d-b2c6790343b8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:10.474929 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474858    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-console-config" (OuterVolumeSpecName: "console-config") pod "42b9c169-2d73-42ab-937d-b2c6790343b8" (UID: "42b9c169-2d73-42ab-937d-b2c6790343b8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:10.474984 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.474933    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42b9c169-2d73-42ab-937d-b2c6790343b8" (UID: "42b9c169-2d73-42ab-937d-b2c6790343b8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:10.475136 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.475110    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "42b9c169-2d73-42ab-937d-b2c6790343b8" (UID: "42b9c169-2d73-42ab-937d-b2c6790343b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:10.476477 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.476447    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42b9c169-2d73-42ab-937d-b2c6790343b8" (UID: "42b9c169-2d73-42ab-937d-b2c6790343b8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:21:10.476561 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.476507    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b9c169-2d73-42ab-937d-b2c6790343b8-kube-api-access-shtnt" (OuterVolumeSpecName: "kube-api-access-shtnt") pod "42b9c169-2d73-42ab-937d-b2c6790343b8" (UID: "42b9c169-2d73-42ab-937d-b2c6790343b8"). InnerVolumeSpecName "kube-api-access-shtnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:21:10.476561 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.476508    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42b9c169-2d73-42ab-937d-b2c6790343b8" (UID: "42b9c169-2d73-42ab-937d-b2c6790343b8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:21:10.576186 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.576154    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:10.576186 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.576186    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-trusted-ca-bundle\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:10.576316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.576196    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-oauth-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:10.576316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.576205    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-oauth-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:10.576316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.576214    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42b9c169-2d73-42ab-937d-b2c6790343b8-console-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:10.576316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.576222    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shtnt\" (UniqueName: \"kubernetes.io/projected/42b9c169-2d73-42ab-937d-b2c6790343b8-kube-api-access-shtnt\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:10.576316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.576230    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42b9c169-2d73-42ab-937d-b2c6790343b8-console-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:10.778936 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.778872    2584 generic.go:356] "Generic (PLEG): container finished" podID="42b9c169-2d73-42ab-937d-b2c6790343b8" containerID="42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171" exitCode=0
Jul 29 19:21:10.778936 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.778923    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb7bdf97c-nmhkp"
Jul 29 19:21:10.779069 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.778960    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb7bdf97c-nmhkp" event={"ID":"42b9c169-2d73-42ab-937d-b2c6790343b8","Type":"ContainerDied","Data":"42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171"}
Jul 29 19:21:10.779069 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.779048    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb7bdf97c-nmhkp" event={"ID":"42b9c169-2d73-42ab-937d-b2c6790343b8","Type":"ContainerDied","Data":"7ef183e950c131f6a866254869b48c8952b34a8eb06ee312065362292dbdad09"}
Jul 29 19:21:10.779131 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.779076    2584 scope.go:117] "RemoveContainer" containerID="42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171"
Jul 29 19:21:10.787634 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.787598    2584 scope.go:117] "RemoveContainer" containerID="42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171"
Jul 29 19:21:10.787891 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:21:10.787874    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171\": container with ID starting with 42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171 not found: ID does not exist" containerID="42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171"
Jul 29 19:21:10.787948 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.787898    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171"} err="failed to get container status \"42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171\": rpc error: code = NotFound desc = could not find container \"42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171\": container with ID starting with 42444ea50563197e55125cc4475948d88cef53259b92b68ee551171e6dfe9171 not found: ID does not exist"
Jul 29 19:21:10.796493 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.796468    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb7bdf97c-nmhkp"]
Jul 29 19:21:10.800092 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:10.800070    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb7bdf97c-nmhkp"]
Jul 29 19:21:12.592872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:12.592832    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b9c169-2d73-42ab-937d-b2c6790343b8" path="/var/lib/kubelet/pods/42b9c169-2d73-42ab-937d-b2c6790343b8/volumes"
Jul 29 19:21:20.796712 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:20.796642    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78d784c858-gl7zj" podUID="0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" containerName="console" containerID="cri-o://eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29" gracePeriod=15
Jul 29 19:21:21.034219 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.034194    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:21:21.152842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.152813    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-oauth-serving-cert\") pod \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") "
Jul 29 19:21:21.152987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.152853    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-config\") pod \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") "
Jul 29 19:21:21.152987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.152910    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-service-ca\") pod \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") "
Jul 29 19:21:21.152987 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.152952    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-serving-cert\") pod \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") "
Jul 29 19:21:21.153151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153032    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-trusted-ca-bundle\") pod \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") "
Jul 29 19:21:21.153151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153062    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-oauth-config\") pod \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") "
Jul 29 19:21:21.153151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153096    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8ltt\" (UniqueName: \"kubernetes.io/projected/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-kube-api-access-x8ltt\") pod \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\" (UID: \"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb\") "
Jul 29 19:21:21.153295 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153255    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" (UID: "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:21.153378 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153360    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-oauth-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:21.153437 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153367    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" (UID: "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:21.153437 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153413    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-config" (OuterVolumeSpecName: "console-config") pod "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" (UID: "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:21.153546 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.153523    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" (UID: "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:21:21.155194 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.155162    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" (UID: "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:21:21.155308 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.155209    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-kube-api-access-x8ltt" (OuterVolumeSpecName: "kube-api-access-x8ltt") pod "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" (UID: "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb"). InnerVolumeSpecName "kube-api-access-x8ltt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:21:21.155308 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.155243    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" (UID: "0c67c9b0-ddb2-4bc5-b584-83a06a08dadb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:21:21.254536 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.254508    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-trusted-ca-bundle\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:21.254536 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.254531    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-oauth-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:21.254719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.254545    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8ltt\" (UniqueName: \"kubernetes.io/projected/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-kube-api-access-x8ltt\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:21.254719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.254557    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:21.254719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.254568    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:21.254719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.254579    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb-console-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:21:21.830508 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.830465    2584 generic.go:356] "Generic (PLEG): container finished" podID="0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" containerID="eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29" exitCode=0
Jul 29 19:21:21.830952 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.830524    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d784c858-gl7zj"
Jul 29 19:21:21.830952 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.830553    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d784c858-gl7zj" event={"ID":"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb","Type":"ContainerDied","Data":"eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29"}
Jul 29 19:21:21.830952 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.830635    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d784c858-gl7zj" event={"ID":"0c67c9b0-ddb2-4bc5-b584-83a06a08dadb","Type":"ContainerDied","Data":"8dc36c371fd02035085d652d27d58bbeb244cc5f04c0b9da1dbc5b4da836c859"}
Jul 29 19:21:21.830952 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.830664    2584 scope.go:117] "RemoveContainer" containerID="eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29"
Jul 29 19:21:21.841232 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.841212    2584 scope.go:117] "RemoveContainer" containerID="eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29"
Jul 29 19:21:21.841552 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:21:21.841533    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29\": container with ID starting with eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29 not found: ID does not exist" containerID="eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29"
Jul 29 19:21:21.841637 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.841564    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29"} err="failed to get container status \"eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29\": rpc error: code = NotFound desc = could not find container \"eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29\": container with ID starting with eb65a5b1443bab367f1c86a49bc73365541c06f59438bbe6542dfc0a0b608e29 not found: ID does not exist"
Jul 29 19:21:21.853355 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.853324    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d784c858-gl7zj"]
Jul 29 19:21:21.857587 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:21.857522    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d784c858-gl7zj"]
Jul 29 19:21:22.593061 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:21:22.593023    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" path="/var/lib/kubelet/pods/0c67c9b0-ddb2-4bc5-b584-83a06a08dadb/volumes"
Jul 29 19:22:10.437854 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:10.437828    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:22:10.452861 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:10.452826    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:22:10.455653 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:10.455631    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 19:22:19.987119 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.987082    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mt725"]
Jul 29 19:22:19.988619 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.987401    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" containerName="console"
Jul 29 19:22:19.988619 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.987416    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" containerName="console"
Jul 29 19:22:19.988619 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.987429    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b9c169-2d73-42ab-937d-b2c6790343b8" containerName="console"
Jul 29 19:22:19.988619 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.987434    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b9c169-2d73-42ab-937d-b2c6790343b8" containerName="console"
Jul 29 19:22:19.988619 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.987497    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b9c169-2d73-42ab-937d-b2c6790343b8" containerName="console"
Jul 29 19:22:19.988619 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.987508    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c67c9b0-ddb2-4bc5-b584-83a06a08dadb" containerName="console"
Jul 29 19:22:19.989270 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.989253    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:19.995769 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.995747    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qzkc4\""
Jul 29 19:22:19.995895 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:19.995773    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 19:22:20.000245 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.000230    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 19:22:20.012278 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.012257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mt725"]
Jul 29 19:22:20.092893 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.092869    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlpvs\" (UniqueName: \"kubernetes.io/projected/9f423ca6-bc40-478a-89cf-89fd98314c15-kube-api-access-qlpvs\") pod \"cert-manager-cainjector-559cdd8c87-mt725\" (UID: \"9f423ca6-bc40-478a-89cf-89fd98314c15\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:20.093016 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.092914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f423ca6-bc40-478a-89cf-89fd98314c15-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mt725\" (UID: \"9f423ca6-bc40-478a-89cf-89fd98314c15\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:20.193859 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.193833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlpvs\" (UniqueName: \"kubernetes.io/projected/9f423ca6-bc40-478a-89cf-89fd98314c15-kube-api-access-qlpvs\") pod \"cert-manager-cainjector-559cdd8c87-mt725\" (UID: \"9f423ca6-bc40-478a-89cf-89fd98314c15\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:20.193974 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.193877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f423ca6-bc40-478a-89cf-89fd98314c15-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mt725\" (UID: \"9f423ca6-bc40-478a-89cf-89fd98314c15\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:20.204762 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.204735    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f423ca6-bc40-478a-89cf-89fd98314c15-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mt725\" (UID: \"9f423ca6-bc40-478a-89cf-89fd98314c15\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:20.204880 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.204863    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlpvs\" (UniqueName: \"kubernetes.io/projected/9f423ca6-bc40-478a-89cf-89fd98314c15-kube-api-access-qlpvs\") pod \"cert-manager-cainjector-559cdd8c87-mt725\" (UID: \"9f423ca6-bc40-478a-89cf-89fd98314c15\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:20.308742 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.308679    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725"
Jul 29 19:22:20.459699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.459598    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mt725"]
Jul 29 19:22:20.462452 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:22:20.462426    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f423ca6_bc40_478a_89cf_89fd98314c15.slice/crio-e6f6f2be9f9b0a5e0388152376dc85542dc1343451740be9796aea39e0313320 WatchSource:0}: Error finding container e6f6f2be9f9b0a5e0388152376dc85542dc1343451740be9796aea39e0313320: Status 404 returned error can't find the container with id e6f6f2be9f9b0a5e0388152376dc85542dc1343451740be9796aea39e0313320
Jul 29 19:22:20.464326 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:20.464309    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:22:21.092389 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:21.092352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725" event={"ID":"9f423ca6-bc40-478a-89cf-89fd98314c15","Type":"ContainerStarted","Data":"e6f6f2be9f9b0a5e0388152376dc85542dc1343451740be9796aea39e0313320"}
Jul 29 19:22:24.109225 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:24.109191    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725" event={"ID":"9f423ca6-bc40-478a-89cf-89fd98314c15","Type":"ContainerStarted","Data":"aca230e48911334dff0011902c6e8ad7b1d66f7038a4ee9be4b7527809b9a3fa"}
Jul 29 19:22:24.125577 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:24.125533    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt725" podStartSLOduration=2.045651171 podStartE2EDuration="5.125520482s" totalImagesPullingTime="3.079869311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:24.12535401 +0000 UTC m=+314.045664336" watchObservedRunningTime="2026-07-29 19:22:24.125520482 +0000 UTC m=+314.045830803"
Jul 29 19:22:32.839059 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:32.839017    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"]
Jul 29 19:22:32.841537 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:32.841514    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:32.844400 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:32.844363    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:22:32.845594 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:32.845573    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 19:22:32.845701 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:32.845623    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f4p44\""
Jul 29 19:22:32.853177 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:32.853146    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"]
Jul 29 19:22:33.005892 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.005864    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpf7l\" (UID: \"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:33.006007 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.005928    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgx47\" (UniqueName: \"kubernetes.io/projected/6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59-kube-api-access-dgx47\") pod \"openshift-lws-operator-fd8ccff4c-cpf7l\" (UID: \"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:33.106698 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.106639    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpf7l\" (UID: \"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:33.106781 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.106699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgx47\" (UniqueName: \"kubernetes.io/projected/6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59-kube-api-access-dgx47\") pod \"openshift-lws-operator-fd8ccff4c-cpf7l\" (UID: \"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:33.107034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.107018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpf7l\" (UID: \"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:33.116229 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.116201    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgx47\" (UniqueName: \"kubernetes.io/projected/6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59-kube-api-access-dgx47\") pod \"openshift-lws-operator-fd8ccff4c-cpf7l\" (UID: \"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:33.151177 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.151158    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"
Jul 29 19:22:33.278514 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:33.278491    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l"]
Jul 29 19:22:33.280918 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:22:33.280887    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d8b2bfa_2130_42ca_b6b4_92ffed9f4c59.slice/crio-2c650cf656b567637cc4077e9552f852ba5f007191a4e19b82de067a56ada9d0 WatchSource:0}: Error finding container 2c650cf656b567637cc4077e9552f852ba5f007191a4e19b82de067a56ada9d0: Status 404 returned error can't find the container with id 2c650cf656b567637cc4077e9552f852ba5f007191a4e19b82de067a56ada9d0
Jul 29 19:22:34.152289 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:34.152248    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l" event={"ID":"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59","Type":"ContainerStarted","Data":"2c650cf656b567637cc4077e9552f852ba5f007191a4e19b82de067a56ada9d0"}
Jul 29 19:22:36.163719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:36.163687    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l" event={"ID":"6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59","Type":"ContainerStarted","Data":"8b7db81b541a7f41f80bd2c184451bbf7b449bca9751b3400d78b08465876cc4"}
Jul 29 19:22:36.181984 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:36.181929    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpf7l" podStartSLOduration=1.879931727 podStartE2EDuration="4.181910786s" totalImagesPullingTime="2.301979059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:36.181031699 +0000 UTC m=+326.101342009" watchObservedRunningTime="2026-07-29 19:22:36.181910786 +0000 UTC m=+326.102221106"
Jul 29 19:22:55.523218 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.523181    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"]
Jul 29 19:22:55.525827 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.525811    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.530703 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.530679    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 19:22:55.530934 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.530906    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 19:22:55.531040 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.531021    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-72wzr\""
Jul 29 19:22:55.531490 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.531470    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 19:22:55.531593 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.531545    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 19:22:55.547487 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.547463    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"]
Jul 29 19:22:55.575255 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.575229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-manifests\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.575353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.575267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.575353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.575289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwmgc\" (UniqueName: \"kubernetes.io/projected/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-kube-api-access-zwmgc\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.575353 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.575340    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-tmp\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.575462 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.575401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-webhook-cert\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.675822 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.675799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.675933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.675831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwmgc\" (UniqueName: \"kubernetes.io/projected/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-kube-api-access-zwmgc\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.675933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.675854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-tmp\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.675933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.675894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-webhook-cert\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.675933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.675919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-manifests\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.676321 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.676294    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-manifests\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.678107 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.678086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-tmp\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.678370 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.678349    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-webhook-cert\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.678439 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.678417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.683934 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.683915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwmgc\" (UniqueName: \"kubernetes.io/projected/0203bb99-ad03-4b85-b5a5-a0f57aa7bef9-kube-api-access-zwmgc\") pod \"opendatahub-operator-controller-manager-d84699fcf-xwtjf\" (UID: \"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9\") " pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.835986 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.835964    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:22:55.969549 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:55.969523    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"]
Jul 29 19:22:55.971790 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:22:55.971763    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0203bb99_ad03_4b85_b5a5_a0f57aa7bef9.slice/crio-9a0c1d59fbf498576ef8b1f72d92ee7f6b9a1371f756b276095b2e1a47a595f2 WatchSource:0}: Error finding container 9a0c1d59fbf498576ef8b1f72d92ee7f6b9a1371f756b276095b2e1a47a595f2: Status 404 returned error can't find the container with id 9a0c1d59fbf498576ef8b1f72d92ee7f6b9a1371f756b276095b2e1a47a595f2
Jul 29 19:22:56.256381 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:56.256296    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf" event={"ID":"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9","Type":"ContainerStarted","Data":"9a0c1d59fbf498576ef8b1f72d92ee7f6b9a1371f756b276095b2e1a47a595f2"}
Jul 29 19:22:59.273048 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:22:59.272964    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf" event={"ID":"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9","Type":"ContainerStarted","Data":"879d325f178fff2f9ba6b48e218c910495d249250a1e77729bcad014f11caa01"}
Jul 29 19:23:00.279547 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:00.279465    2584 generic.go:356] "Generic (PLEG): container finished" podID="0203bb99-ad03-4b85-b5a5-a0f57aa7bef9" containerID="879d325f178fff2f9ba6b48e218c910495d249250a1e77729bcad014f11caa01" exitCode=0
Jul 29 19:23:00.279547 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:00.279521    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf" event={"ID":"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9","Type":"ContainerDied","Data":"879d325f178fff2f9ba6b48e218c910495d249250a1e77729bcad014f11caa01"}
Jul 29 19:23:01.285736 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:01.285692    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf" event={"ID":"0203bb99-ad03-4b85-b5a5-a0f57aa7bef9","Type":"ContainerStarted","Data":"9f35e3385c8082d35843a9723192a283fb98ab36345590bfe70f741d43769323"}
Jul 29 19:23:01.286104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:01.285848    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:23:01.316123 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:01.316071    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf" podStartSLOduration=1.96793763 podStartE2EDuration="6.316055695s" totalImagesPullingTime="3.334472242s" totalInitContainerRuntime="1.013645823s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:01.315815702 +0000 UTC m=+351.236126017" watchObservedRunningTime="2026-07-29 19:23:01.316055695 +0000 UTC m=+351.236366039"
Jul 29 19:23:12.292590 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:12.292507    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d84699fcf-xwtjf"
Jul 29 19:23:21.609414 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.609382    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"]
Jul 29 19:23:21.616314 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.616293    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.622786 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.622428    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 19:23:21.622786 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.622574    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lgfbs\""
Jul 29 19:23:21.622786 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.622581    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 19:23:21.622967 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.622860    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 19:23:21.623287 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.623275    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 19:23:21.637218 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.637198    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"]
Jul 29 19:23:21.678191 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.678171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-tmp\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.678302 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.678216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhgr5\" (UniqueName: \"kubernetes.io/projected/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-kube-api-access-vhgr5\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.678367 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.678340    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-tls-certs\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.778833 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.778809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-tls-certs\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.778933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.778845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-tmp\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.778933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.778873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhgr5\" (UniqueName: \"kubernetes.io/projected/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-kube-api-access-vhgr5\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.781100 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.781074    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-tmp\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.781259 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.781243    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-tls-certs\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.790688 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.790664    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhgr5\" (UniqueName: \"kubernetes.io/projected/d823049a-ebb9-45ad-9af6-44ea8f9e5b6f-kube-api-access-vhgr5\") pod \"kube-auth-proxy-6d594574db-gkqdq\" (UID: \"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f\") " pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.888034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.887970    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-q4frk"]
Jul 29 19:23:21.890618 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.890587    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:21.898934 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.898911    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 19:23:21.899035 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.898996    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qsdzs\""
Jul 29 19:23:21.920540 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.920516    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-q4frk"]
Jul 29 19:23:21.925572 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.925553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"
Jul 29 19:23:21.980383 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.980354    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g55p\" (UniqueName: \"kubernetes.io/projected/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-kube-api-access-4g55p\") pod \"odh-model-controller-7998c67dc4-q4frk\" (UID: \"13dba57e-4f5b-4a75-b69c-6baa097ad3b5\") " pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:21.980574 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:21.980509    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-cert\") pod \"odh-model-controller-7998c67dc4-q4frk\" (UID: \"13dba57e-4f5b-4a75-b69c-6baa097ad3b5\") " pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:22.081319 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.081289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-cert\") pod \"odh-model-controller-7998c67dc4-q4frk\" (UID: \"13dba57e-4f5b-4a75-b69c-6baa097ad3b5\") " pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:22.081477 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.081356    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g55p\" (UniqueName: \"kubernetes.io/projected/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-kube-api-access-4g55p\") pod \"odh-model-controller-7998c67dc4-q4frk\" (UID: \"13dba57e-4f5b-4a75-b69c-6baa097ad3b5\") " pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:22.081477 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:23:22.081448    2584 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 19:23:22.081563 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:23:22.081522    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-cert podName:13dba57e-4f5b-4a75-b69c-6baa097ad3b5 nodeName:}" failed. No retries permitted until 2026-07-29 19:23:22.581505527 +0000 UTC m=+372.501815828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-cert") pod "odh-model-controller-7998c67dc4-q4frk" (UID: "13dba57e-4f5b-4a75-b69c-6baa097ad3b5") : secret "odh-model-controller-webhook-cert" not found
Jul 29 19:23:22.086244 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.086223    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d594574db-gkqdq"]
Jul 29 19:23:22.088908 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:23:22.088885    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd823049a_ebb9_45ad_9af6_44ea8f9e5b6f.slice/crio-bf71f00a686f55d5b680db0c30b613bbeebfcdb8d48c8742e78937c2f0c87e76 WatchSource:0}: Error finding container bf71f00a686f55d5b680db0c30b613bbeebfcdb8d48c8742e78937c2f0c87e76: Status 404 returned error can't find the container with id bf71f00a686f55d5b680db0c30b613bbeebfcdb8d48c8742e78937c2f0c87e76
Jul 29 19:23:22.100119 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.100096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g55p\" (UniqueName: \"kubernetes.io/projected/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-kube-api-access-4g55p\") pod \"odh-model-controller-7998c67dc4-q4frk\" (UID: \"13dba57e-4f5b-4a75-b69c-6baa097ad3b5\") " pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:22.388437 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.388408    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq" event={"ID":"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f","Type":"ContainerStarted","Data":"bf71f00a686f55d5b680db0c30b613bbeebfcdb8d48c8742e78937c2f0c87e76"}
Jul 29 19:23:22.585198 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.585164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-cert\") pod \"odh-model-controller-7998c67dc4-q4frk\" (UID: \"13dba57e-4f5b-4a75-b69c-6baa097ad3b5\") " pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:22.587504 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.587480    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dba57e-4f5b-4a75-b69c-6baa097ad3b5-cert\") pod \"odh-model-controller-7998c67dc4-q4frk\" (UID: \"13dba57e-4f5b-4a75-b69c-6baa097ad3b5\") " pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:22.801074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.801001    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:22.996222 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:22.996127    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-q4frk"]
Jul 29 19:23:22.998715 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:23:22.998681    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13dba57e_4f5b_4a75_b69c_6baa097ad3b5.slice/crio-ed1a697cfc01a359888ab7c65d259b2850e02ed48c31d61564329712be075f0d WatchSource:0}: Error finding container ed1a697cfc01a359888ab7c65d259b2850e02ed48c31d61564329712be075f0d: Status 404 returned error can't find the container with id ed1a697cfc01a359888ab7c65d259b2850e02ed48c31d61564329712be075f0d
Jul 29 19:23:23.395130 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.395093    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-q4frk" event={"ID":"13dba57e-4f5b-4a75-b69c-6baa097ad3b5","Type":"ContainerStarted","Data":"ed1a697cfc01a359888ab7c65d259b2850e02ed48c31d61564329712be075f0d"}
Jul 29 19:23:23.586461 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.586424    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gxvm5"]
Jul 29 19:23:23.590330 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.590303    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.620041 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.620016    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 19:23:23.620169 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.620045    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tjkw5\""
Jul 29 19:23:23.621358 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.621331    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gxvm5"]
Jul 29 19:23:23.697666 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.697528    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjqnk\" (UniqueName: \"kubernetes.io/projected/4172f78d-ec8e-4e6a-8d48-d2b46860a57d-kube-api-access-mjqnk\") pod \"model-serving-api-54d89bd5fc-gxvm5\" (UID: \"4172f78d-ec8e-4e6a-8d48-d2b46860a57d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.697807 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.697675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f78d-ec8e-4e6a-8d48-d2b46860a57d-tls-certs\") pod \"model-serving-api-54d89bd5fc-gxvm5\" (UID: \"4172f78d-ec8e-4e6a-8d48-d2b46860a57d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.799232 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.799196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqnk\" (UniqueName: \"kubernetes.io/projected/4172f78d-ec8e-4e6a-8d48-d2b46860a57d-kube-api-access-mjqnk\") pod \"model-serving-api-54d89bd5fc-gxvm5\" (UID: \"4172f78d-ec8e-4e6a-8d48-d2b46860a57d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.799407 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.799297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f78d-ec8e-4e6a-8d48-d2b46860a57d-tls-certs\") pod \"model-serving-api-54d89bd5fc-gxvm5\" (UID: \"4172f78d-ec8e-4e6a-8d48-d2b46860a57d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.809927 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.804479    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4172f78d-ec8e-4e6a-8d48-d2b46860a57d-tls-certs\") pod \"model-serving-api-54d89bd5fc-gxvm5\" (UID: \"4172f78d-ec8e-4e6a-8d48-d2b46860a57d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.825450 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.825396    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqnk\" (UniqueName: \"kubernetes.io/projected/4172f78d-ec8e-4e6a-8d48-d2b46860a57d-kube-api-access-mjqnk\") pod \"model-serving-api-54d89bd5fc-gxvm5\" (UID: \"4172f78d-ec8e-4e6a-8d48-d2b46860a57d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.886767 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.886736    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"]
Jul 29 19:23:23.891271 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.891247    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:23.894137 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.894112    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 19:23:23.895011 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.894507    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 19:23:23.895011 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.894507    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 19:23:23.895011 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.894800    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-flws2\""
Jul 29 19:23:23.895011 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.894964    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 19:23:23.905381 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.905203    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:23.916019 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:23.915997    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"]
Jul 29 19:23:24.001497 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.001422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.001497 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.001465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.001763 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.001507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.001763 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.001591    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxk8p\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-kube-api-access-mxk8p\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.001763 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.001641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf604-bee6-486f-9cb6-ad92db66bd1f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.001763 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.001723    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.001981 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.001766    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.102523 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.102493    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.102692 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.102558    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.102692 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.102593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.102692 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.102645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.102692 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.102682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.102926 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.102732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxk8p\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-kube-api-access-mxk8p\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.102926 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.102758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf604-bee6-486f-9cb6-ad92db66bd1f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.103643 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.103573    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.107120 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.106218    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf604-bee6-486f-9cb6-ad92db66bd1f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.107120 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.106285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.107726 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.107699    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.108337 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.108313    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.113061 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.113037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.115124 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.115082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxk8p\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-kube-api-access-mxk8p\") pod \"istiod-openshift-gateway-7b7995d5cd-w7l26\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:24.206127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:24.206098    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:25.983218 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:25.983196    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gxvm5"]
Jul 29 19:23:25.986805 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:23:25.986780    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4172f78d_ec8e_4e6a_8d48_d2b46860a57d.slice/crio-b345f3ca62358cecece49eb2979b2247915fe70f7e5e4b396ae81176ab1602ba WatchSource:0}: Error finding container b345f3ca62358cecece49eb2979b2247915fe70f7e5e4b396ae81176ab1602ba: Status 404 returned error can't find the container with id b345f3ca62358cecece49eb2979b2247915fe70f7e5e4b396ae81176ab1602ba
Jul 29 19:23:25.988412 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:25.988333    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"]
Jul 29 19:23:25.990946 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:23:25.990920    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25acf604_bee6_486f_9cb6_ad92db66bd1f.slice/crio-5ecae19d2aa42ed2cfeda6bbcac5170b7a07b21830c8d91ab031bf544f63b041 WatchSource:0}: Error finding container 5ecae19d2aa42ed2cfeda6bbcac5170b7a07b21830c8d91ab031bf544f63b041: Status 404 returned error can't find the container with id 5ecae19d2aa42ed2cfeda6bbcac5170b7a07b21830c8d91ab031bf544f63b041
Jul 29 19:23:26.411255 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:26.411215    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26" event={"ID":"25acf604-bee6-486f-9cb6-ad92db66bd1f","Type":"ContainerStarted","Data":"5ecae19d2aa42ed2cfeda6bbcac5170b7a07b21830c8d91ab031bf544f63b041"}
Jul 29 19:23:26.412278 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:26.412255    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5" event={"ID":"4172f78d-ec8e-4e6a-8d48-d2b46860a57d","Type":"ContainerStarted","Data":"b345f3ca62358cecece49eb2979b2247915fe70f7e5e4b396ae81176ab1602ba"}
Jul 29 19:23:26.413595 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:26.413575    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq" event={"ID":"d823049a-ebb9-45ad-9af6-44ea8f9e5b6f","Type":"ContainerStarted","Data":"f82a79fdf47700d6ed13abd2bba159c579d381d8723dfbe890e0b4a7fe8f8d13"}
Jul 29 19:23:26.415096 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:26.415074    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-q4frk" event={"ID":"13dba57e-4f5b-4a75-b69c-6baa097ad3b5","Type":"ContainerStarted","Data":"c8712171b430f2c0c31bfb271b3b4e9506fe1c812d3d5672d75e224c507cc9d1"}
Jul 29 19:23:26.415217 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:26.415202    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:26.437404 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:26.437361    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d594574db-gkqdq" podStartSLOduration=1.720917684 podStartE2EDuration="5.437350314s" totalImagesPullingTime="3.71643263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:26.435331692 +0000 UTC m=+376.355642004" watchObservedRunningTime="2026-07-29 19:23:26.437350314 +0000 UTC m=+376.357660633"
Jul 29 19:23:28.840221 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:28.840187    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:23:28.840512 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:28.840254    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:23:29.435106 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.435066    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26" event={"ID":"25acf604-bee6-486f-9cb6-ad92db66bd1f","Type":"ContainerStarted","Data":"c02244b8cc9752c6bf98b89641640ebef3df23711d6a3eea212a80e11aa82ee8"}
Jul 29 19:23:29.435288 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.435200    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:29.436695 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.436661    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5" event={"ID":"4172f78d-ec8e-4e6a-8d48-d2b46860a57d","Type":"ContainerStarted","Data":"ff64c7c2874ec66376cd5b647e306410e41078722d6d130af7afb7da99cb4385"}
Jul 29 19:23:29.436825 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.436808    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:23:29.437302 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.437277    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-w7l26 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 19:23:29.437400 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.437318    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26" podUID="25acf604-bee6-486f-9cb6-ad92db66bd1f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:23:29.496158 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.496112    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-q4frk" podStartSLOduration=5.63539368 podStartE2EDuration="8.496099785s" totalImagesPullingTime="2.860706105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:26.457494708 +0000 UTC m=+376.377805029" watchObservedRunningTime="2026-07-29 19:23:29.496099785 +0000 UTC m=+379.416410175"
Jul 29 19:23:29.497223 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.497181    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26" podStartSLOduration=3.650266228 podStartE2EDuration="6.49717098s" totalImagesPullingTime="2.846904752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:29.494470663 +0000 UTC m=+379.414780986" watchObservedRunningTime="2026-07-29 19:23:29.49717098 +0000 UTC m=+379.417481299"
Jul 29 19:23:29.533212 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:29.533163    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5" podStartSLOduration=4.59587472 podStartE2EDuration="6.533146372s" totalImagesPullingTime="1.937271652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:29.531128942 +0000 UTC m=+379.451439260" watchObservedRunningTime="2026-07-29 19:23:29.533146372 +0000 UTC m=+379.453456671"
Jul 29 19:23:30.442324 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:30.442295    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:34.096759 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.096730    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"]
Jul 29 19:23:34.099313 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.099289    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.102486 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.102465    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8rhqq\""
Jul 29 19:23:34.103443 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.103423    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 19:23:34.105309 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.105288    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"]
Jul 29 19:23:34.108012 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.107993    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:34.114400 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.114377    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 19:23:34.119861 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.119839    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"]
Jul 29 19:23:34.120791 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.120772    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5vfqh\""
Jul 29 19:23:34.126668 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.126650    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"]
Jul 29 19:23:34.200937 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.200916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvgjc\" (UniqueName: \"kubernetes.io/projected/23e0d45b-ca78-4c71-abff-87c428f327d3-kube-api-access-wvgjc\") pod \"llmisvc-controller-manager-777c6bd7d5-ntksw\" (UID: \"23e0d45b-ca78-4c71-abff-87c428f327d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:34.201031 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.200954    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23e0d45b-ca78-4c71-abff-87c428f327d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ntksw\" (UID: \"23e0d45b-ca78-4c71-abff-87c428f327d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:34.201031 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.200981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmp98\" (UniqueName: \"kubernetes.io/projected/e19572df-33a4-48c1-abd3-2b8150da8709-kube-api-access-kmp98\") pod \"kserve-controller-manager-d6f4b65b8-ht85b\" (UID: \"e19572df-33a4-48c1-abd3-2b8150da8709\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.201128 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.201049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19572df-33a4-48c1-abd3-2b8150da8709-cert\") pod \"kserve-controller-manager-d6f4b65b8-ht85b\" (UID: \"e19572df-33a4-48c1-abd3-2b8150da8709\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.301997 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.301968    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgjc\" (UniqueName: \"kubernetes.io/projected/23e0d45b-ca78-4c71-abff-87c428f327d3-kube-api-access-wvgjc\") pod \"llmisvc-controller-manager-777c6bd7d5-ntksw\" (UID: \"23e0d45b-ca78-4c71-abff-87c428f327d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:34.302117 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.302012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23e0d45b-ca78-4c71-abff-87c428f327d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ntksw\" (UID: \"23e0d45b-ca78-4c71-abff-87c428f327d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:34.302117 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.302054    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmp98\" (UniqueName: \"kubernetes.io/projected/e19572df-33a4-48c1-abd3-2b8150da8709-kube-api-access-kmp98\") pod \"kserve-controller-manager-d6f4b65b8-ht85b\" (UID: \"e19572df-33a4-48c1-abd3-2b8150da8709\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.302281 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.302124    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19572df-33a4-48c1-abd3-2b8150da8709-cert\") pod \"kserve-controller-manager-d6f4b65b8-ht85b\" (UID: \"e19572df-33a4-48c1-abd3-2b8150da8709\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.302281 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:23:34.302175    2584 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 29 19:23:34.302281 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:23:34.302241    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e0d45b-ca78-4c71-abff-87c428f327d3-cert podName:23e0d45b-ca78-4c71-abff-87c428f327d3 nodeName:}" failed. No retries permitted until 2026-07-29 19:23:34.802222071 +0000 UTC m=+384.722532369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/23e0d45b-ca78-4c71-abff-87c428f327d3-cert") pod "llmisvc-controller-manager-777c6bd7d5-ntksw" (UID: "23e0d45b-ca78-4c71-abff-87c428f327d3") : secret "llmisvc-webhook-server-cert" not found
Jul 29 19:23:34.304685 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.304663    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19572df-33a4-48c1-abd3-2b8150da8709-cert\") pod \"kserve-controller-manager-d6f4b65b8-ht85b\" (UID: \"e19572df-33a4-48c1-abd3-2b8150da8709\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.316669 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.316642    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvgjc\" (UniqueName: \"kubernetes.io/projected/23e0d45b-ca78-4c71-abff-87c428f327d3-kube-api-access-wvgjc\") pod \"llmisvc-controller-manager-777c6bd7d5-ntksw\" (UID: \"23e0d45b-ca78-4c71-abff-87c428f327d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:34.317104 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.317081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmp98\" (UniqueName: \"kubernetes.io/projected/e19572df-33a4-48c1-abd3-2b8150da8709-kube-api-access-kmp98\") pod \"kserve-controller-manager-d6f4b65b8-ht85b\" (UID: \"e19572df-33a4-48c1-abd3-2b8150da8709\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.410012 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.409954    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:34.555246 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.555216    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"]
Jul 29 19:23:34.556444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:23:34.556421    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19572df_33a4_48c1_abd3_2b8150da8709.slice/crio-a808c31b69c5041a9fea04ba412d71968de0274f89ce15ca5f03fb222a8f51d1 WatchSource:0}: Error finding container a808c31b69c5041a9fea04ba412d71968de0274f89ce15ca5f03fb222a8f51d1: Status 404 returned error can't find the container with id a808c31b69c5041a9fea04ba412d71968de0274f89ce15ca5f03fb222a8f51d1
Jul 29 19:23:34.806579 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.806522    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23e0d45b-ca78-4c71-abff-87c428f327d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ntksw\" (UID: \"23e0d45b-ca78-4c71-abff-87c428f327d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:34.808828 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:34.808807    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23e0d45b-ca78-4c71-abff-87c428f327d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ntksw\" (UID: \"23e0d45b-ca78-4c71-abff-87c428f327d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:35.017690 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.017660    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:35.188114 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:23:35.188074    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod23e0d45b_ca78_4c71_abff_87c428f327d3.slice/crio-72fd4778d514636319f016942b448366d4ce0f1859ca90300933f6e5cc89e91f WatchSource:0}: Error finding container 72fd4778d514636319f016942b448366d4ce0f1859ca90300933f6e5cc89e91f: Status 404 returned error can't find the container with id 72fd4778d514636319f016942b448366d4ce0f1859ca90300933f6e5cc89e91f
Jul 29 19:23:35.189023 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.188965    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"]
Jul 29 19:23:35.344211 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.344177    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"]
Jul 29 19:23:35.344422 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.344392    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26" podUID="25acf604-bee6-486f-9cb6-ad92db66bd1f" containerName="discovery" containerID="cri-o://c02244b8cc9752c6bf98b89641640ebef3df23711d6a3eea212a80e11aa82ee8" gracePeriod=30
Jul 29 19:23:35.468580 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.468545    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b" event={"ID":"e19572df-33a4-48c1-abd3-2b8150da8709","Type":"ContainerStarted","Data":"a808c31b69c5041a9fea04ba412d71968de0274f89ce15ca5f03fb222a8f51d1"}
Jul 29 19:23:35.470200 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.470168    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw" event={"ID":"23e0d45b-ca78-4c71-abff-87c428f327d3","Type":"ContainerStarted","Data":"72fd4778d514636319f016942b448366d4ce0f1859ca90300933f6e5cc89e91f"}
Jul 29 19:23:35.472039 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.472011    2584 generic.go:356] "Generic (PLEG): container finished" podID="25acf604-bee6-486f-9cb6-ad92db66bd1f" containerID="c02244b8cc9752c6bf98b89641640ebef3df23711d6a3eea212a80e11aa82ee8" exitCode=0
Jul 29 19:23:35.472190 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.472085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26" event={"ID":"25acf604-bee6-486f-9cb6-ad92db66bd1f","Type":"ContainerDied","Data":"c02244b8cc9752c6bf98b89641640ebef3df23711d6a3eea212a80e11aa82ee8"}
Jul 29 19:23:35.609348 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.609295    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:35.714290 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714259    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxk8p\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-kube-api-access-mxk8p\") pod \"25acf604-bee6-486f-9cb6-ad92db66bd1f\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") "
Jul 29 19:23:35.714473 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714321    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-ca-configmap\") pod \"25acf604-bee6-486f-9cb6-ad92db66bd1f\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") "
Jul 29 19:23:35.714473 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714344    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-cacerts\") pod \"25acf604-bee6-486f-9cb6-ad92db66bd1f\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") "
Jul 29 19:23:35.714473 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714421    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-token\") pod \"25acf604-bee6-486f-9cb6-ad92db66bd1f\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") "
Jul 29 19:23:35.714473 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714463    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-dns-cert\") pod \"25acf604-bee6-486f-9cb6-ad92db66bd1f\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") "
Jul 29 19:23:35.714716 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714494    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-kubeconfig\") pod \"25acf604-bee6-486f-9cb6-ad92db66bd1f\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") "
Jul 29 19:23:35.714716 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714547    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf604-bee6-486f-9cb6-ad92db66bd1f-local-certs\") pod \"25acf604-bee6-486f-9cb6-ad92db66bd1f\" (UID: \"25acf604-bee6-486f-9cb6-ad92db66bd1f\") "
Jul 29 19:23:35.714820 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.714744    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "25acf604-bee6-486f-9cb6-ad92db66bd1f" (UID: "25acf604-bee6-486f-9cb6-ad92db66bd1f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:23:35.715245 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.715221    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-ca-configmap\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:23:35.717397 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.717365    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "25acf604-bee6-486f-9cb6-ad92db66bd1f" (UID: "25acf604-bee6-486f-9cb6-ad92db66bd1f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:23:35.717520 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.717480    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "25acf604-bee6-486f-9cb6-ad92db66bd1f" (UID: "25acf604-bee6-486f-9cb6-ad92db66bd1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:23:35.717597 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.717543    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-cacerts" (OuterVolumeSpecName: "cacerts") pod "25acf604-bee6-486f-9cb6-ad92db66bd1f" (UID: "25acf604-bee6-486f-9cb6-ad92db66bd1f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:23:35.718285 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.718239    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-kube-api-access-mxk8p" (OuterVolumeSpecName: "kube-api-access-mxk8p") pod "25acf604-bee6-486f-9cb6-ad92db66bd1f" (UID: "25acf604-bee6-486f-9cb6-ad92db66bd1f"). InnerVolumeSpecName "kube-api-access-mxk8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:23:35.718642 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.718583    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "25acf604-bee6-486f-9cb6-ad92db66bd1f" (UID: "25acf604-bee6-486f-9cb6-ad92db66bd1f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:23:35.718889 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.718857    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25acf604-bee6-486f-9cb6-ad92db66bd1f-local-certs" (OuterVolumeSpecName: "local-certs") pod "25acf604-bee6-486f-9cb6-ad92db66bd1f" (UID: "25acf604-bee6-486f-9cb6-ad92db66bd1f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:23:35.815617 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.815586    2584 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-cacerts\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:23:35.815719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.815659    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-token\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:23:35.815719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.815675    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-csr-dns-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:23:35.815719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.815684    2584 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25acf604-bee6-486f-9cb6-ad92db66bd1f-istio-kubeconfig\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:23:35.815719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.815694    2584 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25acf604-bee6-486f-9cb6-ad92db66bd1f-local-certs\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:23:35.815848 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:35.815726    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxk8p\" (UniqueName: \"kubernetes.io/projected/25acf604-bee6-486f-9cb6-ad92db66bd1f-kube-api-access-mxk8p\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:23:36.480713 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:36.480670    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26" event={"ID":"25acf604-bee6-486f-9cb6-ad92db66bd1f","Type":"ContainerDied","Data":"5ecae19d2aa42ed2cfeda6bbcac5170b7a07b21830c8d91ab031bf544f63b041"}
Jul 29 19:23:36.481186 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:36.480776    2584 scope.go:117] "RemoveContainer" containerID="c02244b8cc9752c6bf98b89641640ebef3df23711d6a3eea212a80e11aa82ee8"
Jul 29 19:23:36.481186 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:36.480791    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"
Jul 29 19:23:36.522379 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:36.522344    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"]
Jul 29 19:23:36.525030 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:36.525003    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w7l26"]
Jul 29 19:23:36.594847 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:36.594813    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25acf604-bee6-486f-9cb6-ad92db66bd1f" path="/var/lib/kubelet/pods/25acf604-bee6-486f-9cb6-ad92db66bd1f/volumes"
Jul 29 19:23:37.424470 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:37.424443    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-q4frk"
Jul 29 19:23:37.491571 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:37.491537    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b" event={"ID":"e19572df-33a4-48c1-abd3-2b8150da8709","Type":"ContainerStarted","Data":"a3ae8d490f51d444b6c419220418683d3fd632791a9b86b7e93f06b761c49a87"}
Jul 29 19:23:37.492021 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:37.491792    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:23:37.536682 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:37.536629    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b" podStartSLOduration=1.120852044 podStartE2EDuration="3.53659675s" totalImagesPullingTime="2.415744706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:37.534736985 +0000 UTC m=+387.455047305" watchObservedRunningTime="2026-07-29 19:23:37.53659675 +0000 UTC m=+387.456907069"
Jul 29 19:23:38.498069 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:38.498034    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw" event={"ID":"23e0d45b-ca78-4c71-abff-87c428f327d3","Type":"ContainerStarted","Data":"9eeb8420fe8a9e2d1739aeabc04edf14e5fac9030cb13eacc25678c7b4adeb75"}
Jul 29 19:23:38.498501 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:38.498180    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:23:38.600554 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:38.600509    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw" podStartSLOduration=2.027561233 podStartE2EDuration="4.600495321s" totalImagesPullingTime="2.572934088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:38.599406485 +0000 UTC m=+388.519716804" watchObservedRunningTime="2026-07-29 19:23:38.600495321 +0000 UTC m=+388.520805691"
Jul 29 19:23:40.446679 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:23:40.446649    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gxvm5"
Jul 29 19:24:08.504127 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:08.504084    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht85b"
Jul 29 19:24:09.504455 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:09.504419    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ntksw"
Jul 29 19:24:17.155210 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.155179    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ccgj2"]
Jul 29 19:24:17.155718 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.155550    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25acf604-bee6-486f-9cb6-ad92db66bd1f" containerName="discovery"
Jul 29 19:24:17.155718 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.155560    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="25acf604-bee6-486f-9cb6-ad92db66bd1f" containerName="discovery"
Jul 29 19:24:17.155718 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.155647    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="25acf604-bee6-486f-9cb6-ad92db66bd1f" containerName="discovery"
Jul 29 19:24:17.162518 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.162498    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2"
Jul 29 19:24:17.165301 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.165284    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 19:24:17.165418 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.165404    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 19:24:17.166291 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.166275    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cj2g4\""
Jul 29 19:24:17.180325 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.180302    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ccgj2"]
Jul 29 19:24:17.241588 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.241560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4b4g\" (UniqueName: \"kubernetes.io/projected/9335903f-b686-4305-993f-9efe1a6e8282-kube-api-access-s4b4g\") pod \"kuadrant-operator-catalog-ccgj2\" (UID: \"9335903f-b686-4305-993f-9efe1a6e8282\") " pod="kuadrant-system/kuadrant-operator-catalog-ccgj2"
Jul 29 19:24:17.342137 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.342113    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4b4g\" (UniqueName: \"kubernetes.io/projected/9335903f-b686-4305-993f-9efe1a6e8282-kube-api-access-s4b4g\") pod \"kuadrant-operator-catalog-ccgj2\" (UID: \"9335903f-b686-4305-993f-9efe1a6e8282\") " pod="kuadrant-system/kuadrant-operator-catalog-ccgj2"
Jul 29 19:24:17.358013 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.357993    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4b4g\" (UniqueName: \"kubernetes.io/projected/9335903f-b686-4305-993f-9efe1a6e8282-kube-api-access-s4b4g\") pod \"kuadrant-operator-catalog-ccgj2\" (UID: \"9335903f-b686-4305-993f-9efe1a6e8282\") " pod="kuadrant-system/kuadrant-operator-catalog-ccgj2"
Jul 29 19:24:17.472948 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.472894    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2"
Jul 29 19:24:17.597927 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.597896    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ccgj2"]
Jul 29 19:24:17.630662 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.630639    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ccgj2"]
Jul 29 19:24:17.634263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:24:17.634233    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9335903f_b686_4305_993f_9efe1a6e8282.slice/crio-bdc6b1aadba147306a61fa289b93f4ef1a84468d49797c0e198f762598471653 WatchSource:0}: Error finding container bdc6b1aadba147306a61fa289b93f4ef1a84468d49797c0e198f762598471653: Status 404 returned error can't find the container with id bdc6b1aadba147306a61fa289b93f4ef1a84468d49797c0e198f762598471653
Jul 29 19:24:17.688982 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.688956    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2" event={"ID":"9335903f-b686-4305-993f-9efe1a6e8282","Type":"ContainerStarted","Data":"bdc6b1aadba147306a61fa289b93f4ef1a84468d49797c0e198f762598471653"}
Jul 29 19:24:17.717750 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.717726    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qbcjg"]
Jul 29 19:24:17.722357 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.722340    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:17.729717 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.729696    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qbcjg"]
Jul 29 19:24:17.846532 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.846507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzprs\" (UniqueName: \"kubernetes.io/projected/b35a7c47-8a86-417f-bf35-d3add65170c7-kube-api-access-qzprs\") pod \"kuadrant-operator-catalog-qbcjg\" (UID: \"b35a7c47-8a86-417f-bf35-d3add65170c7\") " pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:17.947272 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.947246    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzprs\" (UniqueName: \"kubernetes.io/projected/b35a7c47-8a86-417f-bf35-d3add65170c7-kube-api-access-qzprs\") pod \"kuadrant-operator-catalog-qbcjg\" (UID: \"b35a7c47-8a86-417f-bf35-d3add65170c7\") " pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:17.955756 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:17.955738    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzprs\" (UniqueName: \"kubernetes.io/projected/b35a7c47-8a86-417f-bf35-d3add65170c7-kube-api-access-qzprs\") pod \"kuadrant-operator-catalog-qbcjg\" (UID: \"b35a7c47-8a86-417f-bf35-d3add65170c7\") " pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:18.031939 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:18.031876    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:18.175842 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:18.175820    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qbcjg"]
Jul 29 19:24:18.177956 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:24:18.177929    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35a7c47_8a86_417f_bf35_d3add65170c7.slice/crio-4aca8928ecf2ce075bf0c205e4f244820a59f2552e0e5b20363f29222bb560c0 WatchSource:0}: Error finding container 4aca8928ecf2ce075bf0c205e4f244820a59f2552e0e5b20363f29222bb560c0: Status 404 returned error can't find the container with id 4aca8928ecf2ce075bf0c205e4f244820a59f2552e0e5b20363f29222bb560c0
Jul 29 19:24:18.696671 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:18.696636    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg" event={"ID":"b35a7c47-8a86-417f-bf35-d3add65170c7","Type":"ContainerStarted","Data":"4aca8928ecf2ce075bf0c205e4f244820a59f2552e0e5b20363f29222bb560c0"}
Jul 29 19:24:19.704552 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:19.704515    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg" event={"ID":"b35a7c47-8a86-417f-bf35-d3add65170c7","Type":"ContainerStarted","Data":"0e72fcd9ac87b934f4e376da0929ff0bcb4509e351c66e416b1117c0f6a0f378"}
Jul 29 19:24:19.706061 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:19.706037    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2" event={"ID":"9335903f-b686-4305-993f-9efe1a6e8282","Type":"ContainerStarted","Data":"0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87"}
Jul 29 19:24:19.706168 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:19.706107    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2" podUID="9335903f-b686-4305-993f-9efe1a6e8282" containerName="registry-server" containerID="cri-o://0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87" gracePeriod=2
Jul 29 19:24:19.720258 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:19.720207    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg" podStartSLOduration=1.298072487 podStartE2EDuration="2.720187226s" totalImagesPullingTime="1.422114739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:19.719868804 +0000 UTC m=+429.640179125" watchObservedRunningTime="2026-07-29 19:24:19.720187226 +0000 UTC m=+429.640497547"
Jul 29 19:24:19.736460 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:19.736419    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2" podStartSLOduration=0.771440823 podStartE2EDuration="2.73640458s" totalImagesPullingTime="1.964963757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:19.73480146 +0000 UTC m=+429.655111784" watchObservedRunningTime="2026-07-29 19:24:19.73640458 +0000 UTC m=+429.656714899"
Jul 29 19:24:19.946810 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:19.946786    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ccgj2_9335903f-b686-4305-993f-9efe1a6e8282/registry-server/0.log"
Jul 29 19:24:19.949072 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:19.949054    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2"
Jul 29 19:24:20.075488 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.075464    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4b4g\" (UniqueName: \"kubernetes.io/projected/9335903f-b686-4305-993f-9efe1a6e8282-kube-api-access-s4b4g\") pod \"9335903f-b686-4305-993f-9efe1a6e8282\" (UID: \"9335903f-b686-4305-993f-9efe1a6e8282\") "
Jul 29 19:24:20.077540 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.077510    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9335903f-b686-4305-993f-9efe1a6e8282-kube-api-access-s4b4g" (OuterVolumeSpecName: "kube-api-access-s4b4g") pod "9335903f-b686-4305-993f-9efe1a6e8282" (UID: "9335903f-b686-4305-993f-9efe1a6e8282"). InnerVolumeSpecName "kube-api-access-s4b4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:24:20.176890 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.176835    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4b4g\" (UniqueName: \"kubernetes.io/projected/9335903f-b686-4305-993f-9efe1a6e8282-kube-api-access-s4b4g\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:24:20.712129 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.712101    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ccgj2_9335903f-b686-4305-993f-9efe1a6e8282/registry-server/0.log"
Jul 29 19:24:20.712510 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.712142    2584 generic.go:356] "Generic (PLEG): container finished" podID="9335903f-b686-4305-993f-9efe1a6e8282" containerID="0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87" exitCode=1
Jul 29 19:24:20.712510 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.712171    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2" event={"ID":"9335903f-b686-4305-993f-9efe1a6e8282","Type":"ContainerDied","Data":"0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87"}
Jul 29 19:24:20.712510 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.712232    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2" event={"ID":"9335903f-b686-4305-993f-9efe1a6e8282","Type":"ContainerDied","Data":"bdc6b1aadba147306a61fa289b93f4ef1a84468d49797c0e198f762598471653"}
Jul 29 19:24:20.712510 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.712262    2584 scope.go:117] "RemoveContainer" containerID="0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87"
Jul 29 19:24:20.712510 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.712182    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ccgj2"
Jul 29 19:24:20.721451 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.721437    2584 scope.go:117] "RemoveContainer" containerID="0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87"
Jul 29 19:24:20.721731 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:24:20.721715    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87\": container with ID starting with 0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87 not found: ID does not exist" containerID="0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87"
Jul 29 19:24:20.721785 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.721738    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87"} err="failed to get container status \"0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87\": rpc error: code = NotFound desc = could not find container \"0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87\": container with ID starting with 0cf3426731e70bf7f1ce007f6669bd261a4c679f17a3b26c98ff08dc0fdfeb87 not found: ID does not exist"
Jul 29 19:24:20.729116 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.729096    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ccgj2"]
Jul 29 19:24:20.730778 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:20.730761    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ccgj2"]
Jul 29 19:24:22.593855 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:22.593815    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9335903f-b686-4305-993f-9efe1a6e8282" path="/var/lib/kubelet/pods/9335903f-b686-4305-993f-9efe1a6e8282/volumes"
Jul 29 19:24:28.032793 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:28.032757    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:28.033322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:28.032819    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:28.055696 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:28.055669    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:28.778947 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:28.778913    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qbcjg"
Jul 29 19:24:44.292244 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.292152    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"]
Jul 29 19:24:44.292683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.292624    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9335903f-b686-4305-993f-9efe1a6e8282" containerName="registry-server"
Jul 29 19:24:44.292683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.292641    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9335903f-b686-4305-993f-9efe1a6e8282" containerName="registry-server"
Jul 29 19:24:44.292777 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.292731    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9335903f-b686-4305-993f-9efe1a6e8282" containerName="registry-server"
Jul 29 19:24:44.296025 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.296002    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"
Jul 29 19:24:44.298825 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.298803    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5j8gb\""
Jul 29 19:24:44.308784 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.308754    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"]
Jul 29 19:24:44.381524 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.381495    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2xd\" (UniqueName: \"kubernetes.io/projected/77a236d1-c500-45ea-9b19-8411ec50f0d6-kube-api-access-mb2xd\") pod \"authorino-operator-75cc8d5cb7-qvq6q\" (UID: \"77a236d1-c500-45ea-9b19-8411ec50f0d6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"
Jul 29 19:24:44.482061 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.482012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2xd\" (UniqueName: \"kubernetes.io/projected/77a236d1-c500-45ea-9b19-8411ec50f0d6-kube-api-access-mb2xd\") pod \"authorino-operator-75cc8d5cb7-qvq6q\" (UID: \"77a236d1-c500-45ea-9b19-8411ec50f0d6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"
Jul 29 19:24:44.497119 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.497098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2xd\" (UniqueName: \"kubernetes.io/projected/77a236d1-c500-45ea-9b19-8411ec50f0d6-kube-api-access-mb2xd\") pod \"authorino-operator-75cc8d5cb7-qvq6q\" (UID: \"77a236d1-c500-45ea-9b19-8411ec50f0d6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"
Jul 29 19:24:44.607516 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.607497    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"
Jul 29 19:24:44.826914 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:44.826881    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"]
Jul 29 19:24:44.836263 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:24:44.836236    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a236d1_c500_45ea_9b19_8411ec50f0d6.slice/crio-f78aafdc2d415ab44a28a8d5cebc16b11a7e8069c4efac596cf235ea1b526aa2 WatchSource:0}: Error finding container f78aafdc2d415ab44a28a8d5cebc16b11a7e8069c4efac596cf235ea1b526aa2: Status 404 returned error can't find the container with id f78aafdc2d415ab44a28a8d5cebc16b11a7e8069c4efac596cf235ea1b526aa2
Jul 29 19:24:45.843563 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:45.843523    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q" event={"ID":"77a236d1-c500-45ea-9b19-8411ec50f0d6","Type":"ContainerStarted","Data":"f78aafdc2d415ab44a28a8d5cebc16b11a7e8069c4efac596cf235ea1b526aa2"}
Jul 29 19:24:47.856513 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:47.856477    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q" event={"ID":"77a236d1-c500-45ea-9b19-8411ec50f0d6","Type":"ContainerStarted","Data":"ffc128be53dbeea659b999220bff19b394cc7478fba8068ee4dfcb15e53df103"}
Jul 29 19:24:47.856925 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:47.856733    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"
Jul 29 19:24:47.876991 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:47.876943    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q" podStartSLOduration=1.748613712 podStartE2EDuration="3.876927886s" totalImagesPullingTime="2.128314174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:47.876164717 +0000 UTC m=+457.796475037" watchObservedRunningTime="2026-07-29 19:24:47.876927886 +0000 UTC m=+457.797238206"
Jul 29 19:24:49.535969 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.535931    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"]
Jul 29 19:24:49.539771 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.539753    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.544853 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.544832    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wpmn9\""
Jul 29 19:24:49.574336 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.574310    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"]
Jul 29 19:24:49.626812 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.626787    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxwh\" (UniqueName: \"kubernetes.io/projected/ca82719c-77e7-4365-8428-56eebfe98e9c-kube-api-access-mfxwh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.626921 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.626855    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca82719c-77e7-4365-8428-56eebfe98e9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.728041 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.728012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxwh\" (UniqueName: \"kubernetes.io/projected/ca82719c-77e7-4365-8428-56eebfe98e9c-kube-api-access-mfxwh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.728153 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.728089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca82719c-77e7-4365-8428-56eebfe98e9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.728464 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.728443    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca82719c-77e7-4365-8428-56eebfe98e9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.745950 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.745929    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxwh\" (UniqueName: \"kubernetes.io/projected/ca82719c-77e7-4365-8428-56eebfe98e9c-kube-api-access-mfxwh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.850311 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.850286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:49.983581 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:49.983559    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"]
Jul 29 19:24:49.986207 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:24:49.986179    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca82719c_77e7_4365_8428_56eebfe98e9c.slice/crio-5eea915c0430126fd7af51001cf119b888e526bd5e397f0dd8a6e8eca751b5a6 WatchSource:0}: Error finding container 5eea915c0430126fd7af51001cf119b888e526bd5e397f0dd8a6e8eca751b5a6: Status 404 returned error can't find the container with id 5eea915c0430126fd7af51001cf119b888e526bd5e397f0dd8a6e8eca751b5a6
Jul 29 19:24:50.873684 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:50.873649    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2" event={"ID":"ca82719c-77e7-4365-8428-56eebfe98e9c","Type":"ContainerStarted","Data":"5eea915c0430126fd7af51001cf119b888e526bd5e397f0dd8a6e8eca751b5a6"}
Jul 29 19:24:52.791547 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.791508    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"]
Jul 29 19:24:52.795116 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.795093    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"
Jul 29 19:24:52.798140 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.798120    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-l9dwt\""
Jul 29 19:24:52.798632 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.798593    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 19:24:52.816862 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.816839    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"]
Jul 29 19:24:52.857074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.857045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/590531a6-9dc1-4837-a1ef-4615cf885429-kube-api-access-7sklv\") pod \"dns-operator-controller-manager-864dd78c4c-kqw92\" (UID: \"590531a6-9dc1-4837-a1ef-4615cf885429\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"
Jul 29 19:24:52.958497 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.958472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/590531a6-9dc1-4837-a1ef-4615cf885429-kube-api-access-7sklv\") pod \"dns-operator-controller-manager-864dd78c4c-kqw92\" (UID: \"590531a6-9dc1-4837-a1ef-4615cf885429\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"
Jul 29 19:24:52.980086 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:52.980059    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/590531a6-9dc1-4837-a1ef-4615cf885429-kube-api-access-7sklv\") pod \"dns-operator-controller-manager-864dd78c4c-kqw92\" (UID: \"590531a6-9dc1-4837-a1ef-4615cf885429\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"
Jul 29 19:24:53.105331 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:53.105308    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"
Jul 29 19:24:53.254197 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:53.254174    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"]
Jul 29 19:24:53.256444 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:24:53.256415    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590531a6_9dc1_4837_a1ef_4615cf885429.slice/crio-0034cfacb8f872efbbf4682971c7a2b6ba856628457b60555bd0e1ce55e9fb53 WatchSource:0}: Error finding container 0034cfacb8f872efbbf4682971c7a2b6ba856628457b60555bd0e1ce55e9fb53: Status 404 returned error can't find the container with id 0034cfacb8f872efbbf4682971c7a2b6ba856628457b60555bd0e1ce55e9fb53
Jul 29 19:24:53.895725 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:53.895666    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92" event={"ID":"590531a6-9dc1-4837-a1ef-4615cf885429","Type":"ContainerStarted","Data":"0034cfacb8f872efbbf4682971c7a2b6ba856628457b60555bd0e1ce55e9fb53"}
Jul 29 19:24:56.089170 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.089138    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"]
Jul 29 19:24:56.093429 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.093405    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:24:56.096239 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.096219    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n8jk4\""
Jul 29 19:24:56.105034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.105014    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"]
Jul 29 19:24:56.187908 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.187846    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4f5c\" (UniqueName: \"kubernetes.io/projected/695fb02b-5128-4f56-99ff-9642b6c54bb5-kube-api-access-t4f5c\") pod \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" (UID: \"695fb02b-5128-4f56-99ff-9642b6c54bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:24:56.289345 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.289316    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4f5c\" (UniqueName: \"kubernetes.io/projected/695fb02b-5128-4f56-99ff-9642b6c54bb5-kube-api-access-t4f5c\") pod \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" (UID: \"695fb02b-5128-4f56-99ff-9642b6c54bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:24:56.303802 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.303775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4f5c\" (UniqueName: \"kubernetes.io/projected/695fb02b-5128-4f56-99ff-9642b6c54bb5-kube-api-access-t4f5c\") pod \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" (UID: \"695fb02b-5128-4f56-99ff-9642b6c54bb5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:24:56.403272 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.403243    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:24:56.550794 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.550772    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"]
Jul 29 19:24:56.552741 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:24:56.552718    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695fb02b_5128_4f56_99ff_9642b6c54bb5.slice/crio-28319eab9173b87920df609d03cf8c411e3a6abd7c7b563ab35090f858143fcc WatchSource:0}: Error finding container 28319eab9173b87920df609d03cf8c411e3a6abd7c7b563ab35090f858143fcc: Status 404 returned error can't find the container with id 28319eab9173b87920df609d03cf8c411e3a6abd7c7b563ab35090f858143fcc
Jul 29 19:24:56.921155 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.921107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2" event={"ID":"695fb02b-5128-4f56-99ff-9642b6c54bb5","Type":"ContainerStarted","Data":"28319eab9173b87920df609d03cf8c411e3a6abd7c7b563ab35090f858143fcc"}
Jul 29 19:24:56.922807 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.922775    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92" event={"ID":"590531a6-9dc1-4837-a1ef-4615cf885429","Type":"ContainerStarted","Data":"d03e5b13b7ba1a0e0064a3007449c20d2401f4599100fcb9fdd3cce341caeb0f"}
Jul 29 19:24:56.922961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.922863    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"
Jul 29 19:24:56.924489 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.924468    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2" event={"ID":"ca82719c-77e7-4365-8428-56eebfe98e9c","Type":"ContainerStarted","Data":"6acf5e1710abdaee6ad19fdb95b6b3d0b5ac493423253d47d4d82b81d7a6aec8"}
Jul 29 19:24:56.924591 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.924520    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:24:56.949950 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.949910    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92" podStartSLOduration=2.299871433 podStartE2EDuration="4.949896897s" totalImagesPullingTime="2.650025464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:56.948051331 +0000 UTC m=+466.868361651" watchObservedRunningTime="2026-07-29 19:24:56.949896897 +0000 UTC m=+466.870207217"
Jul 29 19:24:56.974452 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:56.974412    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2" podStartSLOduration=2.042302562 podStartE2EDuration="7.974398294s" totalImagesPullingTime="5.932095732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:56.972211639 +0000 UTC m=+466.892521959" watchObservedRunningTime="2026-07-29 19:24:56.974398294 +0000 UTC m=+466.894708614"
Jul 29 19:24:57.931401 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:57.931371    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2" event={"ID":"695fb02b-5128-4f56-99ff-9642b6c54bb5","Type":"ContainerStarted","Data":"95a854d163b63b94b56bd7d6c2bd53e3a08abd0c119da5e3d243fb3136fc3f9c"}
Jul 29 19:24:57.968524 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:57.968486    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2" podStartSLOduration=0.700139317 podStartE2EDuration="1.968472347s" totalImagesPullingTime="1.26833303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:57.96662809 +0000 UTC m=+467.886938403" watchObservedRunningTime="2026-07-29 19:24:57.968472347 +0000 UTC m=+467.888782666"
Jul 29 19:24:58.865021 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:58.864993    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qvq6q"
Jul 29 19:24:58.936948 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:24:58.936925    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:07.933978 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:07.933944    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kqw92"
Jul 29 19:25:07.934466 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:07.934026    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:09.809488 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.809450    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"]
Jul 29 19:25:09.809922 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.809673    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" containerName="manager" containerID="cri-o://6acf5e1710abdaee6ad19fdb95b6b3d0b5ac493423253d47d4d82b81d7a6aec8" gracePeriod=2
Jul 29 19:25:09.834804 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.834780    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"]
Jul 29 19:25:09.844176 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.844153    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"]
Jul 29 19:25:09.844532 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.844519    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" containerName="manager"
Jul 29 19:25:09.844614 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.844533    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" containerName="manager"
Jul 29 19:25:09.844676 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.844630    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" containerName="manager"
Jul 29 19:25:09.847703 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.847684    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:09.851927 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:09.851898    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:09.862853 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.862832    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"]
Jul 29 19:25:09.863037 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.863008    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" containerName="manager" containerID="cri-o://95a854d163b63b94b56bd7d6c2bd53e3a08abd0c119da5e3d243fb3136fc3f9c" gracePeriod=2
Jul 29 19:25:09.865062 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.865024    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:09.868224 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.868205    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"]
Jul 29 19:25:09.880227 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.880200    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"]
Jul 29 19:25:09.902002 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:09.901973    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:09.904052 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:09.904032    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:09.909498 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.909478    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"]
Jul 29 19:25:09.909895 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.909878    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" containerName="manager"
Jul 29 19:25:09.909895 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.909892    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" containerName="manager"
Jul 29 19:25:09.910042 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.909962    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" containerName="manager"
Jul 29 19:25:09.912909 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.912878    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"
Jul 29 19:25:09.929077 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:09.929053    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:09.931956 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:09.931926    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:09.972558 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.972534    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"]
Jul 29 19:25:09.997909 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.997873    2584 generic.go:356] "Generic (PLEG): container finished" podID="ca82719c-77e7-4365-8428-56eebfe98e9c" containerID="6acf5e1710abdaee6ad19fdb95b6b3d0b5ac493423253d47d4d82b81d7a6aec8" exitCode=0
Jul 29 19:25:09.998103 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.998077    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/908c5c86-5778-4467-9e89-6c22fa258ada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n9pn7\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:09.998231 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.998212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7lf\" (UniqueName: \"kubernetes.io/projected/908c5c86-5778-4467-9e89-6c22fa258ada-kube-api-access-xx7lf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n9pn7\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:09.998314 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.998282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sknzm\" (UniqueName: \"kubernetes.io/projected/02c71601-6274-4e42-a661-1604e4ed5740-kube-api-access-sknzm\") pod \"limitador-operator-controller-manager-859d7b78bd-xttn9\" (UID: \"02c71601-6274-4e42-a661-1604e4ed5740\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"
Jul 29 19:25:10.000021 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:09.999988    2584 generic.go:356] "Generic (PLEG): container finished" podID="695fb02b-5128-4f56-99ff-9642b6c54bb5" containerID="95a854d163b63b94b56bd7d6c2bd53e3a08abd0c119da5e3d243fb3136fc3f9c" exitCode=0
Jul 29 19:25:10.099828 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.099797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/908c5c86-5778-4467-9e89-6c22fa258ada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n9pn7\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:10.099936 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.099911    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7lf\" (UniqueName: \"kubernetes.io/projected/908c5c86-5778-4467-9e89-6c22fa258ada-kube-api-access-xx7lf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n9pn7\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:10.099986 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.099944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sknzm\" (UniqueName: \"kubernetes.io/projected/02c71601-6274-4e42-a661-1604e4ed5740-kube-api-access-sknzm\") pod \"limitador-operator-controller-manager-859d7b78bd-xttn9\" (UID: \"02c71601-6274-4e42-a661-1604e4ed5740\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"
Jul 29 19:25:10.100283 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.100260    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/908c5c86-5778-4467-9e89-6c22fa258ada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n9pn7\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:10.114465 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.114442    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:10.116343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.116325    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sknzm\" (UniqueName: \"kubernetes.io/projected/02c71601-6274-4e42-a661-1604e4ed5740-kube-api-access-sknzm\") pod \"limitador-operator-controller-manager-859d7b78bd-xttn9\" (UID: \"02c71601-6274-4e42-a661-1604e4ed5740\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"
Jul 29 19:25:10.117386 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:10.117362    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:10.117463 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.117441    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:10.117549 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.117528    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7lf\" (UniqueName: \"kubernetes.io/projected/908c5c86-5778-4467-9e89-6c22fa258ada-kube-api-access-xx7lf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n9pn7\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:10.123356 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:10.123330    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:10.127527 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:10.127507    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:10.132137 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:10.132116    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:10.200551 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.200533    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca82719c-77e7-4365-8428-56eebfe98e9c-extensions-socket-volume\") pod \"ca82719c-77e7-4365-8428-56eebfe98e9c\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") "
Jul 29 19:25:10.200647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.200588    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4f5c\" (UniqueName: \"kubernetes.io/projected/695fb02b-5128-4f56-99ff-9642b6c54bb5-kube-api-access-t4f5c\") pod \"695fb02b-5128-4f56-99ff-9642b6c54bb5\" (UID: \"695fb02b-5128-4f56-99ff-9642b6c54bb5\") "
Jul 29 19:25:10.200647 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.200638    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfxwh\" (UniqueName: \"kubernetes.io/projected/ca82719c-77e7-4365-8428-56eebfe98e9c-kube-api-access-mfxwh\") pod \"ca82719c-77e7-4365-8428-56eebfe98e9c\" (UID: \"ca82719c-77e7-4365-8428-56eebfe98e9c\") "
Jul 29 19:25:10.201010 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.200990    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca82719c-77e7-4365-8428-56eebfe98e9c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca82719c-77e7-4365-8428-56eebfe98e9c" (UID: "ca82719c-77e7-4365-8428-56eebfe98e9c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:25:10.202392 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.202376    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695fb02b-5128-4f56-99ff-9642b6c54bb5-kube-api-access-t4f5c" (OuterVolumeSpecName: "kube-api-access-t4f5c") pod "695fb02b-5128-4f56-99ff-9642b6c54bb5" (UID: "695fb02b-5128-4f56-99ff-9642b6c54bb5"). InnerVolumeSpecName "kube-api-access-t4f5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:25:10.202458 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.202422    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca82719c-77e7-4365-8428-56eebfe98e9c-kube-api-access-mfxwh" (OuterVolumeSpecName: "kube-api-access-mfxwh") pod "ca82719c-77e7-4365-8428-56eebfe98e9c" (UID: "ca82719c-77e7-4365-8428-56eebfe98e9c"). InnerVolumeSpecName "kube-api-access-mfxwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:25:10.252743 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.252720    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:10.258532 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.258518    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"
Jul 29 19:25:10.302162 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.302130    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca82719c-77e7-4365-8428-56eebfe98e9c-extensions-socket-volume\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:25:10.302162 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.302162    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4f5c\" (UniqueName: \"kubernetes.io/projected/695fb02b-5128-4f56-99ff-9642b6c54bb5-kube-api-access-t4f5c\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:25:10.302339 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.302175    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfxwh\" (UniqueName: \"kubernetes.io/projected/ca82719c-77e7-4365-8428-56eebfe98e9c-kube-api-access-mfxwh\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:25:10.421336 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.421307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"]
Jul 29 19:25:10.423361 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:25:10.423335    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908c5c86_5778_4467_9e89_6c22fa258ada.slice/crio-dbc290c31546f6503b1895be8d99083973a9be3fbe8f7c3aed76519517a8a087 WatchSource:0}: Error finding container dbc290c31546f6503b1895be8d99083973a9be3fbe8f7c3aed76519517a8a087: Status 404 returned error can't find the container with id dbc290c31546f6503b1895be8d99083973a9be3fbe8f7c3aed76519517a8a087
Jul 29 19:25:10.445005 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.444986    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"]
Jul 29 19:25:10.448573 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:25:10.448548    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c71601_6274_4e42_a661_1604e4ed5740.slice/crio-0e5e9cd7855773aeac8cb046db17bc77a1ef02d47608f52dccfb5f7ba232e1ae WatchSource:0}: Error finding container 0e5e9cd7855773aeac8cb046db17bc77a1ef02d47608f52dccfb5f7ba232e1ae: Status 404 returned error can't find the container with id 0e5e9cd7855773aeac8cb046db17bc77a1ef02d47608f52dccfb5f7ba232e1ae
Jul 29 19:25:10.594580 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:10.594541    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9l8h2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:10.595540 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.595516    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="695fb02b-5128-4f56-99ff-9642b6c54bb5" path="/var/lib/kubelet/pods/695fb02b-5128-4f56-99ff-9642b6c54bb5/volumes"
Jul 29 19:25:10.595881 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:10.595866    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" path="/var/lib/kubelet/pods/ca82719c-77e7-4365-8428-56eebfe98e9c/volumes"
Jul 29 19:25:10.597714 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:10.597638    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rcqm2\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="ca82719c-77e7-4365-8428-56eebfe98e9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:11.007044 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.006955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9" event={"ID":"02c71601-6274-4e42-a661-1604e4ed5740","Type":"ContainerStarted","Data":"e9b70359c803379f7ed96ddffa3873009ac7c3cbc302e437abeeac9d66abcfaf"}
Jul 29 19:25:11.007422 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.007123    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"
Jul 29 19:25:11.007422 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.007161    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9" event={"ID":"02c71601-6274-4e42-a661-1604e4ed5740","Type":"ContainerStarted","Data":"0e5e9cd7855773aeac8cb046db17bc77a1ef02d47608f52dccfb5f7ba232e1ae"}
Jul 29 19:25:11.008408 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.008383    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rcqm2"
Jul 29 19:25:11.008408 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.008398    2584 scope.go:117] "RemoveContainer" containerID="6acf5e1710abdaee6ad19fdb95b6b3d0b5ac493423253d47d4d82b81d7a6aec8"
Jul 29 19:25:11.010415 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.010330    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7" event={"ID":"908c5c86-5778-4467-9e89-6c22fa258ada","Type":"ContainerStarted","Data":"56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04"}
Jul 29 19:25:11.010415 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.010393    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:11.010559 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.010423    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7" event={"ID":"908c5c86-5778-4467-9e89-6c22fa258ada","Type":"ContainerStarted","Data":"dbc290c31546f6503b1895be8d99083973a9be3fbe8f7c3aed76519517a8a087"}
Jul 29 19:25:11.011879 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.011860    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9l8h2"
Jul 29 19:25:11.019872 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.019849    2584 scope.go:117] "RemoveContainer" containerID="95a854d163b63b94b56bd7d6c2bd53e3a08abd0c119da5e3d243fb3136fc3f9c"
Jul 29 19:25:11.083544 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.083505    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9" podStartSLOduration=2.083491232 podStartE2EDuration="2.083491232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:11.046955731 +0000 UTC m=+480.967266050" watchObservedRunningTime="2026-07-29 19:25:11.083491232 +0000 UTC m=+481.003801552"
Jul 29 19:25:11.083916 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.083893    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7" podStartSLOduration=2.083887472 podStartE2EDuration="2.083887472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:11.082093419 +0000 UTC m=+481.002403742" watchObservedRunningTime="2026-07-29 19:25:11.083887472 +0000 UTC m=+481.004197791"
Jul 29 19:25:11.664316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.661642    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"]
Jul 29 19:25:11.668266 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.668238    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:11.689732 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.689702    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"]
Jul 29 19:25:11.812486 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.812458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2wbtt\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:11.812621 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.812511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q94z\" (UniqueName: \"kubernetes.io/projected/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-kube-api-access-8q94z\") pod \"kuadrant-operator-controller-manager-86878c769f-2wbtt\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:11.913100 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.913074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2wbtt\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:11.913238 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.913119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q94z\" (UniqueName: \"kubernetes.io/projected/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-kube-api-access-8q94z\") pod \"kuadrant-operator-controller-manager-86878c769f-2wbtt\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:11.913471 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.913446    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2wbtt\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:11.930715 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.930665    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q94z\" (UniqueName: \"kubernetes.io/projected/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-kube-api-access-8q94z\") pod \"kuadrant-operator-controller-manager-86878c769f-2wbtt\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:11.977911 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:11.977888    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:12.146385 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:12.146361    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"]
Jul 29 19:25:12.149100 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:25:12.149070    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9d0ab9_6989_4c26_bf36_150e19c0ccbf.slice/crio-f3d8441b17e607877cdafda2025cff27c51004305af7c0df215ea20687fd2ae2 WatchSource:0}: Error finding container f3d8441b17e607877cdafda2025cff27c51004305af7c0df215ea20687fd2ae2: Status 404 returned error can't find the container with id f3d8441b17e607877cdafda2025cff27c51004305af7c0df215ea20687fd2ae2
Jul 29 19:25:13.025625 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:13.025576    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt" event={"ID":"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf","Type":"ContainerStarted","Data":"d16c0e94354b6e8f4c803bcf2b35a1da36ac9ec477904f0b2312e6d78becc60d"}
Jul 29 19:25:13.025791 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:13.025638    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt" event={"ID":"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf","Type":"ContainerStarted","Data":"f3d8441b17e607877cdafda2025cff27c51004305af7c0df215ea20687fd2ae2"}
Jul 29 19:25:13.025791 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:13.025712    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:13.049857 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:13.049810    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt" podStartSLOduration=2.049797991 podStartE2EDuration="2.049797991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:13.047407494 +0000 UTC m=+482.967717814" watchObservedRunningTime="2026-07-29 19:25:13.049797991 +0000 UTC m=+482.970108310"
Jul 29 19:25:22.021696 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:22.021659    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xttn9"
Jul 29 19:25:22.022103 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:22.021741    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:24.033592 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.033561    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:25:24.089754 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.089724    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"]
Jul 29 19:25:24.089944 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.089923    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7" podUID="908c5c86-5778-4467-9e89-6c22fa258ada" containerName="manager" containerID="cri-o://56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04" gracePeriod=10
Jul 29 19:25:24.344966 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.344946    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:24.515425 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.515400    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/908c5c86-5778-4467-9e89-6c22fa258ada-extensions-socket-volume\") pod \"908c5c86-5778-4467-9e89-6c22fa258ada\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") "
Jul 29 19:25:24.515549 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.515447    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx7lf\" (UniqueName: \"kubernetes.io/projected/908c5c86-5778-4467-9e89-6c22fa258ada-kube-api-access-xx7lf\") pod \"908c5c86-5778-4467-9e89-6c22fa258ada\" (UID: \"908c5c86-5778-4467-9e89-6c22fa258ada\") "
Jul 29 19:25:24.515849 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.515826    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908c5c86-5778-4467-9e89-6c22fa258ada-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "908c5c86-5778-4467-9e89-6c22fa258ada" (UID: "908c5c86-5778-4467-9e89-6c22fa258ada"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:25:24.517315 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.517296    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908c5c86-5778-4467-9e89-6c22fa258ada-kube-api-access-xx7lf" (OuterVolumeSpecName: "kube-api-access-xx7lf") pod "908c5c86-5778-4467-9e89-6c22fa258ada" (UID: "908c5c86-5778-4467-9e89-6c22fa258ada"). InnerVolumeSpecName "kube-api-access-xx7lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:25:24.616350 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.616330    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/908c5c86-5778-4467-9e89-6c22fa258ada-extensions-socket-volume\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:25:24.616350 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:24.616350    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx7lf\" (UniqueName: \"kubernetes.io/projected/908c5c86-5778-4467-9e89-6c22fa258ada-kube-api-access-xx7lf\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:25:25.093778 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.093743    2584 generic.go:356] "Generic (PLEG): container finished" podID="908c5c86-5778-4467-9e89-6c22fa258ada" containerID="56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04" exitCode=0
Jul 29 19:25:25.094198 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.093785    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"
Jul 29 19:25:25.094198 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.093790    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7" event={"ID":"908c5c86-5778-4467-9e89-6c22fa258ada","Type":"ContainerDied","Data":"56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04"}
Jul 29 19:25:25.094198 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.093832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7" event={"ID":"908c5c86-5778-4467-9e89-6c22fa258ada","Type":"ContainerDied","Data":"dbc290c31546f6503b1895be8d99083973a9be3fbe8f7c3aed76519517a8a087"}
Jul 29 19:25:25.094198 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.093855    2584 scope.go:117] "RemoveContainer" containerID="56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04"
Jul 29 19:25:25.102804 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.102779    2584 scope.go:117] "RemoveContainer" containerID="56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04"
Jul 29 19:25:25.103042 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:25.103020    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04\": container with ID starting with 56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04 not found: ID does not exist" containerID="56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04"
Jul 29 19:25:25.103108 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.103054    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04"} err="failed to get container status \"56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04\": rpc error: code = NotFound desc = could not find container \"56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04\": container with ID starting with 56b238230fc60e3d968d0cbc4d710fad775e0024e0807b71519159a27ff67d04 not found: ID does not exist"
Jul 29 19:25:25.119491 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.119443    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"]
Jul 29 19:25:25.124108 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:25.124085    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n9pn7"]
Jul 29 19:25:26.592799 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:26.592768    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="908c5c86-5778-4467-9e89-6c22fa258ada" path="/var/lib/kubelet/pods/908c5c86-5778-4467-9e89-6c22fa258ada/volumes"
Jul 29 19:25:40.469030 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.468996    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"]
Jul 29 19:25:40.469481 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.469467    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908c5c86-5778-4467-9e89-6c22fa258ada" containerName="manager"
Jul 29 19:25:40.469481 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.469482    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="908c5c86-5778-4467-9e89-6c22fa258ada" containerName="manager"
Jul 29 19:25:40.469561 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.469551    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="908c5c86-5778-4467-9e89-6c22fa258ada" containerName="manager"
Jul 29 19:25:40.471818 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.471800    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.474821 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.474796    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 19:25:40.475575 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.475558    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-w95ck\""
Jul 29 19:25:40.486663 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.486636    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"]
Jul 29 19:25:40.644235 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644204    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644241    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644258    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644278    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644347    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eecf46a-deae-41ac-9a62-7aa07895ec40-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644371 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644367    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwl8x\" (UniqueName: \"kubernetes.io/projected/1eecf46a-deae-41ac-9a62-7aa07895ec40-kube-api-access-gwl8x\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644559 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644559 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644404    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.644559 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.644420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.745813 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.745739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.745813 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.745778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.745993 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.745889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.745993 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.745926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746111 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eecf46a-deae-41ac-9a62-7aa07895ec40-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746111 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwl8x\" (UniqueName: \"kubernetes.io/projected/1eecf46a-deae-41ac-9a62-7aa07895ec40-kube-api-access-gwl8x\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746111 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746111 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746100    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746322 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746139    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746623 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746575    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746811 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.746862 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.746790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eecf46a-deae-41ac-9a62-7aa07895ec40-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.748300 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.748268    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.748398 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.748323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.754485 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.754464    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eecf46a-deae-41ac-9a62-7aa07895ec40-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.754574 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.754512    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwl8x\" (UniqueName: \"kubernetes.io/projected/1eecf46a-deae-41ac-9a62-7aa07895ec40-kube-api-access-gwl8x\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wq7xh\" (UID: \"1eecf46a-deae-41ac-9a62-7aa07895ec40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.782741 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.782722    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:40.921095 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:40.921069    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"]
Jul 29 19:25:40.923339 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:25:40.923309    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eecf46a_deae_41ac_9a62_7aa07895ec40.slice/crio-212694a447c6e33c9a905b1c5bd30a28cc4d16660f0b1ca73d6e968e59f15dae WatchSource:0}: Error finding container 212694a447c6e33c9a905b1c5bd30a28cc4d16660f0b1ca73d6e968e59f15dae: Status 404 returned error can't find the container with id 212694a447c6e33c9a905b1c5bd30a28cc4d16660f0b1ca73d6e968e59f15dae
Jul 29 19:25:41.184767 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:41.184735    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" event={"ID":"1eecf46a-deae-41ac-9a62-7aa07895ec40","Type":"ContainerStarted","Data":"212694a447c6e33c9a905b1c5bd30a28cc4d16660f0b1ca73d6e968e59f15dae"}
Jul 29 19:25:43.413197 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:43.413167    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:25:43.413450 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:43.413234    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:25:43.413450 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:43.413261    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:25:44.204570 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:44.204528    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" event={"ID":"1eecf46a-deae-41ac-9a62-7aa07895ec40","Type":"ContainerStarted","Data":"9facd6d6d3a9e072c92efe08b74a2d81d0593b3d3775c1b3b7d8a2d4c03230cf"}
Jul 29 19:25:44.227269 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:44.227211    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" podStartSLOduration=1.7439709780000001 podStartE2EDuration="4.22719585s" totalImagesPullingTime="2.483224872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:44.22523651 +0000 UTC m=+514.145546831" watchObservedRunningTime="2026-07-29 19:25:44.22719585 +0000 UTC m=+514.147506169"
Jul 29 19:25:44.783245 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:44.783212    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:44.788136 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:44.788113    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:45.210164 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.210117    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:45.211044 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.211026    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:25:45.587208 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.587176    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:25:45.590030 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.590006    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:45.592591 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.592567    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 19:25:45.592704 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.592667    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w9774\""
Jul 29 19:25:45.599152 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.599129    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:25:45.614847 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.614820    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:25:45.686941 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.686908    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5c2k\" (UniqueName: \"kubernetes.io/projected/2fbc3e32-7933-45b4-bbb8-55a818b8e74e-kube-api-access-c5c2k\") pod \"limitador-limitador-54d6d988d5-tm6g6\" (UID: \"2fbc3e32-7933-45b4-bbb8-55a818b8e74e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:45.687049 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.687021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fbc3e32-7933-45b4-bbb8-55a818b8e74e-config-file\") pod \"limitador-limitador-54d6d988d5-tm6g6\" (UID: \"2fbc3e32-7933-45b4-bbb8-55a818b8e74e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:45.788283 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.788253    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fbc3e32-7933-45b4-bbb8-55a818b8e74e-config-file\") pod \"limitador-limitador-54d6d988d5-tm6g6\" (UID: \"2fbc3e32-7933-45b4-bbb8-55a818b8e74e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:45.788679 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.788328    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5c2k\" (UniqueName: \"kubernetes.io/projected/2fbc3e32-7933-45b4-bbb8-55a818b8e74e-kube-api-access-c5c2k\") pod \"limitador-limitador-54d6d988d5-tm6g6\" (UID: \"2fbc3e32-7933-45b4-bbb8-55a818b8e74e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:45.788887 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.788869    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fbc3e32-7933-45b4-bbb8-55a818b8e74e-config-file\") pod \"limitador-limitador-54d6d988d5-tm6g6\" (UID: \"2fbc3e32-7933-45b4-bbb8-55a818b8e74e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:45.796961 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.796940    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5c2k\" (UniqueName: \"kubernetes.io/projected/2fbc3e32-7933-45b4-bbb8-55a818b8e74e-kube-api-access-c5c2k\") pod \"limitador-limitador-54d6d988d5-tm6g6\" (UID: \"2fbc3e32-7933-45b4-bbb8-55a818b8e74e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:45.901228 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:45.901177    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:46.034468 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.034424    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:25:46.036461 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.036435    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wms9t"]
Jul 29 19:25:46.036566 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:25:46.036538    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbc3e32_7933_45b4_bbb8_55a818b8e74e.slice/crio-4bf3c82a5cac05f49a79a7841664cef1cebe6d66f6d3e605352c528e3c60f222 WatchSource:0}: Error finding container 4bf3c82a5cac05f49a79a7841664cef1cebe6d66f6d3e605352c528e3c60f222: Status 404 returned error can't find the container with id 4bf3c82a5cac05f49a79a7841664cef1cebe6d66f6d3e605352c528e3c60f222
Jul 29 19:25:46.040445 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.040426    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wms9t"
Jul 29 19:25:46.042990 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.042963    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fl666\""
Jul 29 19:25:46.044768 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.044748    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wms9t"]
Jul 29 19:25:46.091298 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.091268    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8f8\" (UniqueName: \"kubernetes.io/projected/571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed-kube-api-access-hp8f8\") pod \"authorino-58cd955675-wms9t\" (UID: \"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed\") " pod="kuadrant-system/authorino-58cd955675-wms9t"
Jul 29 19:25:46.192193 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.192132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8f8\" (UniqueName: \"kubernetes.io/projected/571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed-kube-api-access-hp8f8\") pod \"authorino-58cd955675-wms9t\" (UID: \"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed\") " pod="kuadrant-system/authorino-58cd955675-wms9t"
Jul 29 19:25:46.202055 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.202032    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8f8\" (UniqueName: \"kubernetes.io/projected/571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed-kube-api-access-hp8f8\") pod \"authorino-58cd955675-wms9t\" (UID: \"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed\") " pod="kuadrant-system/authorino-58cd955675-wms9t"
Jul 29 19:25:46.215806 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.215777    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6" event={"ID":"2fbc3e32-7933-45b4-bbb8-55a818b8e74e","Type":"ContainerStarted","Data":"4bf3c82a5cac05f49a79a7841664cef1cebe6d66f6d3e605352c528e3c60f222"}
Jul 29 19:25:46.356566 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.356542    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wms9t"
Jul 29 19:25:46.498801 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:46.498774    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wms9t"]
Jul 29 19:25:46.501272 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:25:46.501215    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod571a31b2_a2ce_4f8a_a8f4_427c1e32c9ed.slice/crio-5d8b5a9867f513e377498ed4f418f8d76b4e23ef61e84c86bc5b767881c6f59f WatchSource:0}: Error finding container 5d8b5a9867f513e377498ed4f418f8d76b4e23ef61e84c86bc5b767881c6f59f: Status 404 returned error can't find the container with id 5d8b5a9867f513e377498ed4f418f8d76b4e23ef61e84c86bc5b767881c6f59f
Jul 29 19:25:47.226533 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:47.226472    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wms9t" event={"ID":"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed","Type":"ContainerStarted","Data":"5d8b5a9867f513e377498ed4f418f8d76b4e23ef61e84c86bc5b767881c6f59f"}
Jul 29 19:25:51.249990 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:51.249946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wms9t" event={"ID":"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed","Type":"ContainerStarted","Data":"659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba"}
Jul 29 19:25:51.251843 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:51.251811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6" event={"ID":"2fbc3e32-7933-45b4-bbb8-55a818b8e74e","Type":"ContainerStarted","Data":"5e1d6b47e9a1f0d44de7f3306ab4703d36d81d7214676a4b86d7ab3ee6eac8a7"}
Jul 29 19:25:51.252005 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:51.251920    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:25:51.266745 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:51.266695    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wms9t" podStartSLOduration=1.489687275 podStartE2EDuration="5.266681547s" totalImagesPullingTime="3.776994272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:51.265944926 +0000 UTC m=+521.186255247" watchObservedRunningTime="2026-07-29 19:25:51.266681547 +0000 UTC m=+521.186991868"
Jul 29 19:25:51.289477 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:51.289421    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6" podStartSLOduration=2.054707178 podStartE2EDuration="6.289403359s" totalImagesPullingTime="4.234696181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:51.288143234 +0000 UTC m=+521.208453556" watchObservedRunningTime="2026-07-29 19:25:51.289403359 +0000 UTC m=+521.209713680"
Jul 29 19:25:52.035471 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:52.035437    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wms9t"]
Jul 29 19:25:53.047235 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:53.047201    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f95db7766-v29kr"]
Jul 29 19:25:53.262786 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:53.262729    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wms9t" podUID="571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed" containerName="authorino" containerID="cri-o://659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba" gracePeriod=30
Jul 29 19:25:53.522378 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:53.522352    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wms9t"
Jul 29 19:25:53.561984 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:53.561959    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp8f8\" (UniqueName: \"kubernetes.io/projected/571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed-kube-api-access-hp8f8\") pod \"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed\" (UID: \"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed\") "
Jul 29 19:25:53.563856 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:53.563830    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed-kube-api-access-hp8f8" (OuterVolumeSpecName: "kube-api-access-hp8f8") pod "571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed" (UID: "571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed"). InnerVolumeSpecName "kube-api-access-hp8f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:25:53.663590 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:53.663535    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp8f8\" (UniqueName: \"kubernetes.io/projected/571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed-kube-api-access-hp8f8\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:25:54.269815 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.269776    2584 generic.go:356] "Generic (PLEG): container finished" podID="571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed" containerID="659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba" exitCode=0
Jul 29 19:25:54.270280 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.269836    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wms9t"
Jul 29 19:25:54.270280 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.269843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wms9t" event={"ID":"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed","Type":"ContainerDied","Data":"659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba"}
Jul 29 19:25:54.270280 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.269940    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wms9t" event={"ID":"571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed","Type":"ContainerDied","Data":"5d8b5a9867f513e377498ed4f418f8d76b4e23ef61e84c86bc5b767881c6f59f"}
Jul 29 19:25:54.270280 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.269958    2584 scope.go:117] "RemoveContainer" containerID="659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba"
Jul 29 19:25:54.280133 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.280119    2584 scope.go:117] "RemoveContainer" containerID="659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba"
Jul 29 19:25:54.280375 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:25:54.280356    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba\": container with ID starting with 659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba not found: ID does not exist" containerID="659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba"
Jul 29 19:25:54.280432 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.280382    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba"} err="failed to get container status \"659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba\": rpc error: code = NotFound desc = could not find container \"659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba\": container with ID starting with 659ea30a2fa233466a4aedc331c6ec627627326398f9464e138d82eae9d917ba not found: ID does not exist"
Jul 29 19:25:54.292756 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.292732    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wms9t"]
Jul 29 19:25:54.297018 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.296992    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wms9t"]
Jul 29 19:25:54.596595 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:25:54.596566    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed" path="/var/lib/kubelet/pods/571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed/volumes"
Jul 29 19:26:02.258184 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:02.258150    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"
Jul 29 19:26:18.072356 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.072288    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f95db7766-v29kr" podUID="3299ddde-d332-498d-b72b-bda67835772c" containerName="console" containerID="cri-o://b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5" gracePeriod=15
Jul 29 19:26:18.328051 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.328001    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:26:18.403702 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.403670    2584 generic.go:356] "Generic (PLEG): container finished" podID="3299ddde-d332-498d-b72b-bda67835772c" containerID="b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5" exitCode=0
Jul 29 19:26:18.403827 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.403713    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95db7766-v29kr"
Jul 29 19:26:18.403827 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.403748    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95db7766-v29kr" event={"ID":"3299ddde-d332-498d-b72b-bda67835772c","Type":"ContainerDied","Data":"b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5"}
Jul 29 19:26:18.403827 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.403792    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95db7766-v29kr" event={"ID":"3299ddde-d332-498d-b72b-bda67835772c","Type":"ContainerDied","Data":"407b5a77d7db4dc62a4179d6199f9d6426bcd2f3335ee085fa17f2fc4cbb8c73"}
Jul 29 19:26:18.403827 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.403816    2584 scope.go:117] "RemoveContainer" containerID="b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5"
Jul 29 19:26:18.412102 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.412087    2584 scope.go:117] "RemoveContainer" containerID="b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5"
Jul 29 19:26:18.412354 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:26:18.412337    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5\": container with ID starting with b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5 not found: ID does not exist" containerID="b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5"
Jul 29 19:26:18.412412 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.412362    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5"} err="failed to get container status \"b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5\": rpc error: code = NotFound desc = could not find container \"b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5\": container with ID starting with b4b1121a32c8ef7bebed3961950461bbc5dbf12f3e177d7b181bc8e73832e3c5 not found: ID does not exist"
Jul 29 19:26:18.461816 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.461796    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-trusted-ca-bundle\") pod \"3299ddde-d332-498d-b72b-bda67835772c\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") "
Jul 29 19:26:18.461895 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.461833    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwk8d\" (UniqueName: \"kubernetes.io/projected/3299ddde-d332-498d-b72b-bda67835772c-kube-api-access-qwk8d\") pod \"3299ddde-d332-498d-b72b-bda67835772c\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") "
Jul 29 19:26:18.461895 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.461863    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-oauth-config\") pod \"3299ddde-d332-498d-b72b-bda67835772c\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") "
Jul 29 19:26:18.461963 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.461903    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-oauth-serving-cert\") pod \"3299ddde-d332-498d-b72b-bda67835772c\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") "
Jul 29 19:26:18.461963 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.461950    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-service-ca\") pod \"3299ddde-d332-498d-b72b-bda67835772c\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") "
Jul 29 19:26:18.462034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.461973    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-serving-cert\") pod \"3299ddde-d332-498d-b72b-bda67835772c\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") "
Jul 29 19:26:18.462079 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.462038    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-console-config\") pod \"3299ddde-d332-498d-b72b-bda67835772c\" (UID: \"3299ddde-d332-498d-b72b-bda67835772c\") "
Jul 29 19:26:18.462683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.462254    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3299ddde-d332-498d-b72b-bda67835772c" (UID: "3299ddde-d332-498d-b72b-bda67835772c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:26:18.462683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.462377    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-service-ca" (OuterVolumeSpecName: "service-ca") pod "3299ddde-d332-498d-b72b-bda67835772c" (UID: "3299ddde-d332-498d-b72b-bda67835772c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:26:18.462683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.462383    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3299ddde-d332-498d-b72b-bda67835772c" (UID: "3299ddde-d332-498d-b72b-bda67835772c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:26:18.462683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.462404    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-trusted-ca-bundle\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:18.462683 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.462594    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-console-config" (OuterVolumeSpecName: "console-config") pod "3299ddde-d332-498d-b72b-bda67835772c" (UID: "3299ddde-d332-498d-b72b-bda67835772c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:26:18.463979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.463954    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3299ddde-d332-498d-b72b-bda67835772c-kube-api-access-qwk8d" (OuterVolumeSpecName: "kube-api-access-qwk8d") pod "3299ddde-d332-498d-b72b-bda67835772c" (UID: "3299ddde-d332-498d-b72b-bda67835772c"). InnerVolumeSpecName "kube-api-access-qwk8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:26:18.464142 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.464123    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3299ddde-d332-498d-b72b-bda67835772c" (UID: "3299ddde-d332-498d-b72b-bda67835772c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:26:18.464201 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.464150    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3299ddde-d332-498d-b72b-bda67835772c" (UID: "3299ddde-d332-498d-b72b-bda67835772c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:26:18.562816 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.562792    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwk8d\" (UniqueName: \"kubernetes.io/projected/3299ddde-d332-498d-b72b-bda67835772c-kube-api-access-qwk8d\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:18.562816 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.562811    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-oauth-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:18.562933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.562823    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-oauth-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:18.562933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.562833    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:18.562933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.562842    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3299ddde-d332-498d-b72b-bda67835772c-console-serving-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:18.562933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.562850    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3299ddde-d332-498d-b72b-bda67835772c-console-config\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:18.721465 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.721434    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f95db7766-v29kr"]
Jul 29 19:26:18.723151 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:18.723132    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f95db7766-v29kr"]
Jul 29 19:26:19.672316 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.672287    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sk6t"]
Jul 29 19:26:19.672867 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.672721    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed" containerName="authorino"
Jul 29 19:26:19.672867 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.672733    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed" containerName="authorino"
Jul 29 19:26:19.672867 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.672744    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3299ddde-d332-498d-b72b-bda67835772c" containerName="console"
Jul 29 19:26:19.672867 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.672749    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3299ddde-d332-498d-b72b-bda67835772c" containerName="console"
Jul 29 19:26:19.672867 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.672817    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3299ddde-d332-498d-b72b-bda67835772c" containerName="console"
Jul 29 19:26:19.672867 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.672826    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="571a31b2-a2ce-4f8a-a8f4-427c1e32c9ed" containerName="authorino"
Jul 29 19:26:19.681794 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.681769    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sk6t"]
Jul 29 19:26:19.681960 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.681880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sk6t"
Jul 29 19:26:19.684690 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.684667    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fl666\""
Jul 29 19:26:19.773096 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.773073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsbd8\" (UniqueName: \"kubernetes.io/projected/e64e517d-8609-43d2-9a67-d7ebd0a39766-kube-api-access-vsbd8\") pod \"authorino-5d4b67c446-9sk6t\" (UID: \"e64e517d-8609-43d2-9a67-d7ebd0a39766\") " pod="kuadrant-system/authorino-5d4b67c446-9sk6t"
Jul 29 19:26:19.873623 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.873579    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsbd8\" (UniqueName: \"kubernetes.io/projected/e64e517d-8609-43d2-9a67-d7ebd0a39766-kube-api-access-vsbd8\") pod \"authorino-5d4b67c446-9sk6t\" (UID: \"e64e517d-8609-43d2-9a67-d7ebd0a39766\") " pod="kuadrant-system/authorino-5d4b67c446-9sk6t"
Jul 29 19:26:19.882579 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.882551    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsbd8\" (UniqueName: \"kubernetes.io/projected/e64e517d-8609-43d2-9a67-d7ebd0a39766-kube-api-access-vsbd8\") pod \"authorino-5d4b67c446-9sk6t\" (UID: \"e64e517d-8609-43d2-9a67-d7ebd0a39766\") " pod="kuadrant-system/authorino-5d4b67c446-9sk6t"
Jul 29 19:26:19.922182 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.922161    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sk6t"]
Jul 29 19:26:19.922386 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:19.922354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sk6t"
Jul 29 19:26:20.078350 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:20.078327    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sk6t"]
Jul 29 19:26:20.080872 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:26:20.080846    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode64e517d_8609_43d2_9a67_d7ebd0a39766.slice/crio-be866fa6bb655fc09f951a458fe4809244e4df183f75af8ac13c942b0427799c WatchSource:0}: Error finding container be866fa6bb655fc09f951a458fe4809244e4df183f75af8ac13c942b0427799c: Status 404 returned error can't find the container with id be866fa6bb655fc09f951a458fe4809244e4df183f75af8ac13c942b0427799c
Jul 29 19:26:20.416054 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:20.416020    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9sk6t" event={"ID":"e64e517d-8609-43d2-9a67-d7ebd0a39766","Type":"ContainerStarted","Data":"be866fa6bb655fc09f951a458fe4809244e4df183f75af8ac13c942b0427799c"}
Jul 29 19:26:20.592913 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:20.592883    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3299ddde-d332-498d-b72b-bda67835772c" path="/var/lib/kubelet/pods/3299ddde-d332-498d-b72b-bda67835772c/volumes"
Jul 29 19:26:21.422567 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:21.422531    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9sk6t" event={"ID":"e64e517d-8609-43d2-9a67-d7ebd0a39766","Type":"ContainerStarted","Data":"afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d"}
Jul 29 19:26:21.422567 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:21.422547    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-9sk6t" podUID="e64e517d-8609-43d2-9a67-d7ebd0a39766" containerName="authorino" containerID="cri-o://afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d" gracePeriod=30
Jul 29 19:26:21.440038 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:21.439993    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-9sk6t" podStartSLOduration=1.9406081130000001 podStartE2EDuration="2.439980303s" totalImagesPullingTime="499.37219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:26:21.438172017 +0000 UTC m=+551.358482337" watchObservedRunningTime="2026-07-29 19:26:21.439980303 +0000 UTC m=+551.360290623"
Jul 29 19:26:21.713003 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:21.712978    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sk6t"
Jul 29 19:26:21.790063 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:21.790034    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsbd8\" (UniqueName: \"kubernetes.io/projected/e64e517d-8609-43d2-9a67-d7ebd0a39766-kube-api-access-vsbd8\") pod \"e64e517d-8609-43d2-9a67-d7ebd0a39766\" (UID: \"e64e517d-8609-43d2-9a67-d7ebd0a39766\") "
Jul 29 19:26:21.791944 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:21.791899    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64e517d-8609-43d2-9a67-d7ebd0a39766-kube-api-access-vsbd8" (OuterVolumeSpecName: "kube-api-access-vsbd8") pod "e64e517d-8609-43d2-9a67-d7ebd0a39766" (UID: "e64e517d-8609-43d2-9a67-d7ebd0a39766"). InnerVolumeSpecName "kube-api-access-vsbd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:26:21.891563 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:21.891539    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsbd8\" (UniqueName: \"kubernetes.io/projected/e64e517d-8609-43d2-9a67-d7ebd0a39766-kube-api-access-vsbd8\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:26:22.428439 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.428407    2584 generic.go:356] "Generic (PLEG): container finished" podID="e64e517d-8609-43d2-9a67-d7ebd0a39766" containerID="afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d" exitCode=0
Jul 29 19:26:22.428908 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.428444    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sk6t"
Jul 29 19:26:22.428908 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.428466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9sk6t" event={"ID":"e64e517d-8609-43d2-9a67-d7ebd0a39766","Type":"ContainerDied","Data":"afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d"}
Jul 29 19:26:22.428908 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.428497    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9sk6t" event={"ID":"e64e517d-8609-43d2-9a67-d7ebd0a39766","Type":"ContainerDied","Data":"be866fa6bb655fc09f951a458fe4809244e4df183f75af8ac13c942b0427799c"}
Jul 29 19:26:22.428908 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.428514    2584 scope.go:117] "RemoveContainer" containerID="afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d"
Jul 29 19:26:22.441461 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.440565    2584 scope.go:117] "RemoveContainer" containerID="afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d"
Jul 29 19:26:22.441569 ip-10-0-140-204 kubenswrapper[2584]: E0729 19:26:22.441536    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d\": container with ID starting with afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d not found: ID does not exist" containerID="afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d"
Jul 29 19:26:22.441658 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.441582    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d"} err="failed to get container status \"afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d\": rpc error: code = NotFound desc = could not find container \"afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d\": container with ID starting with afa92bef05c46d0533def921832ccf9e556f8d11014e84c35c5b219da18d192d not found: ID does not exist"
Jul 29 19:26:22.455030 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.455004    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sk6t"]
Jul 29 19:26:22.458392 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.458372    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sk6t"]
Jul 29 19:26:22.593410 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:26:22.593390    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e64e517d-8609-43d2-9a67-d7ebd0a39766" path="/var/lib/kubelet/pods/e64e517d-8609-43d2-9a67-d7ebd0a39766/volumes"
Jul 29 19:27:02.548431 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:02.548393    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:27:10.478268 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.478236    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:27:10.483453 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.483423    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:27:10.677060 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.677024    2584 generic.go:356] "Generic (PLEG): container finished" podID="1eecf46a-deae-41ac-9a62-7aa07895ec40" containerID="9facd6d6d3a9e072c92efe08b74a2d81d0593b3d3775c1b3b7d8a2d4c03230cf" exitCode=0
Jul 29 19:27:10.677169 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.677085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" event={"ID":"1eecf46a-deae-41ac-9a62-7aa07895ec40","Type":"ContainerDied","Data":"9facd6d6d3a9e072c92efe08b74a2d81d0593b3d3775c1b3b7d8a2d4c03230cf"}
Jul 29 19:27:10.677428 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.677414    2584 scope.go:117] "RemoveContainer" containerID="9facd6d6d3a9e072c92efe08b74a2d81d0593b3d3775c1b3b7d8a2d4c03230cf"
Jul 29 19:27:10.678272 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.678248    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:27:10.678333 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.678321    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:27:10.678369 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:10.678355    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:27:11.684012 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:11.683970    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" event={"ID":"1eecf46a-deae-41ac-9a62-7aa07895ec40","Type":"ContainerStarted","Data":"5712b2cb88fe40b2864a02aa3038ce4a1b5bc3c3e38cc8fd6643f69d5f82d5fb"}
Jul 29 19:27:11.783750 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:11.783721    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:27:11.784418 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:11.784398    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 29 19:27:11.784466 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:11.784450    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" podUID="1eecf46a-deae-41ac-9a62-7aa07895ec40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 29 19:27:12.783231 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:12.783185    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 29 19:27:12.783781 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:12.783253    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" podUID="1eecf46a-deae-41ac-9a62-7aa07895ec40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 29 19:27:13.783097 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:13.783048    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 29 19:27:13.783306 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:13.783119    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" podUID="1eecf46a-deae-41ac-9a62-7aa07895ec40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 29 19:27:14.783132 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:14.783097    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 29 19:27:14.783407 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:14.783378    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" podUID="1eecf46a-deae-41ac-9a62-7aa07895ec40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 29 19:27:15.210230 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:15.210202    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:27:15.783388 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:15.783346    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wq7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 29 19:27:15.783584 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:15.783428    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh" podUID="1eecf46a-deae-41ac-9a62-7aa07895ec40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 29 19:27:16.787703 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:16.787675    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:27:16.788646 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:16.788628    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wq7xh"
Jul 29 19:27:19.561359 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:19.561326    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:27:28.632078 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.632045    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"]
Jul 29 19:27:28.632511 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.632455    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64e517d-8609-43d2-9a67-d7ebd0a39766" containerName="authorino"
Jul 29 19:27:28.632511 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.632467    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64e517d-8609-43d2-9a67-d7ebd0a39766" containerName="authorino"
Jul 29 19:27:28.632589 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.632540    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64e517d-8609-43d2-9a67-d7ebd0a39766" containerName="authorino"
Jul 29 19:27:28.634729 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.634707    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.638794 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.638770    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 19:27:28.638794 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.638797    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 19:27:28.639588 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.639566    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qm9st\""
Jul 29 19:27:28.639699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.639573    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 19:27:28.648558 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.648532    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"]
Jul 29 19:27:28.745882 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.745858    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.746000 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.745915    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5wk\" (UniqueName: \"kubernetes.io/projected/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-kube-api-access-hm5wk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.746000 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.745945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.746000 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.745975    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.746111 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.746044    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.746111 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.746061    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.846808 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.846778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5wk\" (UniqueName: \"kubernetes.io/projected/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-kube-api-access-hm5wk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.846971 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.846814    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.846971 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.846849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.846971 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.846929    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.846971 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.846955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.847201 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.846993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.847266 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.847236    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.847387 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.847366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.847452 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.847387    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.849126 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.849105    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.849321 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.849300    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.855725 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.855689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5wk\" (UniqueName: \"kubernetes.io/projected/69a4df5f-ed8b-4e61-a916-781dcb7e7df7-kube-api-access-hm5wk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5lwrj\" (UID: \"69a4df5f-ed8b-4e61-a916-781dcb7e7df7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:28.946539 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:28.946488    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:29.075319 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:29.075296    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"]
Jul 29 19:27:29.077169 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:27:29.077142    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a4df5f_ed8b_4e61_a916_781dcb7e7df7.slice/crio-f2376aa285d0fb3cf0cddf15a9985678de81421d51f9cf01dd2f2723edb9bd69 WatchSource:0}: Error finding container f2376aa285d0fb3cf0cddf15a9985678de81421d51f9cf01dd2f2723edb9bd69: Status 404 returned error can't find the container with id f2376aa285d0fb3cf0cddf15a9985678de81421d51f9cf01dd2f2723edb9bd69
Jul 29 19:27:29.078487 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:29.078470    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:27:29.557680 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:29.557649    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:27:29.789928 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:29.789889    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj" event={"ID":"69a4df5f-ed8b-4e61-a916-781dcb7e7df7","Type":"ContainerStarted","Data":"f2376aa285d0fb3cf0cddf15a9985678de81421d51f9cf01dd2f2723edb9bd69"}
Jul 29 19:27:30.797051 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:30.797010    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj" event={"ID":"69a4df5f-ed8b-4e61-a916-781dcb7e7df7","Type":"ContainerStarted","Data":"6a3f8be83840d8184e680dfc8e13d1dcd4a142756eda56a7e1790a3ca1450dec"}
Jul 29 19:27:30.816899 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:30.816854    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj" podStartSLOduration=1.831244493 podStartE2EDuration="2.816837294s" totalImagesPullingTime="985.592801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:27:30.814254986 +0000 UTC m=+620.734565305" watchObservedRunningTime="2026-07-29 19:27:30.816837294 +0000 UTC m=+620.737147614"
Jul 29 19:27:38.947704 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:38.947628    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:38.947704 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:38.947701    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:38.959951 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:38.959924    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:39.853370 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:39.853341    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5lwrj"
Jul 29 19:27:46.481446 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:46.481404    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:27:56.346882 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:56.346847    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:27:57.843370 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.843339    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"]
Jul 29 19:27:57.848062 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.848040    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:57.851381 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.851358    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 19:27:57.867628 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.867582    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"]
Jul 29 19:27:57.982251 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.982218    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwpgl\" (UniqueName: \"kubernetes.io/projected/080c8754-d107-448b-812b-700de4b4defa-kube-api-access-wwpgl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:57.982436 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.982270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080c8754-d107-448b-812b-700de4b4defa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:57.982436 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.982356    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:57.982436 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.982394    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:57.982436 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.982432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:57.982628 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:57.982547    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.083383 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.083346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080c8754-d107-448b-812b-700de4b4defa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.083420    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.083446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.083486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.083555    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.083631    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwpgl\" (UniqueName: \"kubernetes.io/projected/080c8754-d107-448b-812b-700de4b4defa-kube-api-access-wwpgl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.083988    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084089 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.084037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.084585 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.084141    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.085815 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.085790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080c8754-d107-448b-812b-700de4b4defa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.086022 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.086004    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080c8754-d107-448b-812b-700de4b4defa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.093057 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.093025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwpgl\" (UniqueName: \"kubernetes.io/projected/080c8754-d107-448b-812b-700de4b4defa-kube-api-access-wwpgl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nm9gs\" (UID: \"080c8754-d107-448b-812b-700de4b4defa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.158631 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.158547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:27:58.305937 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.305909    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"]
Jul 29 19:27:58.307785 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:27:58.307754    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080c8754_d107_448b_812b_700de4b4defa.slice/crio-82cbf1a4fa64053a43a8c33ce8a699f9c0c84366b2db15ec327767052db3ec6f WatchSource:0}: Error finding container 82cbf1a4fa64053a43a8c33ce8a699f9c0c84366b2db15ec327767052db3ec6f: Status 404 returned error can't find the container with id 82cbf1a4fa64053a43a8c33ce8a699f9c0c84366b2db15ec327767052db3ec6f
Jul 29 19:27:58.941286 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.941200    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs" event={"ID":"080c8754-d107-448b-812b-700de4b4defa","Type":"ContainerStarted","Data":"2e5b80cf2325be6b4f9bd60e3ec5b679cfaec5f1da0fe35326d51c5100167d83"}
Jul 29 19:27:58.941286 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.941250    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs" event={"ID":"080c8754-d107-448b-812b-700de4b4defa","Type":"ContainerStarted","Data":"82cbf1a4fa64053a43a8c33ce8a699f9c0c84366b2db15ec327767052db3ec6f"}
Jul 29 19:27:58.960882 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:27:58.960838    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs" podStartSLOduration=1.685780647 podStartE2EDuration="1.960820652s" totalImagesPullingTime="275.040005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:27:58.959408952 +0000 UTC m=+648.879719273" watchObservedRunningTime="2026-07-29 19:27:58.960820652 +0000 UTC m=+648.881130973"
Jul 29 19:28:06.551321 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:28:06.551285    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:28:08.158765 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:28:08.158732    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:28:08.159136 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:28:08.158833    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:28:08.171304 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:28:08.171282    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:28:09.004766 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:28:09.004736    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nm9gs"
Jul 29 19:28:13.747408 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:28:13.747373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:29:14.483004 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.482924    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bb554dd78-6n7j8"]
Jul 29 19:29:14.486751 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.486728    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.490075 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.490043    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 19:29:14.490201 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.490080    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fl666\""
Jul 29 19:29:14.496211 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.496188    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bb554dd78-6n7j8"]
Jul 29 19:29:14.620760 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.620737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5q9\" (UniqueName: \"kubernetes.io/projected/be42da00-78be-41e9-badd-27afae6d777c-kube-api-access-rw5q9\") pod \"authorino-bb554dd78-6n7j8\" (UID: \"be42da00-78be-41e9-badd-27afae6d777c\") " pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.620889 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.620788    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be42da00-78be-41e9-badd-27afae6d777c-tls-cert\") pod \"authorino-bb554dd78-6n7j8\" (UID: \"be42da00-78be-41e9-badd-27afae6d777c\") " pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.721709 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.721684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5q9\" (UniqueName: \"kubernetes.io/projected/be42da00-78be-41e9-badd-27afae6d777c-kube-api-access-rw5q9\") pod \"authorino-bb554dd78-6n7j8\" (UID: \"be42da00-78be-41e9-badd-27afae6d777c\") " pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.721820 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.721722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be42da00-78be-41e9-badd-27afae6d777c-tls-cert\") pod \"authorino-bb554dd78-6n7j8\" (UID: \"be42da00-78be-41e9-badd-27afae6d777c\") " pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.724105 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.724082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be42da00-78be-41e9-badd-27afae6d777c-tls-cert\") pod \"authorino-bb554dd78-6n7j8\" (UID: \"be42da00-78be-41e9-badd-27afae6d777c\") " pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.730634 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.730594    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5q9\" (UniqueName: \"kubernetes.io/projected/be42da00-78be-41e9-badd-27afae6d777c-kube-api-access-rw5q9\") pod \"authorino-bb554dd78-6n7j8\" (UID: \"be42da00-78be-41e9-badd-27afae6d777c\") " pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.796740 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.796637    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb554dd78-6n7j8"
Jul 29 19:29:14.930793 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:14.930638    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bb554dd78-6n7j8"]
Jul 29 19:29:14.933675 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:29:14.933644    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe42da00_78be_41e9_badd_27afae6d777c.slice/crio-a4aa32fb2b6565646b024295cbacde0fe22d033f56dcaaed8847d853f03c5f1d WatchSource:0}: Error finding container a4aa32fb2b6565646b024295cbacde0fe22d033f56dcaaed8847d853f03c5f1d: Status 404 returned error can't find the container with id a4aa32fb2b6565646b024295cbacde0fe22d033f56dcaaed8847d853f03c5f1d
Jul 29 19:29:15.333179 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:15.333145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bb554dd78-6n7j8" event={"ID":"be42da00-78be-41e9-badd-27afae6d777c","Type":"ContainerStarted","Data":"a4aa32fb2b6565646b024295cbacde0fe22d033f56dcaaed8847d853f03c5f1d"}
Jul 29 19:29:16.341320 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:16.341282    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bb554dd78-6n7j8" event={"ID":"be42da00-78be-41e9-badd-27afae6d777c","Type":"ContainerStarted","Data":"deebf4f0887ffe67c5c23233fc8dacf74a82571852439b47a2671e730e0d147b"}
Jul 29 19:29:16.368835 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:16.368785    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-bb554dd78-6n7j8" podStartSLOduration=1.918873957 podStartE2EDuration="2.368769469s" totalImagesPullingTime="449.895512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:29:16.367251509 +0000 UTC m=+726.287561835" watchObservedRunningTime="2026-07-29 19:29:16.368769469 +0000 UTC m=+726.289079788"
Jul 29 19:29:44.055553 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:44.055517    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:29:53.248486 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:29:53.248452    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:30:04.752645 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:30:04.752587    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:31:48.048682 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:31:48.048649    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:32:10.511751 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:32:10.511719    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:32:10.515282 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:32:10.515260    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:32:29.652395 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:32:29.652364    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:32:39.446244 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:32:39.446211    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:32:48.161521 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:32:48.161484    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:32:59.448450 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:32:59.448415    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:33:09.462431 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:33:09.462395    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:33:17.453358 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:33:17.453321    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:33:33.752592 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:33:33.752511    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:33:43.549521 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:33:43.549487    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:34:08.850281 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:34:08.850251    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:34:20.641665 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:34:20.641627    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:34:44.742130 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:34:44.742093    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:34:55.744754 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:34:55.744721    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:35:06.413128 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:35:06.413048    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:35:23.651067 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:35:23.651028    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:35:33.154396 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:35:33.154363    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:35:46.239223 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:35:46.239192    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:36:00.572421 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:00.572386    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:36:11.347445 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:11.347411    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:36:21.537350 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:21.537312    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:36:42.237237 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:42.237204    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"]
Jul 29 19:36:42.237782 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:42.237425    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt" podUID="ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" containerName="manager" containerID="cri-o://d16c0e94354b6e8f4c803bcf2b35a1da36ac9ec477904f0b2312e6d78becc60d" gracePeriod=10
Jul 29 19:36:44.732988 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:44.732958    2584 generic.go:356] "Generic (PLEG): container finished" podID="ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" containerID="d16c0e94354b6e8f4c803bcf2b35a1da36ac9ec477904f0b2312e6d78becc60d" exitCode=0
Jul 29 19:36:44.733317 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:44.733034    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt" event={"ID":"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf","Type":"ContainerDied","Data":"d16c0e94354b6e8f4c803bcf2b35a1da36ac9ec477904f0b2312e6d78becc60d"}
Jul 29 19:36:45.189904 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.189880    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:36:45.254854 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.254821    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-extensions-socket-volume\") pod \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") "
Jul 29 19:36:45.254990 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.254951    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q94z\" (UniqueName: \"kubernetes.io/projected/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-kube-api-access-8q94z\") pod \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\" (UID: \"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf\") "
Jul 29 19:36:45.255135 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.255113    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" (UID: "ba9d0ab9-6989-4c26-bf36-150e19c0ccbf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:36:45.255224 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.255212    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-extensions-socket-volume\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:36:45.256979 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.256954    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-kube-api-access-8q94z" (OuterVolumeSpecName: "kube-api-access-8q94z") pod "ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" (UID: "ba9d0ab9-6989-4c26-bf36-150e19c0ccbf"). InnerVolumeSpecName "kube-api-access-8q94z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:36:45.355712 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.355686    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q94z\" (UniqueName: \"kubernetes.io/projected/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf-kube-api-access-8q94z\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:36:45.739645 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.739539    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt" event={"ID":"ba9d0ab9-6989-4c26-bf36-150e19c0ccbf","Type":"ContainerDied","Data":"f3d8441b17e607877cdafda2025cff27c51004305af7c0df215ea20687fd2ae2"}
Jul 29 19:36:45.739645 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.739557    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"
Jul 29 19:36:45.739645 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.739595    2584 scope.go:117] "RemoveContainer" containerID="d16c0e94354b6e8f4c803bcf2b35a1da36ac9ec477904f0b2312e6d78becc60d"
Jul 29 19:36:45.766315 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.766286    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"]
Jul 29 19:36:45.772368 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:45.772347    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2wbtt"]
Jul 29 19:36:46.593748 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:36:46.593713    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" path="/var/lib/kubelet/pods/ba9d0ab9-6989-4c26-bf36-150e19c0ccbf/volumes"
Jul 29 19:37:10.550213 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:10.550094    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:37:10.554034 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:10.550283    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:37:43.321749 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.321716    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"]
Jul 29 19:37:43.322206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.322158    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" containerName="manager"
Jul 29 19:37:43.322206 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.322170    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" containerName="manager"
Jul 29 19:37:43.322293 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.322243    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9d0ab9-6989-4c26-bf36-150e19c0ccbf" containerName="manager"
Jul 29 19:37:43.325393 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.325377    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.327939 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.327916    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wpmn9\""
Jul 29 19:37:43.339890 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.339870    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"]
Jul 29 19:37:43.456012 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.455986    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w92xt\" (UniqueName: \"kubernetes.io/projected/3ecdbadf-b610-42fb-b374-6371953cc905-kube-api-access-w92xt\") pod \"kuadrant-operator-controller-manager-86878c769f-tnrnp\" (UID: \"3ecdbadf-b610-42fb-b374-6371953cc905\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.456145 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.456051    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ecdbadf-b610-42fb-b374-6371953cc905-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tnrnp\" (UID: \"3ecdbadf-b610-42fb-b374-6371953cc905\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.557161 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.557124    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w92xt\" (UniqueName: \"kubernetes.io/projected/3ecdbadf-b610-42fb-b374-6371953cc905-kube-api-access-w92xt\") pod \"kuadrant-operator-controller-manager-86878c769f-tnrnp\" (UID: \"3ecdbadf-b610-42fb-b374-6371953cc905\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.557288 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.557240    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ecdbadf-b610-42fb-b374-6371953cc905-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tnrnp\" (UID: \"3ecdbadf-b610-42fb-b374-6371953cc905\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.557594 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.557575    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ecdbadf-b610-42fb-b374-6371953cc905-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tnrnp\" (UID: \"3ecdbadf-b610-42fb-b374-6371953cc905\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.567929 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.567908    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w92xt\" (UniqueName: \"kubernetes.io/projected/3ecdbadf-b610-42fb-b374-6371953cc905-kube-api-access-w92xt\") pod \"kuadrant-operator-controller-manager-86878c769f-tnrnp\" (UID: \"3ecdbadf-b610-42fb-b374-6371953cc905\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.635168 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.635147    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:43.780435 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:43.780411    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"]
Jul 29 19:37:43.782854 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:37:43.782824    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecdbadf_b610_42fb_b374_6371953cc905.slice/crio-7945e4b04abd6c4732c74a1cb9308346eb7ab2b881ccc4493692914cbb780210 WatchSource:0}: Error finding container 7945e4b04abd6c4732c74a1cb9308346eb7ab2b881ccc4493692914cbb780210: Status 404 returned error can't find the container with id 7945e4b04abd6c4732c74a1cb9308346eb7ab2b881ccc4493692914cbb780210
Jul 29 19:37:44.063419 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:44.063339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp" event={"ID":"3ecdbadf-b610-42fb-b374-6371953cc905","Type":"ContainerStarted","Data":"1bdff46bfd46b0e8df25f16b143847bc139ce2dc5b49a8a57276dd533d8370b6"}
Jul 29 19:37:44.063419 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:44.063395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp" event={"ID":"3ecdbadf-b610-42fb-b374-6371953cc905","Type":"ContainerStarted","Data":"7945e4b04abd6c4732c74a1cb9308346eb7ab2b881ccc4493692914cbb780210"}
Jul 29 19:37:44.063681 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:44.063426    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:37:44.101966 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:44.101908    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp" podStartSLOduration=1.101887528 podStartE2EDuration="1.101887528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:37:44.100955897 +0000 UTC m=+1234.021266217" watchObservedRunningTime="2026-07-29 19:37:44.101887528 +0000 UTC m=+1234.022197849"
Jul 29 19:37:55.070568 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:37:55.070538    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tnrnp"
Jul 29 19:38:03.249579 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:38:03.249494    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:38:14.548399 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:38:14.548357    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:38:28.546630 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:38:28.546572    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:38:43.057325 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:38:43.057291    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:38:53.750302 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:38:53.750267    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:39:04.254835 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:39:04.254796    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:39:13.644343 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:39:13.644308    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:39:25.756946 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:39:25.756906    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:39:33.452235 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:39:33.452155    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:39:44.941868 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:39:44.941832    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:39:58.062062 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:39:58.062024    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:40:06.259548 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:40:06.259511    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:40:23.746871 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:40:23.746838    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:40:33.055493 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:40:33.055459    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:40:51.047069 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:40:51.047033    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:41:06.743240 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:41:06.743164    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:41:31.145135 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:41:31.145097    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:41:45.740772 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:41:45.740735    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:41:52.251991 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:41:52.251957    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:42:08.650105 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:08.650063    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:42:10.597274 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:10.597244    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:42:10.599699 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:10.597450    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:42:18.547487 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:18.547454    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:42:27.748481 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:27.748445    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:42:38.448266 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:38.448191    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:42:47.646519 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:47.646483    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:42:56.940639 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:42:56.940591    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:43:10.443997 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:43:10.443955    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:43:19.892914 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:43:19.892869    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:43:29.751339 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:43:29.751296    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:43:41.861563 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:43:41.861528    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:43:54.152163 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:43:54.152129    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:44:03.148121 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:44:03.148040    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:44:15.998980 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:44:15.998942    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:44:27.853964 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:44:27.853928    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:44:39.044843 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:44:39.044809    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:44:52.758735 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:44:52.758702    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:45:01.953342 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:45:01.953302    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:45:12.263897 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:45:12.263861    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:45:22.842854 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:45:22.842815    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:45:51.640593 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:45:51.640555    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:46:01.650622 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:46:01.650575    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:46:27.301173 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:46:27.301140    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:46:37.540596 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:46:37.540563    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:47:10.635101 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:47:10.635005    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:47:10.642900 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:47:10.635825    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:47:13.192719 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:47:13.192686    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:47:23.052210 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:47:23.052179    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:47:49.065808 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:47:49.065772    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:49:11.743752 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:49:11.743719    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:49:24.158310 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:49:24.158272    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:49:33.954786 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:49:33.954751    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:49:45.482144 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:49:45.482100    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:50:24.747326 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:50:24.747237    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:50:57.044737 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:50:57.044700    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:51:25.541143 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:51:25.541110    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:51:41.750743 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:51:41.750661    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:51:57.140087 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:51:57.140053    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:52:05.540932 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:52:05.540894    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:52:10.677500 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:52:10.677399    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:52:10.688942 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:52:10.680883    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:53:06.238825 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:53:06.238737    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:53:18.343801 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:53:18.343761    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:54:07.040527 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:54:07.040492    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:54:35.653178 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:54:35.653097    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:55:03.244317 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:55:03.244280    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:55:14.940403 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:55:14.940373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:55:50.447278 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:55:50.447246    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:56:35.084688 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.084585    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"]
Jul 29 19:56:35.088254 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.088239    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"
Jul 29 19:56:35.090933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.090906    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jsq2r\""
Jul 29 19:56:35.090933 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.090931    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:56:35.095278 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.095257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"]
Jul 29 19:56:35.104263 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.104239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac1cf19-0deb-45e4-be63-9ea4c7a81724-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m\" (UID: \"3ac1cf19-0deb-45e4-be63-9ea4c7a81724\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"
Jul 29 19:56:35.205628 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.205594    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac1cf19-0deb-45e4-be63-9ea4c7a81724-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m\" (UID: \"3ac1cf19-0deb-45e4-be63-9ea4c7a81724\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"
Jul 29 19:56:35.206258 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.206238    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac1cf19-0deb-45e4-be63-9ea4c7a81724-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m\" (UID: \"3ac1cf19-0deb-45e4-be63-9ea4c7a81724\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"
Jul 29 19:56:35.401397 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.401304    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"
Jul 29 19:56:35.538282 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.538257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"]
Jul 29 19:56:35.539392 ip-10-0-140-204 kubenswrapper[2584]: W0729 19:56:35.539368    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac1cf19_0deb_45e4_be63_9ea4c7a81724.slice/crio-e1b74ea92808952bdd518235818b526194f9f2764b3e1b0592852547bc3a8698 WatchSource:0}: Error finding container e1b74ea92808952bdd518235818b526194f9f2764b3e1b0592852547bc3a8698: Status 404 returned error can't find the container with id e1b74ea92808952bdd518235818b526194f9f2764b3e1b0592852547bc3a8698
Jul 29 19:56:35.541309 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:35.541287    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:56:36.081190 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:36.081158    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m" event={"ID":"3ac1cf19-0deb-45e4-be63-9ea4c7a81724","Type":"ContainerStarted","Data":"e1b74ea92808952bdd518235818b526194f9f2764b3e1b0592852547bc3a8698"}
Jul 29 19:56:39.039346 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:39.039308    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:56:39.100572 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:39.100532    2584 generic.go:356] "Generic (PLEG): container finished" podID="3ac1cf19-0deb-45e4-be63-9ea4c7a81724" containerID="9ac4df31afbc8d4f612628222ce43778fdbc91a581dfecad8eb1cd5514c617b9" exitCode=0
Jul 29 19:56:39.100767 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:39.100586    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m" event={"ID":"3ac1cf19-0deb-45e4-be63-9ea4c7a81724","Type":"ContainerDied","Data":"9ac4df31afbc8d4f612628222ce43778fdbc91a581dfecad8eb1cd5514c617b9"}
Jul 29 19:56:40.245475 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:40.245453    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"
Jul 29 19:56:40.351916 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:40.351880    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac1cf19-0deb-45e4-be63-9ea4c7a81724-maas-api-service-ca\") pod \"3ac1cf19-0deb-45e4-be63-9ea4c7a81724\" (UID: \"3ac1cf19-0deb-45e4-be63-9ea4c7a81724\") "
Jul 29 19:56:40.352175 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:40.352153    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ac1cf19-0deb-45e4-be63-9ea4c7a81724-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ac1cf19-0deb-45e4-be63-9ea4c7a81724" (UID: "3ac1cf19-0deb-45e4-be63-9ea4c7a81724"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:56:40.453061 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:40.452979    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac1cf19-0deb-45e4-be63-9ea4c7a81724-maas-api-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 19:56:41.112776 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:41.112748    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"
Jul 29 19:56:41.112776 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:41.112759    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m" event={"ID":"3ac1cf19-0deb-45e4-be63-9ea4c7a81724","Type":"ContainerDied","Data":"e1b74ea92808952bdd518235818b526194f9f2764b3e1b0592852547bc3a8698"}
Jul 29 19:56:41.113080 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:41.112808    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1b74ea92808952bdd518235818b526194f9f2764b3e1b0592852547bc3a8698"
Jul 29 19:56:45.771412 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:45.771383    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"]
Jul 29 19:56:45.774661 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:45.774634    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-06a5f2-ffj8m"]
Jul 29 19:56:46.593222 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:46.593182    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ac1cf19-0deb-45e4-be63-9ea4c7a81724" path="/var/lib/kubelet/pods/3ac1cf19-0deb-45e4-be63-9ea4c7a81724/volumes"
Jul 29 19:56:55.040419 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:56:55.040385    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:57:06.239590 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:57:06.239553    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:57:10.716247 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:57:10.716136    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:57:10.724074 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:57:10.721842    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 19:57:20.834224 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:57:20.834192    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:57:49.638372 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:57:49.638340    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:58:31.943496 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:58:31.943459    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:58:52.840587 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:58:52.840548    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:59:03.457804 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:59:03.457725    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 19:59:33.338972 ip-10-0-140-204 kubenswrapper[2584]: I0729 19:59:33.338934    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:00:00.155009 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.154967    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"]
Jul 29 20:00:00.155584 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.155414    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac1cf19-0deb-45e4-be63-9ea4c7a81724" containerName="revoke-keys"
Jul 29 20:00:00.155584 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.155426    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac1cf19-0deb-45e4-be63-9ea4c7a81724" containerName="revoke-keys"
Jul 29 20:00:00.155584 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.155493    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac1cf19-0deb-45e4-be63-9ea4c7a81724" containerName="revoke-keys"
Jul 29 20:00:00.158520 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.158497    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"]
Jul 29 20:00:00.158680 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.158644    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"
Jul 29 20:00:00.161364 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.161346    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jsq2r\""
Jul 29 20:00:00.162673 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.162653    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8"]
Jul 29 20:00:00.162776 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.162760    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"
Jul 29 20:00:00.166168 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.166150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8"
Jul 29 20:00:00.170967 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.170948    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"
Jul 29 20:00:00.171988 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.171969    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"]
Jul 29 20:00:00.175567 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.175548    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8"]
Jul 29 20:00:00.181200 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.181177    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"]
Jul 29 20:00:00.194837 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.194813    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"
Jul 29 20:00:00.241634 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.241498    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8"
Jul 29 20:00:00.366677 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.366638    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"]
Jul 29 20:00:00.368203 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:00:00.368157    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5090a638_b709_48a5_9a81_c7200845c95d.slice/crio-afbab8a021b0d3840f2fe94c3e5e38fb0f43bf5032863679d17741434749a453 WatchSource:0}: Error finding container afbab8a021b0d3840f2fe94c3e5e38fb0f43bf5032863679d17741434749a453: Status 404 returned error can't find the container with id afbab8a021b0d3840f2fe94c3e5e38fb0f43bf5032863679d17741434749a453
Jul 29 20:00:00.413896 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.413870    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8"]
Jul 29 20:00:00.416325 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:00:00.416300    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016a7324_b182_4e98_8ed4_2911ffa2dfaf.slice/crio-037836aa5dbab95840f2cbd99464032712733a9a0b33d17474aab983c20e7916 WatchSource:0}: Error finding container 037836aa5dbab95840f2cbd99464032712733a9a0b33d17474aab983c20e7916: Status 404 returned error can't find the container with id 037836aa5dbab95840f2cbd99464032712733a9a0b33d17474aab983c20e7916
Jul 29 20:00:00.614544 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:00.614521    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"]
Jul 29 20:00:00.616499 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:00:00.616475    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b4171d_0613_4e56_a887_33c933078742.slice/crio-f48d8af278a65eb3edc810f337687d26b766fd35db75a69ffda39e2bdb0697ab WatchSource:0}: Error finding container f48d8af278a65eb3edc810f337687d26b766fd35db75a69ffda39e2bdb0697ab: Status 404 returned error can't find the container with id f48d8af278a65eb3edc810f337687d26b766fd35db75a69ffda39e2bdb0697ab
Jul 29 20:00:01.162788 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.162758    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8" event={"ID":"016a7324-b182-4e98-8ed4-2911ffa2dfaf","Type":"ContainerStarted","Data":"9e217fb3da20502eec217131e5925f1f71551a14aeb474fc0bc58524d987e7e8"}
Jul 29 20:00:01.163171 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.162813    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8" event={"ID":"016a7324-b182-4e98-8ed4-2911ffa2dfaf","Type":"ContainerStarted","Data":"037836aa5dbab95840f2cbd99464032712733a9a0b33d17474aab983c20e7916"}
Jul 29 20:00:01.164288 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.164266    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f" event={"ID":"c8b4171d-0613-4e56-a887-33c933078742","Type":"ContainerStarted","Data":"9bd9a4c5b0561d55608951c1ee73c150dc04ec6b82761453fe8b972c2f03872b"}
Jul 29 20:00:01.164403 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.164301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f" event={"ID":"c8b4171d-0613-4e56-a887-33c933078742","Type":"ContainerStarted","Data":"f48d8af278a65eb3edc810f337687d26b766fd35db75a69ffda39e2bdb0697ab"}
Jul 29 20:00:01.165802 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.165780    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm" event={"ID":"5090a638-b709-48a5-9a81-c7200845c95d","Type":"ContainerStarted","Data":"76f6e94cb155eaa69f537e3ecc2bb5aa41a1d02413b56c7e926f05e0f5b234db"}
Jul 29 20:00:01.165906 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.165815    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm" event={"ID":"5090a638-b709-48a5-9a81-c7200845c95d","Type":"ContainerStarted","Data":"afbab8a021b0d3840f2fe94c3e5e38fb0f43bf5032863679d17741434749a453"}
Jul 29 20:00:01.182224 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.181940    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8" podStartSLOduration=1.181925616 podStartE2EDuration="1.181925616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:00:01.178519289 +0000 UTC m=+2571.098829610" watchObservedRunningTime="2026-07-29 20:00:01.181925616 +0000 UTC m=+2571.102235937"
Jul 29 20:00:01.194445 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.194402    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f" podStartSLOduration=1.194390017 podStartE2EDuration="1.194390017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:00:01.194037226 +0000 UTC m=+2571.114347547" watchObservedRunningTime="2026-07-29 20:00:01.194390017 +0000 UTC m=+2571.114700338"
Jul 29 20:00:01.211076 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:01.211031    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm" podStartSLOduration=1.211016702 podStartE2EDuration="1.211016702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:00:01.209883613 +0000 UTC m=+2571.130193933" watchObservedRunningTime="2026-07-29 20:00:01.211016702 +0000 UTC m=+2571.131327024"
Jul 29 20:00:02.171936 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:02.171902    2584 generic.go:356] "Generic (PLEG): container finished" podID="016a7324-b182-4e98-8ed4-2911ffa2dfaf" containerID="9e217fb3da20502eec217131e5925f1f71551a14aeb474fc0bc58524d987e7e8" exitCode=0
Jul 29 20:00:02.172352 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:02.171981    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8" event={"ID":"016a7324-b182-4e98-8ed4-2911ffa2dfaf","Type":"ContainerDied","Data":"9e217fb3da20502eec217131e5925f1f71551a14aeb474fc0bc58524d987e7e8"}
Jul 29 20:00:02.173409 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:02.173388    2584 generic.go:356] "Generic (PLEG): container finished" podID="c8b4171d-0613-4e56-a887-33c933078742" containerID="9bd9a4c5b0561d55608951c1ee73c150dc04ec6b82761453fe8b972c2f03872b" exitCode=0
Jul 29 20:00:02.173541 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:02.173471    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f" event={"ID":"c8b4171d-0613-4e56-a887-33c933078742","Type":"ContainerDied","Data":"9bd9a4c5b0561d55608951c1ee73c150dc04ec6b82761453fe8b972c2f03872b"}
Jul 29 20:00:02.174942 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:02.174917    2584 generic.go:356] "Generic (PLEG): container finished" podID="5090a638-b709-48a5-9a81-c7200845c95d" containerID="76f6e94cb155eaa69f537e3ecc2bb5aa41a1d02413b56c7e926f05e0f5b234db" exitCode=0
Jul 29 20:00:02.175042 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:02.175003    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm" event={"ID":"5090a638-b709-48a5-9a81-c7200845c95d","Type":"ContainerDied","Data":"76f6e94cb155eaa69f537e3ecc2bb5aa41a1d02413b56c7e926f05e0f5b234db"}
Jul 29 20:00:03.336795 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:03.336772    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8"
Jul 29 20:00:03.378010 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:03.377991    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"
Jul 29 20:00:03.381342 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:03.381323    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"
Jul 29 20:00:03.941160 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:03.941128    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:00:04.189394 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.189365    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8"
Jul 29 20:00:04.189573 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.189366    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-tcxm8" event={"ID":"016a7324-b182-4e98-8ed4-2911ffa2dfaf","Type":"ContainerDied","Data":"037836aa5dbab95840f2cbd99464032712733a9a0b33d17474aab983c20e7916"}
Jul 29 20:00:04.189573 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.189512    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="037836aa5dbab95840f2cbd99464032712733a9a0b33d17474aab983c20e7916"
Jul 29 20:00:04.190873 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.190846    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"
Jul 29 20:00:04.191012 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.190895    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f" event={"ID":"c8b4171d-0613-4e56-a887-33c933078742","Type":"ContainerDied","Data":"f48d8af278a65eb3edc810f337687d26b766fd35db75a69ffda39e2bdb0697ab"}
Jul 29 20:00:04.191012 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.190957    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f48d8af278a65eb3edc810f337687d26b766fd35db75a69ffda39e2bdb0697ab"
Jul 29 20:00:04.192498 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.192436    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"
Jul 29 20:00:04.192498 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.192462    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm" event={"ID":"5090a638-b709-48a5-9a81-c7200845c95d","Type":"ContainerDied","Data":"afbab8a021b0d3840f2fe94c3e5e38fb0f43bf5032863679d17741434749a453"}
Jul 29 20:00:04.192626 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:04.192498    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afbab8a021b0d3840f2fe94c3e5e38fb0f43bf5032863679d17741434749a453"
Jul 29 20:00:34.738386 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:00:34.738303    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:01:02.747570 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:01:02.747532    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:01:23.638438 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:01:23.638397    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:01:36.765693 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:01:36.765652    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:01:57.438581 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:01:57.438547    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:02:09.138120 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:02:09.138080    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:02:10.749172 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:02:10.749067    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 20:02:10.756972 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:02:10.756948    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 20:02:20.738492 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:02:20.738452    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:02:38.240069 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:02:38.240031    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:02:56.343280 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:02:56.343244    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:03:10.823592 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:03:10.823561    2584 scope.go:117] "RemoveContainer" containerID="9ac4df31afbc8d4f612628222ce43778fdbc91a581dfecad8eb1cd5514c617b9"
Jul 29 20:03:19.744263 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:03:19.744226    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:03:36.143061 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:03:36.142985    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:03:59.039894 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:03:59.039858    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:04:16.939498 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:04:16.939461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:04:42.238771 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:04:42.238740    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:04:58.637397 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:04:58.637362    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:05:08.436232 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:05:08.436146    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:05:23.152343 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:05:23.152303    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:05:51.546257 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:05:51.546224    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:06:11.043757 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:06:11.043718    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:06:29.233017 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:06:29.232976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:06:53.939316 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:06:53.939275    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:07:10.782810 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:07:10.782703    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 20:07:10.793375 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:07:10.793348    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 20:07:30.845008 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:07:30.844968    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:07:45.435380 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:07:45.435343    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:08:00.250031 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:00.249995    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:08:06.781633 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.781525    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140253228805168"]
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.781965    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016a7324-b182-4e98-8ed4-2911ffa2dfaf" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.781977    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="016a7324-b182-4e98-8ed4-2911ffa2dfaf" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.781991    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b4171d-0613-4e56-a887-33c933078742" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.781997    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b4171d-0613-4e56-a887-33c933078742" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.782018    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5090a638-b709-48a5-9a81-c7200845c95d" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.782025    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5090a638-b709-48a5-9a81-c7200845c95d" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.782095    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b4171d-0613-4e56-a887-33c933078742" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.782103    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="016a7324-b182-4e98-8ed4-2911ffa2dfaf" containerName="cleanup"
Jul 29 20:08:06.782229 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.782111    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5090a638-b709-48a5-9a81-c7200845c95d" containerName="cleanup"
Jul 29 20:08:06.785009 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.784982    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228805168"
Jul 29 20:08:06.787567 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.787538    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5pt9s\""
Jul 29 20:08:06.790397 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.790373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228805168"]
Jul 29 20:08:06.924736 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:06.924712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkqzl\" (UniqueName: \"kubernetes.io/projected/e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff-kube-api-access-lkqzl\") pod \"test-curl-7422-140253228805168\" (UID: \"e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff\") " pod="opendatahub/test-curl-7422-140253228805168"
Jul 29 20:08:07.025316 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:07.025288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkqzl\" (UniqueName: \"kubernetes.io/projected/e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff-kube-api-access-lkqzl\") pod \"test-curl-7422-140253228805168\" (UID: \"e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff\") " pod="opendatahub/test-curl-7422-140253228805168"
Jul 29 20:08:07.034459 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:07.034411    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkqzl\" (UniqueName: \"kubernetes.io/projected/e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff-kube-api-access-lkqzl\") pod \"test-curl-7422-140253228805168\" (UID: \"e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff\") " pod="opendatahub/test-curl-7422-140253228805168"
Jul 29 20:08:07.095985 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:07.095964    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228805168"
Jul 29 20:08:07.223221 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:07.223189    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228805168"]
Jul 29 20:08:07.224928 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:08:07.224903    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3fb34fc_25dc_4a05_b04f_f9fc1d1f24ff.slice/crio-f6a3d061ed58ea6cfa626bd38161876e14eb121b12157d086e9494355023c35e WatchSource:0}: Error finding container f6a3d061ed58ea6cfa626bd38161876e14eb121b12157d086e9494355023c35e: Status 404 returned error can't find the container with id f6a3d061ed58ea6cfa626bd38161876e14eb121b12157d086e9494355023c35e
Jul 29 20:08:07.226207 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:07.226191    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 20:08:07.822042 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:07.822008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228805168" event={"ID":"e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff","Type":"ContainerStarted","Data":"f6a3d061ed58ea6cfa626bd38161876e14eb121b12157d086e9494355023c35e"}
Jul 29 20:08:08.829215 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:08.829180    2584 generic.go:356] "Generic (PLEG): container finished" podID="e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff" containerID="5e3ef8f0ab6356b9f3938888029863b006a841eba48ffa0b5ed5a99075e67c08" exitCode=0
Jul 29 20:08:08.829642 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:08.829263    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228805168" event={"ID":"e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff","Type":"ContainerDied","Data":"5e3ef8f0ab6356b9f3938888029863b006a841eba48ffa0b5ed5a99075e67c08"}
Jul 29 20:08:09.976082 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:09.976058    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228805168"
Jul 29 20:08:10.010348 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.010322    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140253228805168_e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff/test-curl-7422-140253228805168/0.log"
Jul 29 20:08:10.032523 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.032492    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140253228805168"]
Jul 29 20:08:10.038258 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.038238    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140253228805168"]
Jul 29 20:08:10.048666 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.048646    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkqzl\" (UniqueName: \"kubernetes.io/projected/e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff-kube-api-access-lkqzl\") pod \"e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff\" (UID: \"e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff\") "
Jul 29 20:08:10.050726 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.050706    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff-kube-api-access-lkqzl" (OuterVolumeSpecName: "kube-api-access-lkqzl") pod "e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff" (UID: "e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff"). InnerVolumeSpecName "kube-api-access-lkqzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:10.149403 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.149352    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkqzl\" (UniqueName: \"kubernetes.io/projected/e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff-kube-api-access-lkqzl\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:08:10.157326 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.157294    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140253228802608"]
Jul 29 20:08:10.157829 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.157810    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff" containerName="test-curl-7422-140253228805168"
Jul 29 20:08:10.157919 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.157830    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff" containerName="test-curl-7422-140253228805168"
Jul 29 20:08:10.157985 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.157939    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff" containerName="test-curl-7422-140253228805168"
Jul 29 20:08:10.160922 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.160906    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:10.167281 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.167259    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228802608"]
Jul 29 20:08:10.250192 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.250166    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxtms\" (UniqueName: \"kubernetes.io/projected/d2337ade-d1a7-4486-9ef0-f774fec2f78a-kube-api-access-qxtms\") pod \"test-curl-7422-140253228802608\" (UID: \"d2337ade-d1a7-4486-9ef0-f774fec2f78a\") " pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:10.350916 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.350885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxtms\" (UniqueName: \"kubernetes.io/projected/d2337ade-d1a7-4486-9ef0-f774fec2f78a-kube-api-access-qxtms\") pod \"test-curl-7422-140253228802608\" (UID: \"d2337ade-d1a7-4486-9ef0-f774fec2f78a\") " pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:10.358995 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.358969    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxtms\" (UniqueName: \"kubernetes.io/projected/d2337ade-d1a7-4486-9ef0-f774fec2f78a-kube-api-access-qxtms\") pod \"test-curl-7422-140253228802608\" (UID: \"d2337ade-d1a7-4486-9ef0-f774fec2f78a\") " pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:10.470686 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.470597    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:10.597105 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.597071    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff" path="/var/lib/kubelet/pods/e3fb34fc-25dc-4a05-b04f-f9fc1d1f24ff/volumes"
Jul 29 20:08:10.608765 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.608745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228802608"]
Jul 29 20:08:10.610848 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:08:10.610824    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2337ade_d1a7_4486_9ef0_f774fec2f78a.slice/crio-962adec633b576aea7bdfa705476b7015d579df1bf1b1a7efeefc54f0b035a5f WatchSource:0}: Error finding container 962adec633b576aea7bdfa705476b7015d579df1bf1b1a7efeefc54f0b035a5f: Status 404 returned error can't find the container with id 962adec633b576aea7bdfa705476b7015d579df1bf1b1a7efeefc54f0b035a5f
Jul 29 20:08:10.631783 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:08:10.631760    2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3fb34fc_25dc_4a05_b04f_f9fc1d1f24ff.slice\": RecentStats: unable to find data in memory cache]"
Jul 29 20:08:10.841819 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.841789    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228802608" event={"ID":"d2337ade-d1a7-4486-9ef0-f774fec2f78a","Type":"ContainerStarted","Data":"962adec633b576aea7bdfa705476b7015d579df1bf1b1a7efeefc54f0b035a5f"}
Jul 29 20:08:10.843105 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.843089    2584 scope.go:117] "RemoveContainer" containerID="5e3ef8f0ab6356b9f3938888029863b006a841eba48ffa0b5ed5a99075e67c08"
Jul 29 20:08:10.843105 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:10.843101    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228805168"
Jul 29 20:08:11.849671 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:11.849644    2584 generic.go:356] "Generic (PLEG): container finished" podID="d2337ade-d1a7-4486-9ef0-f774fec2f78a" containerID="9425b0c111a6e682b0ab34660cf78e081fd3dda05eed2ec20751d92e545029c1" exitCode=0
Jul 29 20:08:11.850035 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:11.849728    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228802608" event={"ID":"d2337ade-d1a7-4486-9ef0-f774fec2f78a","Type":"ContainerDied","Data":"9425b0c111a6e682b0ab34660cf78e081fd3dda05eed2ec20751d92e545029c1"}
Jul 29 20:08:12.996776 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:12.996753    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:13.017206 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.017174    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140253228802608_d2337ade-d1a7-4486-9ef0-f774fec2f78a/test-curl-7422-140253228802608/0.log"
Jul 29 20:08:13.054400 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.054371    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140253228802608"]
Jul 29 20:08:13.062222 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.062197    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140253228802608"]
Jul 29 20:08:13.074881 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.074857    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxtms\" (UniqueName: \"kubernetes.io/projected/d2337ade-d1a7-4486-9ef0-f774fec2f78a-kube-api-access-qxtms\") pod \"d2337ade-d1a7-4486-9ef0-f774fec2f78a\" (UID: \"d2337ade-d1a7-4486-9ef0-f774fec2f78a\") "
Jul 29 20:08:13.076796 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.076768    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2337ade-d1a7-4486-9ef0-f774fec2f78a-kube-api-access-qxtms" (OuterVolumeSpecName: "kube-api-access-qxtms") pod "d2337ade-d1a7-4486-9ef0-f774fec2f78a" (UID: "d2337ade-d1a7-4486-9ef0-f774fec2f78a"). InnerVolumeSpecName "kube-api-access-qxtms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:13.176130 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.176076    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxtms\" (UniqueName: \"kubernetes.io/projected/d2337ade-d1a7-4486-9ef0-f774fec2f78a-kube-api-access-qxtms\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:08:13.249810 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.249782    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:13.250216 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.250203    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2337ade-d1a7-4486-9ef0-f774fec2f78a" containerName="test-curl-7422-140253228802608"
Jul 29 20:08:13.250259 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.250218    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2337ade-d1a7-4486-9ef0-f774fec2f78a" containerName="test-curl-7422-140253228802608"
Jul 29 20:08:13.250295 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.250278    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2337ade-d1a7-4486-9ef0-f774fec2f78a" containerName="test-curl-7422-140253228802608"
Jul 29 20:08:13.253426 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.253409    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:13.261973 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.261952    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:13.377832 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.377801    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xhkx\" (UniqueName: \"kubernetes.io/projected/9c6c9e0d-df07-41eb-8951-e192b1c6f42a-kube-api-access-4xhkx\") pod \"test-curl-7422-140253228849168\" (UID: \"9c6c9e0d-df07-41eb-8951-e192b1c6f42a\") " pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:13.479323 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.479257    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhkx\" (UniqueName: \"kubernetes.io/projected/9c6c9e0d-df07-41eb-8951-e192b1c6f42a-kube-api-access-4xhkx\") pod \"test-curl-7422-140253228849168\" (UID: \"9c6c9e0d-df07-41eb-8951-e192b1c6f42a\") " pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:13.488203 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.488180    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xhkx\" (UniqueName: \"kubernetes.io/projected/9c6c9e0d-df07-41eb-8951-e192b1c6f42a-kube-api-access-4xhkx\") pod \"test-curl-7422-140253228849168\" (UID: \"9c6c9e0d-df07-41eb-8951-e192b1c6f42a\") " pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:13.563585 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.563554    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:13.693468 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.693447    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:13.695202 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:08:13.695177    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c6c9e0d_df07_41eb_8951_e192b1c6f42a.slice/crio-3ba18894e2b58227062327b6d5147027454de40754b9dbc11e4d5a5570a46b0c WatchSource:0}: Error finding container 3ba18894e2b58227062327b6d5147027454de40754b9dbc11e4d5a5570a46b0c: Status 404 returned error can't find the container with id 3ba18894e2b58227062327b6d5147027454de40754b9dbc11e4d5a5570a46b0c
Jul 29 20:08:13.861922 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.861891    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:13.862031 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.861937    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="962adec633b576aea7bdfa705476b7015d579df1bf1b1a7efeefc54f0b035a5f"
Jul 29 20:08:13.863170 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:13.863147    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228849168" event={"ID":"9c6c9e0d-df07-41eb-8951-e192b1c6f42a","Type":"ContainerStarted","Data":"3ba18894e2b58227062327b6d5147027454de40754b9dbc11e4d5a5570a46b0c"}
Jul 29 20:08:13.876619 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:08:13.876577    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-140253228802608\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="d2337ade-d1a7-4486-9ef0-f774fec2f78a" pod="opendatahub/test-curl-7422-140253228802608"
Jul 29 20:08:14.594148 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:14.594109    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2337ade-d1a7-4486-9ef0-f774fec2f78a" path="/var/lib/kubelet/pods/d2337ade-d1a7-4486-9ef0-f774fec2f78a/volumes"
Jul 29 20:08:14.870793 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:14.870714    2584 generic.go:356] "Generic (PLEG): container finished" podID="9c6c9e0d-df07-41eb-8951-e192b1c6f42a" containerID="e6bc74e99eb2f427d9836696fe39d34c83c1cfd75d90ee9897c518ee61a4e2c1" exitCode=0
Jul 29 20:08:14.870936 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:14.870807    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228849168" event={"ID":"9c6c9e0d-df07-41eb-8951-e192b1c6f42a","Type":"ContainerDied","Data":"e6bc74e99eb2f427d9836696fe39d34c83c1cfd75d90ee9897c518ee61a4e2c1"}
Jul 29 20:08:16.011214 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.011190    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:16.030406 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.030381    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140253228849168_9c6c9e0d-df07-41eb-8951-e192b1c6f42a/test-curl-7422-140253228849168/0.log"
Jul 29 20:08:16.052152 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.052123    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:16.054214 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.054193    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:16.103486 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.103460    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xhkx\" (UniqueName: \"kubernetes.io/projected/9c6c9e0d-df07-41eb-8951-e192b1c6f42a-kube-api-access-4xhkx\") pod \"9c6c9e0d-df07-41eb-8951-e192b1c6f42a\" (UID: \"9c6c9e0d-df07-41eb-8951-e192b1c6f42a\") "
Jul 29 20:08:16.105590 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.105566    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6c9e0d-df07-41eb-8951-e192b1c6f42a-kube-api-access-4xhkx" (OuterVolumeSpecName: "kube-api-access-4xhkx") pod "9c6c9e0d-df07-41eb-8951-e192b1c6f42a" (UID: "9c6c9e0d-df07-41eb-8951-e192b1c6f42a"). InnerVolumeSpecName "kube-api-access-4xhkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:16.173737 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.173682    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:16.174115 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.174102    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6c9e0d-df07-41eb-8951-e192b1c6f42a" containerName="test-curl-7422-140253228849168"
Jul 29 20:08:16.174153 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.174116    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6c9e0d-df07-41eb-8951-e192b1c6f42a" containerName="test-curl-7422-140253228849168"
Jul 29 20:08:16.174200 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.174191    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c6c9e0d-df07-41eb-8951-e192b1c6f42a" containerName="test-curl-7422-140253228849168"
Jul 29 20:08:16.177251 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.177236    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:16.185283 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.185047    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:16.205238 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.205216    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xhkx\" (UniqueName: \"kubernetes.io/projected/9c6c9e0d-df07-41eb-8951-e192b1c6f42a-kube-api-access-4xhkx\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:08:16.305719 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.305699    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5flj\" (UniqueName: \"kubernetes.io/projected/3b51837e-67d2-4241-9c68-87d0498cd6e9-kube-api-access-v5flj\") pod \"test-curl-7422-140253228849168\" (UID: \"3b51837e-67d2-4241-9c68-87d0498cd6e9\") " pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:16.406451 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.406427    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5flj\" (UniqueName: \"kubernetes.io/projected/3b51837e-67d2-4241-9c68-87d0498cd6e9-kube-api-access-v5flj\") pod \"test-curl-7422-140253228849168\" (UID: \"3b51837e-67d2-4241-9c68-87d0498cd6e9\") " pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:16.414702 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.414679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5flj\" (UniqueName: \"kubernetes.io/projected/3b51837e-67d2-4241-9c68-87d0498cd6e9-kube-api-access-v5flj\") pod \"test-curl-7422-140253228849168\" (UID: \"3b51837e-67d2-4241-9c68-87d0498cd6e9\") " pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:16.487841 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.487793    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:16.596239 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.596207    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c6c9e0d-df07-41eb-8951-e192b1c6f42a" path="/var/lib/kubelet/pods/9c6c9e0d-df07-41eb-8951-e192b1c6f42a/volumes"
Jul 29 20:08:16.616982 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.616962    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:16.619044 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:08:16.619023    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b51837e_67d2_4241_9c68_87d0498cd6e9.slice/crio-5d0a505f53b59c9dc9a3e4019ce2bc4b7293e2f5304d18ff200d40acd639536d WatchSource:0}: Error finding container 5d0a505f53b59c9dc9a3e4019ce2bc4b7293e2f5304d18ff200d40acd639536d: Status 404 returned error can't find the container with id 5d0a505f53b59c9dc9a3e4019ce2bc4b7293e2f5304d18ff200d40acd639536d
Jul 29 20:08:16.883641 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.883578    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228849168" event={"ID":"3b51837e-67d2-4241-9c68-87d0498cd6e9","Type":"ContainerStarted","Data":"5d0a505f53b59c9dc9a3e4019ce2bc4b7293e2f5304d18ff200d40acd639536d"}
Jul 29 20:08:16.884981 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.884963    2584 scope.go:117] "RemoveContainer" containerID="e6bc74e99eb2f427d9836696fe39d34c83c1cfd75d90ee9897c518ee61a4e2c1"
Jul 29 20:08:16.885091 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:16.884978    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:17.244953 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:17.244898    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:08:17.892557 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:17.892527    2584 generic.go:356] "Generic (PLEG): container finished" podID="3b51837e-67d2-4241-9c68-87d0498cd6e9" containerID="15e0b989732709529fbed98270eb726e37e525541f4a2ca94871f5f01f216fe4" exitCode=0
Jul 29 20:08:17.892761 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:17.892650    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228849168" event={"ID":"3b51837e-67d2-4241-9c68-87d0498cd6e9","Type":"ContainerDied","Data":"15e0b989732709529fbed98270eb726e37e525541f4a2ca94871f5f01f216fe4"}
Jul 29 20:08:19.036776 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.036753    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:19.077436 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.077409    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140253228849168_3b51837e-67d2-4241-9c68-87d0498cd6e9/test-curl-7422-140253228849168/0.log"
Jul 29 20:08:19.104267 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.104232    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:19.108156 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.108133    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140253228849168"]
Jul 29 20:08:19.129779 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.129753    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5flj\" (UniqueName: \"kubernetes.io/projected/3b51837e-67d2-4241-9c68-87d0498cd6e9-kube-api-access-v5flj\") pod \"3b51837e-67d2-4241-9c68-87d0498cd6e9\" (UID: \"3b51837e-67d2-4241-9c68-87d0498cd6e9\") "
Jul 29 20:08:19.131731 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.131705    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b51837e-67d2-4241-9c68-87d0498cd6e9-kube-api-access-v5flj" (OuterVolumeSpecName: "kube-api-access-v5flj") pod "3b51837e-67d2-4241-9c68-87d0498cd6e9" (UID: "3b51837e-67d2-4241-9c68-87d0498cd6e9"). InnerVolumeSpecName "kube-api-access-v5flj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:19.221013 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.220956    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:19.221391 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.221378    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b51837e-67d2-4241-9c68-87d0498cd6e9" containerName="test-curl-7422-140253228849168"
Jul 29 20:08:19.221436 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.221393    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b51837e-67d2-4241-9c68-87d0498cd6e9" containerName="test-curl-7422-140253228849168"
Jul 29 20:08:19.221497 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.221488    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b51837e-67d2-4241-9c68-87d0498cd6e9" containerName="test-curl-7422-140253228849168"
Jul 29 20:08:19.224565 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.224548    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:19.231338 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.231317    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5flj\" (UniqueName: \"kubernetes.io/projected/3b51837e-67d2-4241-9c68-87d0498cd6e9-kube-api-access-v5flj\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:08:19.231732 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.231713    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:19.332444 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.332413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvzj6\" (UniqueName: \"kubernetes.io/projected/0563461e-ea3a-4337-a5cd-1db7cf552598-kube-api-access-lvzj6\") pod \"test-curl-7422-140253228850176\" (UID: \"0563461e-ea3a-4337-a5cd-1db7cf552598\") " pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:19.433187 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.433156    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvzj6\" (UniqueName: \"kubernetes.io/projected/0563461e-ea3a-4337-a5cd-1db7cf552598-kube-api-access-lvzj6\") pod \"test-curl-7422-140253228850176\" (UID: \"0563461e-ea3a-4337-a5cd-1db7cf552598\") " pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:19.442133 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.442108    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvzj6\" (UniqueName: \"kubernetes.io/projected/0563461e-ea3a-4337-a5cd-1db7cf552598-kube-api-access-lvzj6\") pod \"test-curl-7422-140253228850176\" (UID: \"0563461e-ea3a-4337-a5cd-1db7cf552598\") " pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:19.534859 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.534800    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:19.669517 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.669494    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:19.671508 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:08:19.671486    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0563461e_ea3a_4337_a5cd_1db7cf552598.slice/crio-5ddbfaf80106a5820731b3f129c2c1d1a4527b87d628ceee43f970074dd1a3f6 WatchSource:0}: Error finding container 5ddbfaf80106a5820731b3f129c2c1d1a4527b87d628ceee43f970074dd1a3f6: Status 404 returned error can't find the container with id 5ddbfaf80106a5820731b3f129c2c1d1a4527b87d628ceee43f970074dd1a3f6
Jul 29 20:08:19.905529 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.905503    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:19.905661 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.905528    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d0a505f53b59c9dc9a3e4019ce2bc4b7293e2f5304d18ff200d40acd639536d"
Jul 29 20:08:19.906652 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:19.906627    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228850176" event={"ID":"0563461e-ea3a-4337-a5cd-1db7cf552598","Type":"ContainerStarted","Data":"5ddbfaf80106a5820731b3f129c2c1d1a4527b87d628ceee43f970074dd1a3f6"}
Jul 29 20:08:19.916452 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:08:19.916427    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-140253228849168\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="3b51837e-67d2-4241-9c68-87d0498cd6e9" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:20.592150 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:08:20.592095    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-140253228849168\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="3b51837e-67d2-4241-9c68-87d0498cd6e9" pod="opendatahub/test-curl-7422-140253228849168"
Jul 29 20:08:20.594976 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:20.594953    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b51837e-67d2-4241-9c68-87d0498cd6e9" path="/var/lib/kubelet/pods/3b51837e-67d2-4241-9c68-87d0498cd6e9/volumes"
Jul 29 20:08:20.913549 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:20.913463    2584 generic.go:356] "Generic (PLEG): container finished" podID="0563461e-ea3a-4337-a5cd-1db7cf552598" containerID="a15cf83ddcd010a1d4accd1173defcc3aa65893c2bddfe935ab7aedcd23bdf5e" exitCode=0
Jul 29 20:08:20.913549 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:20.913512    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228850176" event={"ID":"0563461e-ea3a-4337-a5cd-1db7cf552598","Type":"ContainerDied","Data":"a15cf83ddcd010a1d4accd1173defcc3aa65893c2bddfe935ab7aedcd23bdf5e"}
Jul 29 20:08:22.055208 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.055182    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:22.074594 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.074571    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140253228850176_0563461e-ea3a-4337-a5cd-1db7cf552598/test-curl-7422-140253228850176/0.log"
Jul 29 20:08:22.096089 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.096061    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:22.099318 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.099295    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:22.156781 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.156761    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvzj6\" (UniqueName: \"kubernetes.io/projected/0563461e-ea3a-4337-a5cd-1db7cf552598-kube-api-access-lvzj6\") pod \"0563461e-ea3a-4337-a5cd-1db7cf552598\" (UID: \"0563461e-ea3a-4337-a5cd-1db7cf552598\") "
Jul 29 20:08:22.158718 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.158690    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0563461e-ea3a-4337-a5cd-1db7cf552598-kube-api-access-lvzj6" (OuterVolumeSpecName: "kube-api-access-lvzj6") pod "0563461e-ea3a-4337-a5cd-1db7cf552598" (UID: "0563461e-ea3a-4337-a5cd-1db7cf552598"). InnerVolumeSpecName "kube-api-access-lvzj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:22.211565 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.211510    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:22.211977 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.211963    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0563461e-ea3a-4337-a5cd-1db7cf552598" containerName="test-curl-7422-140253228850176"
Jul 29 20:08:22.212025 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.211978    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0563461e-ea3a-4337-a5cd-1db7cf552598" containerName="test-curl-7422-140253228850176"
Jul 29 20:08:22.212061 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.212037    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0563461e-ea3a-4337-a5cd-1db7cf552598" containerName="test-curl-7422-140253228850176"
Jul 29 20:08:22.214856 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.214841    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:22.219770 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.219747    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:22.257360 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.257340    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvzj6\" (UniqueName: \"kubernetes.io/projected/0563461e-ea3a-4337-a5cd-1db7cf552598-kube-api-access-lvzj6\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:08:22.358207 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.358183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22tjs\" (UniqueName: \"kubernetes.io/projected/78cb7116-33a9-4316-8ea3-8869beee5e2e-kube-api-access-22tjs\") pod \"test-curl-7422-140253228850176\" (UID: \"78cb7116-33a9-4316-8ea3-8869beee5e2e\") " pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:22.458664 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.458637    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22tjs\" (UniqueName: \"kubernetes.io/projected/78cb7116-33a9-4316-8ea3-8869beee5e2e-kube-api-access-22tjs\") pod \"test-curl-7422-140253228850176\" (UID: \"78cb7116-33a9-4316-8ea3-8869beee5e2e\") " pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:22.466883 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.466834    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22tjs\" (UniqueName: \"kubernetes.io/projected/78cb7116-33a9-4316-8ea3-8869beee5e2e-kube-api-access-22tjs\") pod \"test-curl-7422-140253228850176\" (UID: \"78cb7116-33a9-4316-8ea3-8869beee5e2e\") " pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:22.526521 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.526500    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:22.601933 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.601906    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0563461e-ea3a-4337-a5cd-1db7cf552598" path="/var/lib/kubelet/pods/0563461e-ea3a-4337-a5cd-1db7cf552598/volumes"
Jul 29 20:08:22.664889 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.664863    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:22.667313 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:08:22.667287    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78cb7116_33a9_4316_8ea3_8869beee5e2e.slice/crio-efe51aa2d23ccc8f38c6526e62ba641d1bebcfc28b97aa1f660958ea8e1bdbc4 WatchSource:0}: Error finding container efe51aa2d23ccc8f38c6526e62ba641d1bebcfc28b97aa1f660958ea8e1bdbc4: Status 404 returned error can't find the container with id efe51aa2d23ccc8f38c6526e62ba641d1bebcfc28b97aa1f660958ea8e1bdbc4
Jul 29 20:08:22.926375 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.926349    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:22.926500 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.926379    2584 scope.go:117] "RemoveContainer" containerID="a15cf83ddcd010a1d4accd1173defcc3aa65893c2bddfe935ab7aedcd23bdf5e"
Jul 29 20:08:22.928038 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:22.928014    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228850176" event={"ID":"78cb7116-33a9-4316-8ea3-8869beee5e2e","Type":"ContainerStarted","Data":"efe51aa2d23ccc8f38c6526e62ba641d1bebcfc28b97aa1f660958ea8e1bdbc4"}
Jul 29 20:08:23.934735 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:23.934701    2584 generic.go:356] "Generic (PLEG): container finished" podID="78cb7116-33a9-4316-8ea3-8869beee5e2e" containerID="40834b37d622f8036925d0d2e4920821209fdf8c9509ce7e15399fd281079d8b" exitCode=0
Jul 29 20:08:23.935174 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:23.934793    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-140253228850176" event={"ID":"78cb7116-33a9-4316-8ea3-8869beee5e2e","Type":"ContainerDied","Data":"40834b37d622f8036925d0d2e4920821209fdf8c9509ce7e15399fd281079d8b"}
Jul 29 20:08:25.081467 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.081444    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:25.102479 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.102460    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7422-140253228850176_78cb7116-33a9-4316-8ea3-8869beee5e2e/test-curl-7422-140253228850176/0.log"
Jul 29 20:08:25.129388 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.129363    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:25.134499 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.134478    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-140253228850176"]
Jul 29 20:08:25.178842 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.178815    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22tjs\" (UniqueName: \"kubernetes.io/projected/78cb7116-33a9-4316-8ea3-8869beee5e2e-kube-api-access-22tjs\") pod \"78cb7116-33a9-4316-8ea3-8869beee5e2e\" (UID: \"78cb7116-33a9-4316-8ea3-8869beee5e2e\") "
Jul 29 20:08:25.180765 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.180737    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78cb7116-33a9-4316-8ea3-8869beee5e2e-kube-api-access-22tjs" (OuterVolumeSpecName: "kube-api-access-22tjs") pod "78cb7116-33a9-4316-8ea3-8869beee5e2e" (UID: "78cb7116-33a9-4316-8ea3-8869beee5e2e"). InnerVolumeSpecName "kube-api-access-22tjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:08:25.279530 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.279472    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22tjs\" (UniqueName: \"kubernetes.io/projected/78cb7116-33a9-4316-8ea3-8869beee5e2e-kube-api-access-22tjs\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:08:25.948274 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.948248    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:25.948441 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:25.948295    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efe51aa2d23ccc8f38c6526e62ba641d1bebcfc28b97aa1f660958ea8e1bdbc4"
Jul 29 20:08:25.958407 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:08:25.958376    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7422-140253228850176\" is forbidden: User \"system:node:ip-10-0-140-204.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-204.ec2.internal' and this object" podUID="78cb7116-33a9-4316-8ea3-8869beee5e2e" pod="opendatahub/test-curl-7422-140253228850176"
Jul 29 20:08:26.594198 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:26.594161    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78cb7116-33a9-4316-8ea3-8869beee5e2e" path="/var/lib/kubelet/pods/78cb7116-33a9-4316-8ea3-8869beee5e2e/volumes"
Jul 29 20:08:37.839619 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:37.839576    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:08:55.092707 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.092668    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"]
Jul 29 20:08:55.093314 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.093115    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78cb7116-33a9-4316-8ea3-8869beee5e2e" containerName="test-curl-7422-140253228850176"
Jul 29 20:08:55.093314 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.093128    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="78cb7116-33a9-4316-8ea3-8869beee5e2e" containerName="test-curl-7422-140253228850176"
Jul 29 20:08:55.093314 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.093212    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="78cb7116-33a9-4316-8ea3-8869beee5e2e" containerName="test-curl-7422-140253228850176"
Jul 29 20:08:55.096637 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.096614    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.099419 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.099398    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-2d9c39-openshift-default-dockercfg-twnmk\""
Jul 29 20:08:55.116919 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.116895    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"]
Jul 29 20:08:55.224354 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-socket\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224502 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224361    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-data\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224502 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-token\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224502 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224480    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-certs\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224652 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224508    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-envoy\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224690 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224640    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-podinfo\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224690 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istiod-ca-cert\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224760 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvv8g\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-kube-api-access-tvv8g\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.224760 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.224721    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-credential-socket\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326009 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.325975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-data\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326009 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326011    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-token\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326236 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326049    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-certs\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326236 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-envoy\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326236 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326122    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-podinfo\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326236 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istiod-ca-cert\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326236 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvv8g\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-kube-api-access-tvv8g\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326236 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326201    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-credential-socket\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326576 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326236    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-socket\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326576 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326471    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-data\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326576 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-certs\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326725 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326570    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-socket\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326725 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-credential-socket\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.326913 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.326894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istiod-ca-cert\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.328429 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.328412    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-envoy\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.328798 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.328776    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-podinfo\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.344008 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.343946    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-token\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.344089 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.344056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvv8g\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-kube-api-access-tvv8g\") pod \"e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") " pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.408214 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.408178    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:55.548707 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.548680    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"]
Jul 29 20:08:55.550570 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:08:55.550543    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0719775e_6bda_4aae_8e40_07f8d39c4d1f.slice/crio-d89a2de7e06405001611e75ab37a77b6fd96f35e2f571dc8908e9bedaf5b0cb7 WatchSource:0}: Error finding container d89a2de7e06405001611e75ab37a77b6fd96f35e2f571dc8908e9bedaf5b0cb7: Status 404 returned error can't find the container with id d89a2de7e06405001611e75ab37a77b6fd96f35e2f571dc8908e9bedaf5b0cb7
Jul 29 20:08:55.552774 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.552741    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:08:55.552875 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.552816    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:08:55.552875 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:55.552864    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:08:56.126330 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:56.126292    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" event={"ID":"0719775e-6bda-4aae-8e40-07f8d39c4d1f","Type":"ContainerStarted","Data":"79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2"}
Jul 29 20:08:56.126779 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:56.126352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" event={"ID":"0719775e-6bda-4aae-8e40-07f8d39c4d1f","Type":"ContainerStarted","Data":"d89a2de7e06405001611e75ab37a77b6fd96f35e2f571dc8908e9bedaf5b0cb7"}
Jul 29 20:08:56.148763 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:56.148706    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" podStartSLOduration=1.148685957 podStartE2EDuration="1.148685957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:08:56.145887766 +0000 UTC m=+3106.066198088" watchObservedRunningTime="2026-07-29 20:08:56.148685957 +0000 UTC m=+3106.068996278"
Jul 29 20:08:56.408639 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:56.408528    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:56.413029 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:56.413006    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:57.132419 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:57.132385    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:08:57.133311 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:08:57.133288    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:09:07.444787 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:07.444752    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:09:16.245050 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:16.244968    2584 generic.go:356] "Generic (PLEG): container finished" podID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerID="79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2" exitCode=0
Jul 29 20:09:16.245442 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:16.245042    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" event={"ID":"0719775e-6bda-4aae-8e40-07f8d39c4d1f","Type":"ContainerDied","Data":"79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2"}
Jul 29 20:09:16.245442 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:16.245413    2584 scope.go:117] "RemoveContainer" containerID="79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2"
Jul 29 20:09:16.246487 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:16.246461    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:09:16.246618 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:16.246525    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:09:16.246618 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:16.246555    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 20:09:17.115812 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.115777    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hx545"]
Jul 29 20:09:17.118809 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.118789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:17.136522 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.136497    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hx545"]
Jul 29 20:09:17.231742 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.231704    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n694x\" (UniqueName: \"kubernetes.io/projected/ca060cfa-67fd-4f69-8225-f40d5af61912-kube-api-access-n694x\") pod \"kuadrant-operator-catalog-hx545\" (UID: \"ca060cfa-67fd-4f69-8225-f40d5af61912\") " pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:17.252291 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.252263    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" event={"ID":"0719775e-6bda-4aae-8e40-07f8d39c4d1f","Type":"ContainerStarted","Data":"19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb"}
Jul 29 20:09:17.333228 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.333190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n694x\" (UniqueName: \"kubernetes.io/projected/ca060cfa-67fd-4f69-8225-f40d5af61912-kube-api-access-n694x\") pod \"kuadrant-operator-catalog-hx545\" (UID: \"ca060cfa-67fd-4f69-8225-f40d5af61912\") " pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:17.341896 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.341871    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n694x\" (UniqueName: \"kubernetes.io/projected/ca060cfa-67fd-4f69-8225-f40d5af61912-kube-api-access-n694x\") pod \"kuadrant-operator-catalog-hx545\" (UID: \"ca060cfa-67fd-4f69-8225-f40d5af61912\") " pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:17.409141 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.409049    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:09:17.409416 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.409391    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 29 20:09:17.409516 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.409446    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 29 20:09:17.428891 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.428866    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:17.606627 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:17.603277    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hx545"]
Jul 29 20:09:18.259420 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:18.259309    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hx545" event={"ID":"ca060cfa-67fd-4f69-8225-f40d5af61912","Type":"ContainerStarted","Data":"197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59"}
Jul 29 20:09:18.259420 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:18.259412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hx545" event={"ID":"ca060cfa-67fd-4f69-8225-f40d5af61912","Type":"ContainerStarted","Data":"ed03e82ff46197a8622f974be06714f11c407747d6a68d7c8f8bf857b61cb18c"}
Jul 29 20:09:18.278828 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:18.278769    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hx545" podStartSLOduration=0.90011816 podStartE2EDuration="1.278749524s" totalImagesPullingTime="378.631364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:18.275964194 +0000 UTC m=+3128.196274513" watchObservedRunningTime="2026-07-29 20:09:18.278749524 +0000 UTC m=+3128.199059846"
Jul 29 20:09:18.409492 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:18.409460    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 29 20:09:18.409661 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:18.409511    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 29 20:09:19.409325 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:19.409293    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 29 20:09:19.409751 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:19.409344    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 29 20:09:20.408823 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:20.408781    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 29 20:09:20.409003 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:20.408848    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 29 20:09:21.412387 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:21.412359    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:09:21.412807 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:21.412590    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:09:21.413390 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:21.413372    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:09:27.429620 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:27.429567    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:27.430180 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:27.429645    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:27.452382 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:27.452357    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:28.341764 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:28.341736    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:28.374514 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:28.374482    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hx545"]
Jul 29 20:09:30.331638 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:30.331549    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hx545" podUID="ca060cfa-67fd-4f69-8225-f40d5af61912" containerName="registry-server" containerID="cri-o://197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59" gracePeriod=2
Jul 29 20:09:30.589456 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:30.589392    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:30.644214 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:30.644185    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n694x\" (UniqueName: \"kubernetes.io/projected/ca060cfa-67fd-4f69-8225-f40d5af61912-kube-api-access-n694x\") pod \"ca060cfa-67fd-4f69-8225-f40d5af61912\" (UID: \"ca060cfa-67fd-4f69-8225-f40d5af61912\") "
Jul 29 20:09:30.646095 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:30.646069    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca060cfa-67fd-4f69-8225-f40d5af61912-kube-api-access-n694x" (OuterVolumeSpecName: "kube-api-access-n694x") pod "ca060cfa-67fd-4f69-8225-f40d5af61912" (UID: "ca060cfa-67fd-4f69-8225-f40d5af61912"). InnerVolumeSpecName "kube-api-access-n694x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:09:30.745698 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:30.745675    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n694x\" (UniqueName: \"kubernetes.io/projected/ca060cfa-67fd-4f69-8225-f40d5af61912-kube-api-access-n694x\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:09:31.339188 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.339155    2584 generic.go:356] "Generic (PLEG): container finished" podID="ca060cfa-67fd-4f69-8225-f40d5af61912" containerID="197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59" exitCode=0
Jul 29 20:09:31.339632 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.339208    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hx545"
Jul 29 20:09:31.339632 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.339241    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hx545" event={"ID":"ca060cfa-67fd-4f69-8225-f40d5af61912","Type":"ContainerDied","Data":"197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59"}
Jul 29 20:09:31.339632 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.339299    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hx545" event={"ID":"ca060cfa-67fd-4f69-8225-f40d5af61912","Type":"ContainerDied","Data":"ed03e82ff46197a8622f974be06714f11c407747d6a68d7c8f8bf857b61cb18c"}
Jul 29 20:09:31.339632 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.339326    2584 scope.go:117] "RemoveContainer" containerID="197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59"
Jul 29 20:09:31.349739 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.349717    2584 scope.go:117] "RemoveContainer" containerID="197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59"
Jul 29 20:09:31.350059 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:09:31.350034    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59\": container with ID starting with 197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59 not found: ID does not exist" containerID="197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59"
Jul 29 20:09:31.350162 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.350066    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59"} err="failed to get container status \"197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59\": rpc error: code = NotFound desc = could not find container \"197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59\": container with ID starting with 197b4f8ac5b354ec497ad53cb68a7e8ed21a83d19d2d8983ea9f5c7d7b58ac59 not found: ID does not exist"
Jul 29 20:09:31.362005 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.361981    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hx545"]
Jul 29 20:09:31.364486 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:31.364462    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hx545"]
Jul 29 20:09:32.593851 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:32.593775    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca060cfa-67fd-4f69-8225-f40d5af61912" path="/var/lib/kubelet/pods/ca060cfa-67fd-4f69-8225-f40d5af61912/volumes"
Jul 29 20:09:52.941625 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:09:52.941577    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:10:30.548792 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:10:30.548752    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:10:58.241283 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:10:58.241250    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:11:10.585005 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.584910    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"]
Jul 29 20:11:10.585589 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.585437    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca060cfa-67fd-4f69-8225-f40d5af61912" containerName="registry-server"
Jul 29 20:11:10.585589 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.585451    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca060cfa-67fd-4f69-8225-f40d5af61912" containerName="registry-server"
Jul 29 20:11:10.585589 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.585518    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca060cfa-67fd-4f69-8225-f40d5af61912" containerName="registry-server"
Jul 29 20:11:10.589547 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.589523    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"
Jul 29 20:11:10.592509 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.592485    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:11:10.592665 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.592509    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jsq2r\""
Jul 29 20:11:10.599265 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.599244    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"]
Jul 29 20:11:10.764354 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.764318    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/160c9149-5f60-4b95-b0b9-10e981c67759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6\" (UID: \"160c9149-5f60-4b95-b0b9-10e981c67759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"
Jul 29 20:11:10.865642 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.865558    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/160c9149-5f60-4b95-b0b9-10e981c67759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6\" (UID: \"160c9149-5f60-4b95-b0b9-10e981c67759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"
Jul 29 20:11:10.866160 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.866143    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/160c9149-5f60-4b95-b0b9-10e981c67759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6\" (UID: \"160c9149-5f60-4b95-b0b9-10e981c67759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"
Jul 29 20:11:10.904401 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:10.904373    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"
Jul 29 20:11:11.253093 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:11.253070    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"]
Jul 29 20:11:11.255348 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:11:11.255319    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160c9149_5f60_4b95_b0b9_10e981c67759.slice/crio-d086b48400ec5e926a543b713ef53024d3a18c5d4ebc03254a836ae5e3a4561a WatchSource:0}: Error finding container d086b48400ec5e926a543b713ef53024d3a18c5d4ebc03254a836ae5e3a4561a: Status 404 returned error can't find the container with id d086b48400ec5e926a543b713ef53024d3a18c5d4ebc03254a836ae5e3a4561a
Jul 29 20:11:11.896840 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:11.896757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6" event={"ID":"160c9149-5f60-4b95-b0b9-10e981c67759","Type":"ContainerStarted","Data":"892f707864eb07cc999345ea164e2c9171d8112435c6ffd51aa92d9c86ad8ce1"}
Jul 29 20:11:11.896840 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:11.896810    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6" event={"ID":"160c9149-5f60-4b95-b0b9-10e981c67759","Type":"ContainerStarted","Data":"d086b48400ec5e926a543b713ef53024d3a18c5d4ebc03254a836ae5e3a4561a"}
Jul 29 20:11:11.915085 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:11.915031    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6" podStartSLOduration=1.915017317 podStartE2EDuration="1.915017317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:11:11.912205066 +0000 UTC m=+3241.832515387" watchObservedRunningTime="2026-07-29 20:11:11.915017317 +0000 UTC m=+3241.835327637"
Jul 29 20:11:12.903779 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:12.903744    2584 generic.go:356] "Generic (PLEG): container finished" podID="160c9149-5f60-4b95-b0b9-10e981c67759" containerID="892f707864eb07cc999345ea164e2c9171d8112435c6ffd51aa92d9c86ad8ce1" exitCode=0
Jul 29 20:11:12.904195 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:12.903827    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6" event={"ID":"160c9149-5f60-4b95-b0b9-10e981c67759","Type":"ContainerDied","Data":"892f707864eb07cc999345ea164e2c9171d8112435c6ffd51aa92d9c86ad8ce1"}
Jul 29 20:11:14.046775 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:14.046746    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"
Jul 29 20:11:14.192304 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:14.192245    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/160c9149-5f60-4b95-b0b9-10e981c67759-maas-api-service-ca\") pod \"160c9149-5f60-4b95-b0b9-10e981c67759\" (UID: \"160c9149-5f60-4b95-b0b9-10e981c67759\") "
Jul 29 20:11:14.192654 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:14.192631    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160c9149-5f60-4b95-b0b9-10e981c67759-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "160c9149-5f60-4b95-b0b9-10e981c67759" (UID: "160c9149-5f60-4b95-b0b9-10e981c67759"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:11:14.293247 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:14.293223    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/160c9149-5f60-4b95-b0b9-10e981c67759-maas-api-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:11:14.916919 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:14.916838    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6" event={"ID":"160c9149-5f60-4b95-b0b9-10e981c67759","Type":"ContainerDied","Data":"d086b48400ec5e926a543b713ef53024d3a18c5d4ebc03254a836ae5e3a4561a"}
Jul 29 20:11:14.916919 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:14.916898    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d086b48400ec5e926a543b713ef53024d3a18c5d4ebc03254a836ae5e3a4561a"
Jul 29 20:11:14.916919 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:14.916849    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"
Jul 29 20:11:16.948307 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:16.948275    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"]
Jul 29 20:11:16.951692 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:16.951665    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-5d7141-hl8l6"]
Jul 29 20:11:18.594244 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:18.594204    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160c9149-5f60-4b95-b0b9-10e981c67759" path="/var/lib/kubelet/pods/160c9149-5f60-4b95-b0b9-10e981c67759/volumes"
Jul 29 20:11:21.052475 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:21.052443    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:11:26.959537 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.959502    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"]
Jul 29 20:11:26.959992 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.959976    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160c9149-5f60-4b95-b0b9-10e981c67759" containerName="revoke-keys"
Jul 29 20:11:26.960037 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.959994    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="160c9149-5f60-4b95-b0b9-10e981c67759" containerName="revoke-keys"
Jul 29 20:11:26.960087 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.960077    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="160c9149-5f60-4b95-b0b9-10e981c67759" containerName="revoke-keys"
Jul 29 20:11:26.962188 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.962172    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"
Jul 29 20:11:26.964547 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.964531    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jsq2r\""
Jul 29 20:11:26.964647 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.964544    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:11:26.971510 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.971481    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"]
Jul 29 20:11:26.999546 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:26.999521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b262c2f-5d4e-4060-9ff4-e55d4124b251-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf\" (UID: \"2b262c2f-5d4e-4060-9ff4-e55d4124b251\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"
Jul 29 20:11:27.100453 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:27.100424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b262c2f-5d4e-4060-9ff4-e55d4124b251-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf\" (UID: \"2b262c2f-5d4e-4060-9ff4-e55d4124b251\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"
Jul 29 20:11:27.101051 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:27.101033    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b262c2f-5d4e-4060-9ff4-e55d4124b251-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf\" (UID: \"2b262c2f-5d4e-4060-9ff4-e55d4124b251\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"
Jul 29 20:11:27.272928 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:27.272872    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"
Jul 29 20:11:27.407476 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:11:27.407435    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b262c2f_5d4e_4060_9ff4_e55d4124b251.slice/crio-490a5ef628d5966e361d31b8c0076b5d1d37b0ab87d76b5a8f4d55a9b8d003f9 WatchSource:0}: Error finding container 490a5ef628d5966e361d31b8c0076b5d1d37b0ab87d76b5a8f4d55a9b8d003f9: Status 404 returned error can't find the container with id 490a5ef628d5966e361d31b8c0076b5d1d37b0ab87d76b5a8f4d55a9b8d003f9
Jul 29 20:11:27.408917 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:27.408893    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"]
Jul 29 20:11:27.993972 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:27.993926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf" event={"ID":"2b262c2f-5d4e-4060-9ff4-e55d4124b251","Type":"ContainerStarted","Data":"b430c9eb11ca7fc07f9f4958ae66fe387650dc8906e3331e95c40eafb0493072"}
Jul 29 20:11:27.994316 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:27.993994    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf" event={"ID":"2b262c2f-5d4e-4060-9ff4-e55d4124b251","Type":"ContainerStarted","Data":"490a5ef628d5966e361d31b8c0076b5d1d37b0ab87d76b5a8f4d55a9b8d003f9"}
Jul 29 20:11:28.010597 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:28.010548    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf" podStartSLOduration=2.01053366 podStartE2EDuration="2.01053366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:11:28.008054424 +0000 UTC m=+3257.928364758" watchObservedRunningTime="2026-07-29 20:11:28.01053366 +0000 UTC m=+3257.930843980"
Jul 29 20:11:29.007760 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:29.007720    2584 generic.go:356] "Generic (PLEG): container finished" podID="2b262c2f-5d4e-4060-9ff4-e55d4124b251" containerID="b430c9eb11ca7fc07f9f4958ae66fe387650dc8906e3331e95c40eafb0493072" exitCode=0
Jul 29 20:11:29.008208 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:29.007811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf" event={"ID":"2b262c2f-5d4e-4060-9ff4-e55d4124b251","Type":"ContainerDied","Data":"b430c9eb11ca7fc07f9f4958ae66fe387650dc8906e3331e95c40eafb0493072"}
Jul 29 20:11:30.150891 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:30.150867    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"
Jul 29 20:11:30.227860 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:30.227837    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b262c2f-5d4e-4060-9ff4-e55d4124b251-maas-api-service-ca\") pod \"2b262c2f-5d4e-4060-9ff4-e55d4124b251\" (UID: \"2b262c2f-5d4e-4060-9ff4-e55d4124b251\") "
Jul 29 20:11:30.228193 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:30.228175    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b262c2f-5d4e-4060-9ff4-e55d4124b251-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b262c2f-5d4e-4060-9ff4-e55d4124b251" (UID: "2b262c2f-5d4e-4060-9ff4-e55d4124b251"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:11:30.329279 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:30.329222    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b262c2f-5d4e-4060-9ff4-e55d4124b251-maas-api-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:11:31.020068 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:31.019987    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"
Jul 29 20:11:31.020068 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:31.020004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf" event={"ID":"2b262c2f-5d4e-4060-9ff4-e55d4124b251","Type":"ContainerDied","Data":"490a5ef628d5966e361d31b8c0076b5d1d37b0ab87d76b5a8f4d55a9b8d003f9"}
Jul 29 20:11:31.020068 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:31.020047    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="490a5ef628d5966e361d31b8c0076b5d1d37b0ab87d76b5a8f4d55a9b8d003f9"
Jul 29 20:11:42.737986 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:42.737954    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"]
Jul 29 20:11:42.741001 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:42.740980    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f0b78f-nwvkf"]
Jul 29 20:11:43.758024 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:43.757988    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:11:44.593557 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:44.593524    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b262c2f-5d4e-4060-9ff4-e55d4124b251" path="/var/lib/kubelet/pods/2b262c2f-5d4e-4060-9ff4-e55d4124b251/volumes"
Jul 29 20:11:54.443179 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:11:54.443148    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:12:10.819385 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:10.819361    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 20:12:10.830215 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:10.830195    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 20:12:32.447712 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.447627    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"]
Jul 29 20:12:32.448137 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.448047    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b262c2f-5d4e-4060-9ff4-e55d4124b251" containerName="revoke-keys"
Jul 29 20:12:32.448137 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.448058    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b262c2f-5d4e-4060-9ff4-e55d4124b251" containerName="revoke-keys"
Jul 29 20:12:32.448137 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.448133    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b262c2f-5d4e-4060-9ff4-e55d4124b251" containerName="revoke-keys"
Jul 29 20:12:32.455902 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.455863    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"
Jul 29 20:12:32.460111 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.460086    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:12:32.460111 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.460093    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jsq2r\""
Jul 29 20:12:32.460703 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.460681    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"]
Jul 29 20:12:32.557477 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.557445    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q\" (UID: \"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"
Jul 29 20:12:32.658914 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.658889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q\" (UID: \"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"
Jul 29 20:12:32.659453 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.659436    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q\" (UID: \"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"
Jul 29 20:12:32.769636 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.769560    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"
Jul 29 20:12:32.945981 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:32.945941    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"]
Jul 29 20:12:32.948842 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:12:32.948813    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9f8541_07a0_4fae_bb4b_8cbfdd7aa026.slice/crio-3a588687e8ec540151b2ee85fac231df18d65c2542e71fc5a285db2ee3f7a504 WatchSource:0}: Error finding container 3a588687e8ec540151b2ee85fac231df18d65c2542e71fc5a285db2ee3f7a504: Status 404 returned error can't find the container with id 3a588687e8ec540151b2ee85fac231df18d65c2542e71fc5a285db2ee3f7a504
Jul 29 20:12:33.369675 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:33.369641    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q" event={"ID":"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026","Type":"ContainerStarted","Data":"18501ca8410c5447e484a53a709800d4dcecdc72b465d8a54c165c19843febf8"}
Jul 29 20:12:33.369806 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:33.369695    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q" event={"ID":"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026","Type":"ContainerStarted","Data":"3a588687e8ec540151b2ee85fac231df18d65c2542e71fc5a285db2ee3f7a504"}
Jul 29 20:12:33.390089 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:33.390049    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q" podStartSLOduration=1.390034763 podStartE2EDuration="1.390034763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:12:33.387313831 +0000 UTC m=+3323.307624151" watchObservedRunningTime="2026-07-29 20:12:33.390034763 +0000 UTC m=+3323.310345082"
Jul 29 20:12:34.376695 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:34.376661    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026" containerID="18501ca8410c5447e484a53a709800d4dcecdc72b465d8a54c165c19843febf8" exitCode=0
Jul 29 20:12:34.377092 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:34.376746    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q" event={"ID":"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026","Type":"ContainerDied","Data":"18501ca8410c5447e484a53a709800d4dcecdc72b465d8a54c165c19843febf8"}
Jul 29 20:12:35.516170 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:35.516148    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"
Jul 29 20:12:35.583926 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:35.583901    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026-maas-api-service-ca\") pod \"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026\" (UID: \"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026\") "
Jul 29 20:12:35.584287 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:35.584268    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026" (UID: "1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:12:35.685539 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:35.685479    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026-maas-api-service-ca\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:36.389864 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:36.389828    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q" event={"ID":"1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026","Type":"ContainerDied","Data":"3a588687e8ec540151b2ee85fac231df18d65c2542e71fc5a285db2ee3f7a504"}
Jul 29 20:12:36.389864 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:36.389862    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"
Jul 29 20:12:36.390065 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:36.389876    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a588687e8ec540151b2ee85fac231df18d65c2542e71fc5a285db2ee3f7a504"
Jul 29 20:12:43.188060 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:43.188022    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"]
Jul 29 20:12:43.194787 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:43.194762    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d9c39-fsr8q"]
Jul 29 20:12:44.594007 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:44.593969    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026" path="/var/lib/kubelet/pods/1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026/volumes"
Jul 29 20:12:46.252257 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:46.252224    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:12:49.834440 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:49.834402    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"]
Jul 29 20:12:49.834845 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:49.834655    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy" containerID="cri-o://19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb" gracePeriod=30
Jul 29 20:12:51.415670 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:51.415629    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 20:12:51.416049 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:51.415704    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:12:55.100452 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.100398    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:12:55.256020 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.255991    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-socket\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256029    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-podinfo\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256051    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvv8g\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-kube-api-access-tvv8g\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256091    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-data\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256111    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-certs\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256128    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-credential-socket\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256155    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-envoy\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256484 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256271    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istiod-ca-cert\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256484 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256293    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:55.256484 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256310    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-token\") pod \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\" (UID: \"0719775e-6bda-4aae-8e40-07f8d39c4d1f\") "
Jul 29 20:12:55.256484 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256418    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:55.256484 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256452    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:55.256762 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256678    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-certs\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.256762 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256700    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-credential-socket\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.256762 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256714    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-workload-socket\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.256941 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.256791    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:12:55.257126 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.257102    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:55.258446 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.258423    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:12:55.258519 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.258463    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:55.258641 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.258622    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:12:55.258743 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.258726    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-kube-api-access-tvv8g" (OuterVolumeSpecName: "kube-api-access-tvv8g") pod "0719775e-6bda-4aae-8e40-07f8d39c4d1f" (UID: "0719775e-6bda-4aae-8e40-07f8d39c4d1f"). InnerVolumeSpecName "kube-api-access-tvv8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:12:55.357791 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.357707    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istiod-ca-cert\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.357791 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.357737    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-token\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.357791 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.357748    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-podinfo\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.357791 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.357760    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvv8g\" (UniqueName: \"kubernetes.io/projected/0719775e-6bda-4aae-8e40-07f8d39c4d1f-kube-api-access-tvv8g\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.357791 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.357773    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-data\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.357791 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.357788    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0719775e-6bda-4aae-8e40-07f8d39c4d1f-istio-envoy\") on node \"ip-10-0-140-204.ec2.internal\" DevicePath \"\""
Jul 29 20:12:55.507943 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.507908    2584 generic.go:356] "Generic (PLEG): container finished" podID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerID="19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb" exitCode=0
Jul 29 20:12:55.508101 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.507958    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"
Jul 29 20:12:55.508101 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.507980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" event={"ID":"0719775e-6bda-4aae-8e40-07f8d39c4d1f","Type":"ContainerDied","Data":"19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb"}
Jul 29 20:12:55.508101 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.508022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8" event={"ID":"0719775e-6bda-4aae-8e40-07f8d39c4d1f","Type":"ContainerDied","Data":"d89a2de7e06405001611e75ab37a77b6fd96f35e2f571dc8908e9bedaf5b0cb7"}
Jul 29 20:12:55.508101 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.508046    2584 scope.go:117] "RemoveContainer" containerID="19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb"
Jul 29 20:12:55.518059 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.518038    2584 scope.go:117] "RemoveContainer" containerID="79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2"
Jul 29 20:12:55.526804 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.526789    2584 scope.go:117] "RemoveContainer" containerID="19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb"
Jul 29 20:12:55.527032 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:12:55.527016    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb\": container with ID starting with 19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb not found: ID does not exist" containerID="19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb"
Jul 29 20:12:55.527080 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.527040    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb"} err="failed to get container status \"19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb\": rpc error: code = NotFound desc = could not find container \"19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb\": container with ID starting with 19868f1dbc10579e75539d2cf49cec1ee2cd5c0f078bc99839aa432f60b40ebb not found: ID does not exist"
Jul 29 20:12:55.527080 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.527056    2584 scope.go:117] "RemoveContainer" containerID="79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2"
Jul 29 20:12:55.527252 ip-10-0-140-204 kubenswrapper[2584]: E0729 20:12:55.527231    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2\": container with ID starting with 79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2 not found: ID does not exist" containerID="79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2"
Jul 29 20:12:55.527300 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.527256    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2"} err="failed to get container status \"79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2\": rpc error: code = NotFound desc = could not find container \"79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2\": container with ID starting with 79bbc55adcb4a87088f08e9d605500c933b44654fd416b96038ad2d09497c0d2 not found: ID does not exist"
Jul 29 20:12:55.530651 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.530629    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"]
Jul 29 20:12:55.534681 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:55.534660    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d9c39-openshift-default-69d6785f56-p8kl8"]
Jul 29 20:12:56.593579 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:12:56.593544    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" path="/var/lib/kubelet/pods/0719775e-6bda-4aae-8e40-07f8d39c4d1f/volumes"
Jul 29 20:13:00.953703 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:00.953672    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"]
Jul 29 20:13:00.956674 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:00.956649    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-641e39-29755920-5n5gm"]
Jul 29 20:13:02.593298 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:02.593269    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5090a638-b709-48a5-9a81-c7200845c95d" path="/var/lib/kubelet/pods/5090a638-b709-48a5-9a81-c7200845c95d/volumes"
Jul 29 20:13:03.752198 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:03.752167    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:13:10.950914 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:10.950887    2584 scope.go:117] "RemoveContainer" containerID="76f6e94cb155eaa69f537e3ecc2bb5aa41a1d02413b56c7e926f05e0f5b234db"
Jul 29 20:13:19.057582 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:19.057545    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"]
Jul 29 20:13:19.059495 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:19.059469    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4c787c-29755920-dqc2f"]
Jul 29 20:13:20.593853 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:20.593812    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b4171d-0613-4e56-a887-33c933078742" path="/var/lib/kubelet/pods/c8b4171d-0613-4e56-a887-33c933078742/volumes"
Jul 29 20:13:21.952679 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:21.952648    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tm6g6"]
Jul 29 20:13:26.838468 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:26.838440    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb554dd78-6n7j8_be42da00-78be-41e9-badd-27afae6d777c/authorino/0.log"
Jul 29 20:13:31.942299 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:31.942267    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ht85b_e19572df-33a4-48c1-abd3-2b8150da8709/manager/0.log"
Jul 29 20:13:32.057488 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:32.057463    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ntksw_23e0d45b-ca78-4c71-abff-87c428f327d3/manager/0.log"
Jul 29 20:13:32.301869 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:32.301802    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gxvm5_4172f78d-ec8e-4e6a-8d48-d2b46860a57d/server/0.log"
Jul 29 20:13:32.426856 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:32.426828    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-q4frk_13dba57e-4f5b-4a75-b69c-6baa097ad3b5/manager/0.log"
Jul 29 20:13:32.810343 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:32.810316    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d84699fcf-xwtjf_0203bb99-ad03-4b85-b5a5-a0f57aa7bef9/manager/0.log"
Jul 29 20:13:32.818411 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:32.818389    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d84699fcf-xwtjf_0203bb99-ad03-4b85-b5a5-a0f57aa7bef9/copy-manifests/0.log"
Jul 29 20:13:33.483873 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:33.483845    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755920-tcxm8_016a7324-b182-4e98-8ed4-2911ffa2dfaf/cleanup/0.log"
Jul 29 20:13:34.824814 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:34.824781    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb554dd78-6n7j8_be42da00-78be-41e9-badd-27afae6d777c/authorino/0.log"
Jul 29 20:13:34.938616 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:34.938580    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qvq6q_77a236d1-c500-45ea-9b19-8411ec50f0d6/manager/0.log"
Jul 29 20:13:35.046554 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:35.046529    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kqw92_590531a6-9dc1-4837-a1ef-4615cf885429/manager/0.log"
Jul 29 20:13:35.256402 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:35.256371    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qbcjg_b35a7c47-8a86-417f-bf35-d3add65170c7/registry-server/0.log"
Jul 29 20:13:35.369633 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:35.369588    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tnrnp_3ecdbadf-b610-42fb-b374-6371953cc905/manager/0.log"
Jul 29 20:13:35.494199 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:35.494171    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tm6g6_2fbc3e32-7933-45b4-bbb8-55a818b8e74e/limitador/0.log"
Jul 29 20:13:35.602822 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:35.602798    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xttn9_02c71601-6274-4e42-a661-1604e4ed5740/manager/0.log"
Jul 29 20:13:36.159090 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:36.159063    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d594574db-gkqdq_d823049a-ebb9-45ad-9af6-44ea8f9e5b6f/kube-auth-proxy/0.log"
Jul 29 20:13:36.376439 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:36.376409    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wq7xh_1eecf46a-deae-41ac-9a62-7aa07895ec40/istio-proxy/1.log"
Jul 29 20:13:37.139382 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:37.139346    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5lwrj_69a4df5f-ed8b-4e61-a916-781dcb7e7df7/main/0.log"
Jul 29 20:13:37.457693 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:37.457586    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nm9gs_080c8754-d107-448b-812b-700de4b4defa/main/0.log"
Jul 29 20:13:45.654766 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:45.654726    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fqssn_9a07531d-5792-4873-941d-1887f0064274/global-pull-secret-syncer/0.log"
Jul 29 20:13:45.908023 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:45.907947    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nf459_1c827d0c-9815-4704-9817-88506748f26d/konnectivity-agent/0.log"
Jul 29 20:13:45.988529 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:45.988505    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-204.ec2.internal_7d990f6501778c29228144bf34cfedd5/haproxy/0.log"
Jul 29 20:13:49.894741 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:49.894708    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb554dd78-6n7j8_be42da00-78be-41e9-badd-27afae6d777c/authorino/0.log"
Jul 29 20:13:50.049710 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:50.049683    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qvq6q_77a236d1-c500-45ea-9b19-8411ec50f0d6/manager/0.log"
Jul 29 20:13:50.089472 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:50.089448    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kqw92_590531a6-9dc1-4837-a1ef-4615cf885429/manager/0.log"
Jul 29 20:13:50.221707 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:50.221649    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qbcjg_b35a7c47-8a86-417f-bf35-d3add65170c7/registry-server/0.log"
Jul 29 20:13:50.428459 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:50.428427    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tnrnp_3ecdbadf-b610-42fb-b374-6371953cc905/manager/0.log"
Jul 29 20:13:50.494268 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:50.494202    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tm6g6_2fbc3e32-7933-45b4-bbb8-55a818b8e74e/limitador/0.log"
Jul 29 20:13:50.578517 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:50.578496    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xttn9_02c71601-6274-4e42-a661-1604e4ed5740/manager/0.log"
Jul 29 20:13:52.219254 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.219219    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2b0077aa-7862-4d41-ad7e-dfe327c5da4c/alertmanager/0.log"
Jul 29 20:13:52.247131 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.247101    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2b0077aa-7862-4d41-ad7e-dfe327c5da4c/config-reloader/0.log"
Jul 29 20:13:52.270971 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.270947    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2b0077aa-7862-4d41-ad7e-dfe327c5da4c/kube-rbac-proxy-web/0.log"
Jul 29 20:13:52.300507 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.300487    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2b0077aa-7862-4d41-ad7e-dfe327c5da4c/kube-rbac-proxy/0.log"
Jul 29 20:13:52.334260 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.334246    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2b0077aa-7862-4d41-ad7e-dfe327c5da4c/kube-rbac-proxy-metric/0.log"
Jul 29 20:13:52.367878 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.367853    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2b0077aa-7862-4d41-ad7e-dfe327c5da4c/prom-label-proxy/0.log"
Jul 29 20:13:52.399223 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.399201    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2b0077aa-7862-4d41-ad7e-dfe327c5da4c/init-config-reloader/0.log"
Jul 29 20:13:52.446173 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.446140    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-ghm2l_b81d897c-042e-449b-a56f-333ab4d4728e/cluster-monitoring-operator/0.log"
Jul 29 20:13:52.559352 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.559297    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6577d77d4f-hn76d_e7fe204f-2b4b-46d0-a671-899d4d3e0619/metrics-server/0.log"
Jul 29 20:13:52.673353 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.673333    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dkkd_b33220c0-48e3-4cb0-8c25-1d4cf40e3d85/node-exporter/0.log"
Jul 29 20:13:52.694942 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.694927    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dkkd_b33220c0-48e3-4cb0-8c25-1d4cf40e3d85/kube-rbac-proxy/0.log"
Jul 29 20:13:52.722713 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.722691    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dkkd_b33220c0-48e3-4cb0-8c25-1d4cf40e3d85/init-textfile/0.log"
Jul 29 20:13:52.943406 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.943383    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-tm9d6_e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d/kube-rbac-proxy-main/0.log"
Jul 29 20:13:52.970772 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:52.970736    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-tm9d6_e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d/kube-rbac-proxy-self/0.log"
Jul 29 20:13:53.013759 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.013736    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-tm9d6_e05ddb6d-5fb2-4f47-a5cd-21f41e89df6d/openshift-state-metrics/0.log"
Jul 29 20:13:53.342234 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.342204    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-hfp9q_71179293-1931-424a-9e76-08cd2c6bbb52/prometheus-operator-admission-webhook/0.log"
Jul 29 20:13:53.379235 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.379211    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c97565c75-jpntk_77ba0ef7-ba88-437c-8f50-dbb8090b849f/telemeter-client/0.log"
Jul 29 20:13:53.403976 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.403953    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c97565c75-jpntk_77ba0ef7-ba88-437c-8f50-dbb8090b849f/reload/0.log"
Jul 29 20:13:53.430204 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.430187    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c97565c75-jpntk_77ba0ef7-ba88-437c-8f50-dbb8090b849f/kube-rbac-proxy/0.log"
Jul 29 20:13:53.461757 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.461738    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd5649c67-db6kz_26178a4e-af3b-4f7b-88c5-3f002abee89a/thanos-query/0.log"
Jul 29 20:13:53.487235 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.487205    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd5649c67-db6kz_26178a4e-af3b-4f7b-88c5-3f002abee89a/kube-rbac-proxy-web/0.log"
Jul 29 20:13:53.513988 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.513969    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd5649c67-db6kz_26178a4e-af3b-4f7b-88c5-3f002abee89a/kube-rbac-proxy/0.log"
Jul 29 20:13:53.541104 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.541083    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd5649c67-db6kz_26178a4e-af3b-4f7b-88c5-3f002abee89a/prom-label-proxy/0.log"
Jul 29 20:13:53.568922 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.568903    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd5649c67-db6kz_26178a4e-af3b-4f7b-88c5-3f002abee89a/kube-rbac-proxy-rules/0.log"
Jul 29 20:13:53.588251 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:53.588238    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bd5649c67-db6kz_26178a4e-af3b-4f7b-88c5-3f002abee89a/kube-rbac-proxy-metrics/0.log"
Jul 29 20:13:55.503987 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:55.503954    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/1.log"
Jul 29 20:13:55.509191 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:55.509170    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgbql_3f28a200-de12-4d8c-9cdd-3f2fbe64ce3b/console-operator/2.log"
Jul 29 20:13:56.208899 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.208866    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"]
Jul 29 20:13:56.209304 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.209292    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy"
Jul 29 20:13:56.209352 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.209307    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy"
Jul 29 20:13:56.209352 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.209315    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026" containerName="revoke-keys"
Jul 29 20:13:56.209352 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.209322    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026" containerName="revoke-keys"
Jul 29 20:13:56.209449 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.209401    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d9f8541-07a0-4fae-bb4b-8cbfdd7aa026" containerName="revoke-keys"
Jul 29 20:13:56.209449 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.209410    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0719775e-6bda-4aae-8e40-07f8d39c4d1f" containerName="istio-proxy"
Jul 29 20:13:56.211805 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.211786    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.214708 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.214687    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7np8j\"/\"openshift-service-ca.crt\""
Jul 29 20:13:56.215366 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.215349    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7np8j\"/\"kube-root-ca.crt\""
Jul 29 20:13:56.216732 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.216711    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7np8j\"/\"default-dockercfg-xfh45\""
Jul 29 20:13:56.227929 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.227910    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"]
Jul 29 20:13:56.363503 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.363482    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-proc\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.363649 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.363509    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-sys\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.363649 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.363556    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-podres\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.363649 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.363629    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-lib-modules\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.363649 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.363645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7jnz\" (UniqueName: \"kubernetes.io/projected/528c0a00-7fc4-4f96-9e34-023c9cb00abe-kube-api-access-x7jnz\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464098    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-proc\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464163 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-sys\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464325 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464172    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-proc\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464325 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-podres\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464325 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464220    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-sys\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464325 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-lib-modules\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464325 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7jnz\" (UniqueName: \"kubernetes.io/projected/528c0a00-7fc4-4f96-9e34-023c9cb00abe-kube-api-access-x7jnz\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464513 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464339    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-podres\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.464513 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.464444    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/528c0a00-7fc4-4f96-9e34-023c9cb00abe-lib-modules\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.472637 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.472619    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7jnz\" (UniqueName: \"kubernetes.io/projected/528c0a00-7fc4-4f96-9e34-023c9cb00abe-kube-api-access-x7jnz\") pod \"perf-node-gather-daemonset-fpkx4\" (UID: \"528c0a00-7fc4-4f96-9e34-023c9cb00abe\") " pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.521659 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.521640    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.656411 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.656387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"]
Jul 29 20:13:56.658390 ip-10-0-140-204 kubenswrapper[2584]: W0729 20:13:56.658362    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod528c0a00_7fc4_4f96_9e34_023c9cb00abe.slice/crio-9c18da95817948ad2dfb7cfebac332cf5a1b324c917ad176a630bd0ce89173b8 WatchSource:0}: Error finding container 9c18da95817948ad2dfb7cfebac332cf5a1b324c917ad176a630bd0ce89173b8: Status 404 returned error can't find the container with id 9c18da95817948ad2dfb7cfebac332cf5a1b324c917ad176a630bd0ce89173b8
Jul 29 20:13:56.858421 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.858393    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4" event={"ID":"528c0a00-7fc4-4f96-9e34-023c9cb00abe","Type":"ContainerStarted","Data":"8159a50eb66a117e2fe79dfd7a009d653223c3b091e3c2f4400e481ac2e2a2a0"}
Jul 29 20:13:56.858522 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.858453    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4" event={"ID":"528c0a00-7fc4-4f96-9e34-023c9cb00abe","Type":"ContainerStarted","Data":"9c18da95817948ad2dfb7cfebac332cf5a1b324c917ad176a630bd0ce89173b8"}
Jul 29 20:13:56.858522 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.858488    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:13:56.891578 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.891552    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-7gjb7_678d1584-4ebe-4820-b648-28dc34191b40/volume-data-source-validator/0.log"
Jul 29 20:13:56.900259 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:56.900222    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4" podStartSLOduration=0.900207774 podStartE2EDuration="900.207774ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:13:56.899995149 +0000 UTC m=+3406.820305470" watchObservedRunningTime="2026-07-29 20:13:56.900207774 +0000 UTC m=+3406.820518120"
Jul 29 20:13:58.071341 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:58.071318    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v8h5x_589ae4b3-0f85-479b-af86-4e5dc69766e2/dns/0.log"
Jul 29 20:13:58.094780 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:58.094756    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v8h5x_589ae4b3-0f85-479b-af86-4e5dc69766e2/kube-rbac-proxy/0.log"
Jul 29 20:13:58.151051 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:58.151027    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p5gsl_d82635f6-4578-42e2-9ea8-4183e286887c/dns-node-resolver/0.log"
Jul 29 20:13:58.753573 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:58.753540    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5dc6cc454f-59dcj_b363d194-6b82-43dd-899b-8114d9b70dd7/registry/0.log"
Jul 29 20:13:58.832147 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:58.832120    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hj4d7_388b2184-94cf-4f9f-89a9-8fbb36be29e5/node-ca/0.log"
Jul 29 20:13:59.952748 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:13:59.952719    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d594574db-gkqdq_d823049a-ebb9-45ad-9af6-44ea8f9e5b6f/kube-auth-proxy/0.log"
Jul 29 20:14:00.008379 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:00.008357    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wq7xh_1eecf46a-deae-41ac-9a62-7aa07895ec40/istio-proxy/0.log"
Jul 29 20:14:00.033709 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:00.033677    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wq7xh_1eecf46a-deae-41ac-9a62-7aa07895ec40/istio-proxy/1.log"
Jul 29 20:14:00.992776 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:00.992739    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j8552_030f3207-da35-4ddf-95ba-4913da56f008/serve-healthcheck-canary/0.log"
Jul 29 20:14:01.638808 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:01.638780    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrjst_9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7/kube-rbac-proxy/0.log"
Jul 29 20:14:01.662287 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:01.662256    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrjst_9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7/exporter/0.log"
Jul 29 20:14:01.692699 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:01.692679    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrjst_9c478e14-80ad-47b4-8bac-5ddaf7a7b8f7/extractor/0.log"
Jul 29 20:14:02.875495 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:02.875417    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7np8j/perf-node-gather-daemonset-fpkx4"
Jul 29 20:14:03.999734 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:03.999701    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ht85b_e19572df-33a4-48c1-abd3-2b8150da8709/manager/0.log"
Jul 29 20:14:04.207200 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:04.207173    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ntksw_23e0d45b-ca78-4c71-abff-87c428f327d3/manager/0.log"
Jul 29 20:14:04.362312 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:04.362287    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gxvm5_4172f78d-ec8e-4e6a-8d48-d2b46860a57d/server/0.log"
Jul 29 20:14:04.437036 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:04.437004    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-q4frk_13dba57e-4f5b-4a75-b69c-6baa097ad3b5/manager/0.log"
Jul 29 20:14:04.669943 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:04.669871    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d84699fcf-xwtjf_0203bb99-ad03-4b85-b5a5-a0f57aa7bef9/manager/0.log"
Jul 29 20:14:04.703209 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:04.703186    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d84699fcf-xwtjf_0203bb99-ad03-4b85-b5a5-a0f57aa7bef9/copy-manifests/0.log"
Jul 29 20:14:06.223437 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:06.223411    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cpf7l_6d8b2bfa-2130-42ca-b6b4-92ffed9f4c59/openshift-lws-operator/0.log"
Jul 29 20:14:06.419476 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:06.419450    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d594574db-gkqdq_d823049a-ebb9-45ad-9af6-44ea8f9e5b6f/kube-auth-proxy/0.log"
Jul 29 20:14:06.477002 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:06.476933    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wq7xh_1eecf46a-deae-41ac-9a62-7aa07895ec40/istio-proxy/0.log"
Jul 29 20:14:06.503293 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:06.503268    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wq7xh_1eecf46a-deae-41ac-9a62-7aa07895ec40/istio-proxy/1.log"
Jul 29 20:14:08.103388 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:08.103293    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d594574db-gkqdq_d823049a-ebb9-45ad-9af6-44ea8f9e5b6f/kube-auth-proxy/0.log"
Jul 29 20:14:08.139655 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:08.139628    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wq7xh_1eecf46a-deae-41ac-9a62-7aa07895ec40/istio-proxy/0.log"
Jul 29 20:14:08.172011 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:08.171984    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wq7xh_1eecf46a-deae-41ac-9a62-7aa07895ec40/istio-proxy/1.log"
Jul 29 20:14:10.977775 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:10.977740    2584 scope.go:117] "RemoveContainer" containerID="9bd9a4c5b0561d55608951c1ee73c150dc04ec6b82761453fe8b972c2f03872b"
Jul 29 20:14:11.636503 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:11.636469    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98_32a75a3f-4a90-42e5-b202-d487db4bfc3f/kube-storage-version-migrator-operator/1.log"
Jul 29 20:14:11.637215 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:11.637194    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-vvl98_32a75a3f-4a90-42e5-b202-d487db4bfc3f/kube-storage-version-migrator-operator/0.log"
Jul 29 20:14:12.752715 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:12.752687    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nw4df_28dc1b0f-8979-4f98-b118-eb9741c6c1ca/kube-multus-additional-cni-plugins/0.log"
Jul 29 20:14:12.775243 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:12.775213    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nw4df_28dc1b0f-8979-4f98-b118-eb9741c6c1ca/egress-router-binary-copy/0.log"
Jul 29 20:14:12.797344 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:12.797325    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nw4df_28dc1b0f-8979-4f98-b118-eb9741c6c1ca/cni-plugins/0.log"
Jul 29 20:14:12.818109 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:12.818089    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nw4df_28dc1b0f-8979-4f98-b118-eb9741c6c1ca/bond-cni-plugin/0.log"
Jul 29 20:14:12.839334 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:12.839316    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nw4df_28dc1b0f-8979-4f98-b118-eb9741c6c1ca/routeoverride-cni/0.log"
Jul 29 20:14:12.860078 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:12.860060    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nw4df_28dc1b0f-8979-4f98-b118-eb9741c6c1ca/whereabouts-cni-bincopy/0.log"
Jul 29 20:14:12.886693 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:12.886675    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nw4df_28dc1b0f-8979-4f98-b118-eb9741c6c1ca/whereabouts-cni/0.log"
Jul 29 20:14:13.137747 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:13.137724    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tgrrq_96bd8941-f472-4650-99aa-0dd551105ee8/kube-multus/0.log"
Jul 29 20:14:13.250208 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:13.250180    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mtcn6_005fe08a-66f3-4973-884c-26ed86e6fa5f/network-metrics-daemon/0.log"
Jul 29 20:14:13.270590 ip-10-0-140-204 kubenswrapper[2584]: I0729 20:14:13.270568    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mtcn6_005fe08a-66f3-4973-884c-26ed86e6fa5f/kube-rbac-proxy/0.log"