Jul 16 00:11:01.040476 ip-10-0-140-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 00:11:01.040490 ip-10-0-140-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 00:11:01.040497 ip-10-0-140-233 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 00:11:01.040863 ip-10-0-140-233 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 00:11:11.223768 ip-10-0-140-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 00:11:11.223784 ip-10-0-140-233 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 132ab3059f18449fa44e19c58a95126f --
Jul 16 00:13:14.310981 ip-10-0-140-233 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 00:13:14.700051 ip-10-0-140-233 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 00:13:14.700051 ip-10-0-140-233 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 00:13:14.700051 ip-10-0-140-233 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 00:13:14.700051 ip-10-0-140-233 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 00:13:14.700051 ip-10-0-140-233 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 00:13:14.700716 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.700063    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 00:13:14.707620 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707584    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:13:14.707620 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707616    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:13:14.707620 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707621    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:13:14.707620 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707624    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:13:14.707620 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707627    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707632    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707637    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707640    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707643    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707646    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707648    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707652    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707654    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707657    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707660    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707662    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707666    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707669    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707671    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707674    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707676    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707679    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707682    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:13:14.707813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707684    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707687    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707693    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707696    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707699    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707701    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707704    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707707    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707710    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707712    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707715    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707717    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707722    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707725    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707729    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707732    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707735    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707738    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707741    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:13:14.708275 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707744    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707747    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707749    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707752    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707754    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707757    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707760    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707762    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707765    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707768    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707770    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707773    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707776    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707778    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707781    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707783    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707786    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707790    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707793    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:13:14.708747 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707796    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707798    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707801    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707803    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707806    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707808    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707811    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707814    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707817    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707820    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707823    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707826    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707828    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707831    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707834    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707837    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707840    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707842    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707845    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707848    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:13:14.709217 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707850    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707853    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707856    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707858    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707861    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707864    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707866    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707870    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707873    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707875    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707878    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707881    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707884    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707887    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707889    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707892    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707894    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.707897    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708594    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708601    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:13:14.709706 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708624    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708629    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708636    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708641    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708643    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708646    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708649    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708652    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708654    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708657    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708659    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708662    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708665    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708667    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708670    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708674    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708676    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708679    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708682    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708685    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:13:14.710224 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708687    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708690    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708692    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708695    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708697    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708700    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708702    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708705    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708707    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708709    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708712    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708714    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708719    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708722    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708725    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708728    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708731    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708734    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708736    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708739    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:13:14.710737 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708741    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708744    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708746    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708749    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708752    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708754    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708757    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708760    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708763    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708765    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708768    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708771    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708773    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708775    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708778    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708780    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708783    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708785    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708788    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708790    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:13:14.711262 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708793    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708795    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708798    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708801    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708804    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708807    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708810    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708813    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708816    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708818    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708821    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708823    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708828    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708832    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708835    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708838    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708841    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708844    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708847    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:13:14.711850 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708849    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708851    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708855    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708858    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708861    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708863    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708866    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708868    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708871    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708873    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708876    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708878    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708881    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708883    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708886    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708890    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708894    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.708897    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709270    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709275    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:13:14.712296 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709279    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709282    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709285    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709288    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709291    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709294    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709296    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709300    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709303    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709306    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709309    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709311    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709314    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709316    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709322    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709325    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709328    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709330    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709333    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709335    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:13:14.712787 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709338    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709341    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709343    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709346    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709349    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709352    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709354    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709357    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709360    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709362    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709365    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709368    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709372    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709375    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709378    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709381    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709384    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709387    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709391    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:13:14.713272 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709394    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709396    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709399    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709402    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709405    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709407    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709409    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709412    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709415    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709418    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709420    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709423    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709425    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709428    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709430    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709433    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709435    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709438    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709441    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709443    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:13:14.713741 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709445    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709450    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709452    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709455    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709457    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709460    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709462    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709465    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709467    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709470    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709472    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709475    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709477    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709480    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709483    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709485    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709487    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709490    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709492    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709495    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:13:14.714216 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709497    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709500    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709503    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709506    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709508    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709511    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709513    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709516    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709520    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709524    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709527    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709530    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709532    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709537    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709540    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709543    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709547    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.709550    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709643    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709651    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 00:13:14.714704 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709658    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709663    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709667    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709670    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709674    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709678    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709681    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709684    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709687    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709691    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709694    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709696    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709699    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709702    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709705    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709708    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709712    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709715    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709718    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709721    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709728    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709732    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709735    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 00:13:14.715192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709737    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709741    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709745    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709748    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709750    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709753    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709756    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709760    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709763    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709766    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709769    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709772    2556 flags.go:64] FLAG: --enable-server="true"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709775    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709779    2556 flags.go:64] FLAG: --event-burst="100"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709782    2556 flags.go:64] FLAG: --event-qps="50"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709785    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709788    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709791    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709795    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709798    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709801    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709804    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709807    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709809    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709813    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 00:13:14.715777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709816    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709823    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709826    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709829    2556 flags.go:64] FLAG: --feature-gates=""
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709834    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709837    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709840    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709843    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709845    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709849    2556 flags.go:64] FLAG: --help="false"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709852    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-140-233.ec2.internal"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709855    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709858    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709861    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709864    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709868    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709870    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709873    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709875    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709878    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709881    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709884    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709887    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709889    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 00:13:14.716384 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709892    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709895    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709898    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709900    2556 flags.go:64] FLAG: --lock-file=""
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709903    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709906    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709909    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709914    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709917    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709920    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709922    2556 flags.go:64] FLAG: --logging-format="text"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709925    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709930    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709932    2556 flags.go:64] FLAG: --manifest-url=""
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709935    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709939    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709942    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709946    2556 flags.go:64] FLAG: --max-pods="110"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709949    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709952    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709955    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709957    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709960    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709963    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709966    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 00:13:14.716991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709972    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709975    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709978    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709981    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709984    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709989    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709991    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709994    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.709997    2556 flags.go:64] FLAG: --port="10250"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710000    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710002    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc0c8dcf16401a2b"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710006    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710008    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710011    2556 flags.go:64] FLAG: --register-node="true"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710014    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710018    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710021    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710024    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710027    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710030    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710034    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710037    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710040    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710042    2556 flags.go:64] FLAG: --runonce="false"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710045    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 00:13:14.717587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710048    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710051    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710054    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710056    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710060    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710063    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710066    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710068    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710071    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710074    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710076    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710079    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710082    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710085    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710090    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710092    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710095    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710099    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710101    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710104    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710106    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710109    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710112    2556 flags.go:64] FLAG: --v="2"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710116    2556 flags.go:64] FLAG: --version="false"
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710120    2556 flags.go:64] FLAG: --vmodule=""
Jul 16 00:13:14.718204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710124    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710127    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710243    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710247    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710250    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710255    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710258    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710260    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710263    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710268    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710272    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710275    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710277    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710280    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710283    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710286    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710289    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710292    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710294    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710297    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:13:14.718854 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710299    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710302    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710304    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710307    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710310    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710312    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710315    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710317    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710320    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710322    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710325    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710329    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710332    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710335    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710339    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710342    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710344    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710348    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710350    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710353    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:13:14.719341 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710356    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710358    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710361    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710363    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710366    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710369    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710371    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710374    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710376    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710379    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710381    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710384    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710386    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710389    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710391    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710394    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710397    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710399    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710402    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:13:14.719909 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710404    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710407    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710409    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710412    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710414    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710417    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710419    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710423    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710426    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710428    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710432    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710435    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710438    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710440    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710443    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710445    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710448    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710450    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710453    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:13:14.720370 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710456    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710458    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710462    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710465    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710468    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710471    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710474    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710477    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710479    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710482    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710485    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710488    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710490    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710492    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710495    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710497    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710500    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710503    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710505    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710508    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:13:14.720833 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710512    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710515    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.710517    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.710524    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.717558    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.717576    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.718346    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.718354    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718417    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718422    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718426    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718429    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718432    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718435    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718438    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:13:14.721317 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718440    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718443    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718446    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718448    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718451    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718453    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718456    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718459    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718462    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718464    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718467    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718469    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718472    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718474    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718477    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718480    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718483    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718485    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718488    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718491    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:13:14.721699 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718493    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718496    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718505    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718508    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718512    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718516    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718519    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718522    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718525    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718528    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718530    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718533    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718536    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718538    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718541    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718543    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718546    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718549    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718551    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:13:14.722171 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718553    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718556    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718558    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718561    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718563    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718566    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718568    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718571    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718573    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718576    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718578    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718582    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718585    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718588    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718591    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718594    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718614    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718617    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718620    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718623    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:13:14.722702 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718626    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718629    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718632    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718634    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718637    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718640    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718643    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718645    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718648    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718650    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718653    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718655    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718658    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718660    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718663    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718666    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718668    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718670    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718673    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718676    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:13:14.723204 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718678    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718681    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718683    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718686    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718688    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718691    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718694    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718697    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718701    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718712    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718715    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718718    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718721    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.718726    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 00:13:14.723704 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718865    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718872    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718876    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718878    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718881    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718884    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718887    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718890    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718892    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718895    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718898    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718900    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718903    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718905    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718908    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718910    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718913    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718915    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718918    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718922    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 00:13:14.724045 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718925    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718929    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718933    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718936    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718939    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718942    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718945    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718948    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718957    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718960    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718962    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718965    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718968    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718970    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718973    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718975    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718978    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718980    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718983    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 00:13:14.724520 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718985    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718988    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718991    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718993    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718995    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.718998    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719000    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719003    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719005    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719008    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719010    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719013    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719015    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719018    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719020    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719023    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719026    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719028    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719030    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719033    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 00:13:14.724986 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719035    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719038    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719048    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719051    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719053    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719056    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719058    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719061    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719063    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719065    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719068    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719070    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719073    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719076    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719078    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719081    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719083    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719085    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719088    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719091    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 00:13:14.725448 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719093    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719096    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719098    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719101    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719113    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719117    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719120    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719123    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719125    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719127    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719131    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719135    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719138    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719141    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719143    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719153    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719155    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719158    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719160    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 00:13:14.725956 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:14.719163    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 00:13:14.726448 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.719167    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 00:13:14.726448 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.719283    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 00:13:14.726448 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.721335    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 00:13:14.726448 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.722582    2556 server.go:1019] "Starting client certificate rotation"
Jul 16 00:13:14.726448 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.722660    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 00:13:14.726448 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.722709    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 00:13:14.726448 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.725947    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 00:13:14.730904 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.730883    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 00:13:14.739112 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.739063    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 16 00:13:14.741100 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.741084    2556 log.go:25] "Validated CRI v1 image API"
Jul 16 00:13:14.741945 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.741930    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 00:13:14.747007 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.746984    2556 fs.go:135] Filesystem UUIDs: map[59b38447-ace5-4d1e-850d-38f3d75c2c9f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f7dcdd0a-9ff6-4dee-b67d-711981982ebd:/dev/nvme0n1p3]
Jul 16 00:13:14.747066 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.747007    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 00:13:14.750761 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.750743    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 00:13:14.752039 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.751934    2556 manager.go:216] Machine: {Timestamp:2026-07-16 00:13:14.750667198 +0000 UTC m=+0.322263489 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100549 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21faac74d237288e434d9db2bb20b0 SystemUUID:ec21faac-74d2-3728-8e43-4d9db2bb20b0 BootID:132ab305-9f18-449f-a44e-19c58a95126f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ec:98:9b:f9:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ec:98:9b:f9:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:b2:c7:d6:ad:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 00:13:14.752039 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.752033    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 00:13:14.752140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.752129    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 00:13:14.755287 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.755266    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 00:13:14.755415 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.755289    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 00:13:14.756469 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.756459    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 00:13:14.756501 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.756473    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 00:13:14.756501 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.756480    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 00:13:14.757337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.757326    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 00:13:14.758746 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.758737    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 00:13:14.761716 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.761704    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 00:13:14.761957 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.761947    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 00:13:14.761989 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.761977    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 00:13:14.761989 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.761987    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 00:13:14.762041 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.761998    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 00:13:14.762041 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.762007    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 16 00:13:14.762041 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.762016    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 00:13:14.762477 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.762459    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 00:13:14.762586 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.762485    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 00:13:14.765390 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.765374    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 00:13:14.767052 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767039    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 00:13:14.767095 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767070    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 00:13:14.767234 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767224    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 00:13:14.767281 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767238    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 00:13:14.767281 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767244    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 00:13:14.767281 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767249    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 00:13:14.767281 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767257    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 00:13:14.767281 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767262    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 00:13:14.767808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767799    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 00:13:14.767808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767809    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 00:13:14.767869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767815    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 00:13:14.767869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767821    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 00:13:14.767869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767829    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 00:13:14.767869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.767837    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 00:13:14.768349 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.768334    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg246"
Jul 16 00:13:14.769254 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.769244    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 00:13:14.769293 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.769257    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 00:13:14.772433 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.772421    2556 server.go:1268] "Started kubelet"
Jul 16 00:13:14.772542 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.772513    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 00:13:14.772652 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.772560    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 00:13:14.772652 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.772553    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 00:13:14.776673 ip-10-0-140-233 systemd[1]: Started Kubernetes Kubelet.
Jul 16 00:13:14.776843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.776823    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 00:13:14.777926 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.777906    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg246"
Jul 16 00:13:14.778918 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.778900    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 00:13:14.779329 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.779308    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 00:13:14.779413 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.779316    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 00:13:14.779413 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.779354    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 00:13:14.780892 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.780844    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 00:13:14.782659 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.782641    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 00:13:14.782758 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.782646    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 00:13:14.783057 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.783038    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:14.783265 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.782307    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-233.ec2.internal.18c29cca3a96533e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-233.ec2.internal,UID:ip-10-0-140-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-233.ec2.internal,},FirstTimestamp:2026-07-16 00:13:14.772394814 +0000 UTC m=+0.343991107,LastTimestamp:2026-07-16 00:13:14.772394814 +0000 UTC m=+0.343991107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-233.ec2.internal,}"
Jul 16 00:13:14.783265 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.783260    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 00:13:14.783431 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.783272    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 00:13:14.783431 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.783390    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 00:13:14.783431 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.783398    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 00:13:14.783806 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.783787    2556 factory.go:55] Registering systemd factory
Jul 16 00:13:14.783806 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.783807    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 16 00:13:14.784079 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.784049    2556 factory.go:153] Registering CRI-O factory
Jul 16 00:13:14.784079 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.784071    2556 factory.go:223] Registration of the crio container factory successfully
Jul 16 00:13:14.784195 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.784123    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 00:13:14.784195 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.784145    2556 factory.go:103] Registering Raw factory
Jul 16 00:13:14.784195 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.784159    2556 manager.go:1196] Started watching for new ooms in manager
Jul 16 00:13:14.784892 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.784723    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 00:13:14.785295 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.785274    2556 manager.go:349] Starting recovery of all containers
Jul 16 00:13:14.791674 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.791652    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:13:14.793492 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.793465    2556 manager.go:354] Recovery completed
Jul 16 00:13:14.794382 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.794361    2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-233.ec2.internal\" not found" node="ip-10-0-140-233.ec2.internal"
Jul 16 00:13:14.797993 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.797979    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:13:14.800017 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.800002    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:13:14.800100 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.800035    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:13:14.800100 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.800049    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:13:14.800579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.800566    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 00:13:14.800579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.800578    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 00:13:14.800684 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.800568    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:13:14.800684 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.800593    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 00:13:14.801237 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.801223    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:13:14.801312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.801250    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:13:14.801312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.801262    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:13:14.801734 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.801722    2556 policy_none.go:49] "None policy: Start"
Jul 16 00:13:14.801771 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.801738    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 00:13:14.801771 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.801748    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 00:13:14.802740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.802729    2556 policy_none.go:47] "Start"
Jul 16 00:13:14.850425 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.850398    2556 manager.go:337] "Starting Device Plugin manager"
Jul 16 00:13:14.850579 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.850549    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 00:13:14.850579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.850565    2556 server.go:87] "Starting device plugin registration server"
Jul 16 00:13:14.850862 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.850848    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 00:13:14.850912 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.850864    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 00:13:14.850987 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.850966    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 00:13:14.851084 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.851071    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 00:13:14.851138 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.851085    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 00:13:14.851654 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.851630    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 00:13:14.851763 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.851693    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:14.951204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.951109    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:13:14.952455 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.952311    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:13:14.952455 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.952348    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:13:14.952455 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.952359    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:13:14.952455 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.952386    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-233.ec2.internal"
Jul 16 00:13:14.958187 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.958169    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-233.ec2.internal"
Jul 16 00:13:14.958251 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.958196    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-233.ec2.internal\": node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:14.963028 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.962998    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 00:13:14.964362 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.964344    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 00:13:14.964442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.964384    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 00:13:14.964442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.964405    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 00:13:14.964442 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.964438    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 00:13:14.966374 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:14.966354    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:13:14.971243 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:14.971214    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.065194 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.065146    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"]
Jul 16 00:13:15.065363 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.065234    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:13:15.066938 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.066920    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:13:15.067030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.066958    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:13:15.067030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.066969    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:13:15.068199 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.068185    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:13:15.068306 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.068288    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.068365 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.068323    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:13:15.069039 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.069021    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:13:15.069128 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.069047    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:13:15.069128 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.069057    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:13:15.069128 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.069028    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:13:15.069128 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.069120    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:13:15.069128 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.069130    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:13:15.070499 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.070481    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.070553 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.070512    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 00:13:15.071274 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.071258    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.071352 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.071321    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 00:13:15.071446 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.071355    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 00:13:15.071446 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.071365    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeHasSufficientPID"
Jul 16 00:13:15.107573 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.107536    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-233.ec2.internal\" not found" node="ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.112027 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.111997    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-233.ec2.internal\" not found" node="ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.171502 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.171465    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.184867 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.184832    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db40c023a867f1bc28c53e6c270c084a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal\" (UID: \"db40c023a867f1bc28c53e6c270c084a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.184961 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.184871    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/161e034c1359394ff1bdcb207faeb1e3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-233.ec2.internal\" (UID: \"161e034c1359394ff1bdcb207faeb1e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.184961 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.184890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db40c023a867f1bc28c53e6c270c084a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal\" (UID: \"db40c023a867f1bc28c53e6c270c084a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.272424 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.272336    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.285717 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.285689    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db40c023a867f1bc28c53e6c270c084a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal\" (UID: \"db40c023a867f1bc28c53e6c270c084a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.285801 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.285720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db40c023a867f1bc28c53e6c270c084a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal\" (UID: \"db40c023a867f1bc28c53e6c270c084a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.285801 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.285739    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/161e034c1359394ff1bdcb207faeb1e3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-233.ec2.internal\" (UID: \"161e034c1359394ff1bdcb207faeb1e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.285874 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.285794    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db40c023a867f1bc28c53e6c270c084a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal\" (UID: \"db40c023a867f1bc28c53e6c270c084a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.285874 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.285796    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/161e034c1359394ff1bdcb207faeb1e3-config\") pod \"kube-apiserver-proxy-ip-10-0-140-233.ec2.internal\" (UID: \"161e034c1359394ff1bdcb207faeb1e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.285874 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.285796    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db40c023a867f1bc28c53e6c270c084a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal\" (UID: \"db40c023a867f1bc28c53e6c270c084a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.379007 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.378951    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.410882 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.410852    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.415562 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.415540    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.479692 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.479645    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.587353 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.587263    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.687373 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.687337    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-233.ec2.internal\" not found"
Jul 16 00:13:15.699813 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.699777    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:13:15.722581 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.722537    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 00:13:15.723337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.722752    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 00:13:15.723337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.722771    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 00:13:15.723337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.722775    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 00:13:15.762258 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.762217    2556 apiserver.go:52] "Watching apiserver"
Jul 16 00:13:15.781944 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.781897    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 00:08:15 +0000 UTC" deadline="2028-02-21 00:45:30.583563817 +0000 UTC"
Jul 16 00:13:15.781944 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.781929    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14040h32m14.801637559s"
Jul 16 00:13:15.782360 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.782337    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 00:13:15.783089 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.783068    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.783167 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.783098    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 00:13:15.785821 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.785792    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-w58fj","openshift-dns/node-resolver-rlk2r","openshift-image-registry/node-ca-7r8gq","openshift-multus/multus-additional-cni-plugins-fh55z","openshift-multus/multus-b2hlj","openshift-multus/network-metrics-daemon-dsphw","openshift-network-diagnostics/network-check-target-jsrpt","openshift-ovn-kubernetes/ovnkube-node-sgxtj","kube-system/global-pull-secret-syncer-9w6gf","kube-system/konnectivity-agent-gjvn5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg","openshift-network-operator/iptables-alerter-r8zqz"]
Jul 16 00:13:15.787529 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.787507    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.788734 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.788710    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:15.790058 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.790038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:15.790801 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.790779    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 00:13:15.790903 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.790850    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:13:15.791170 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.791149    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7ldqc\""
Jul 16 00:13:15.791400 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.791382    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.792268 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.792250    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 00:13:15.792518 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.792494    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 00:13:15.793643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.792590    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5vsg4\""
Jul 16 00:13:15.793643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.792894    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"
Jul 16 00:13:15.793643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.793025    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.793643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.793339    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 00:13:15.793927 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.793881    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 00:13:15.794205 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.794171    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 00:13:15.794350 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.794331    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 00:13:15.795149 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.795126    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vvsfj\""
Jul 16 00:13:15.795244 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.795203    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 00:13:15.796185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.795138    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 00:13:15.796185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.795367    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 00:13:15.796185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.795136    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-62xmd\""
Jul 16 00:13:15.796185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.795713    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 00:13:15.796185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.796031    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rlsk2\""
Jul 16 00:13:15.796477 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.796195    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:15.796477 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.796284    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:15.797137 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.796932    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 00:13:15.797950 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.797926    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:15.798061 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.797998    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:15.798211 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.798193    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 00:13:15.798523 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.798496    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 00:13:15.799386 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.799365    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.800952 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.800929    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:15.801066 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.801049    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:15.801737 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.801720    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 00:13:15.802014 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.801994    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 00:13:15.802204 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.802181    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwf57\""
Jul 16 00:13:15.802548 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.802479    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:15.802991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.802966    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 00:13:15.803095 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.802997    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 00:13:15.803095 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.803001    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 00:13:15.803095 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.803083    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 00:13:15.803996 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.803976    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.804700 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.804680    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7bsb2\""
Jul 16 00:13:15.804928 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.804903    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 00:13:15.805119 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.805102    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 00:13:15.805282 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.805264    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal"]
Jul 16 00:13:15.805374 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.805360    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:15.806104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.806084    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 00:13:15.806259 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.806241    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 00:13:15.806363 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.806347    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 00:13:15.806514 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.806495    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 00:13:15.806612 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.806592    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b47d\""
Jul 16 00:13:15.806763 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.806744    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal"]
Jul 16 00:13:15.807854 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.807836    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 00:13:15.807942 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.807920    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 00:13:15.808019 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.807948    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 00:13:15.808328 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.808314    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rf4t\""
Jul 16 00:13:15.822762 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.822725    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ncjv6"
Jul 16 00:13:15.832838 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.832809    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ncjv6"
Jul 16 00:13:15.885870 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.885845    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 00:13:15.889468 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-sys\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.889468 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889467    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-host\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0dcedff-c06c-430c-943d-c125f46afe03-multus-daemon-config\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-device-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889550    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-var-lib-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-modprobe-d\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889660    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-run\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889697    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-etc-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-log-socket\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889744    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-os-release\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889786    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-etc-kubernetes\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-sys-fs\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.889823 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62fqb\" (UniqueName: \"kubernetes.io/projected/4677dd29-51b6-432c-a9e4-3f68e230926b-kube-api-access-62fqb\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-env-overrides\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889873    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-cni-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pt8z\" (UniqueName: \"kubernetes.io/projected/6f6ddb13-cc71-4f4e-970d-82c5568b989a-kube-api-access-2pt8z\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-cni-netd\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889935    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-kubelet\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-socket-dir-parent\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.889973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-multus-certs\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890014    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysctl-d\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428p4\" (UniqueName: \"kubernetes.io/projected/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-kube-api-access-428p4\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890099    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-socket-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890187    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-registration-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890217    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4677dd29-51b6-432c-a9e4-3f68e230926b-tmp-dir\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-system-cni-dir\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.890530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-run-netns\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890353    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890385    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4677dd29-51b6-432c-a9e4-3f68e230926b-hosts-file\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5a86802-8113-42ea-aa36-498e3e37a8bf-dbus\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-lib-modules\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890447    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bhl\" (UniqueName: \"kubernetes.io/projected/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-kube-api-access-k9bhl\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890465    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crcn9\" (UniqueName: \"kubernetes.io/projected/e0dcedff-c06c-430c-943d-c125f46afe03-kube-api-access-crcn9\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890487    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-node-log\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovn-node-metrics-cert\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890556    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-cni-bin\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-kubelet\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovnkube-config\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890712    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2nlr\" (UniqueName: \"kubernetes.io/projected/2d0047ff-cf80-47c5-8986-aa7cfae2c623-kube-api-access-s2nlr\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890729    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890775    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhdnv\" (UniqueName: \"kubernetes.io/projected/209e3a07-8da7-4c79-9aee-87568a5f3c9d-kube-api-access-dhdnv\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.891422 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-ovn\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890859    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d0047ff-cf80-47c5-8986-aa7cfae2c623-host-slash\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysctl-conf\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-tuned\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890924    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-os-release\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.890981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-cnibin\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891003    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-k8s-cni-cncf-io\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891069    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-netns\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvjdt\" (UniqueName: \"kubernetes.io/projected/74ff4ead-9b53-434a-b8fd-8a5e289877ad-kube-api-access-tvjdt\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891119    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0ee6b-40df-4489-a633-7fc7f7797b88-konnectivity-ca\") pod \"konnectivity-agent-gjvn5\" (UID: \"8bd0ee6b-40df-4489-a633-7fc7f7797b88\") " pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891138    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-cni-multus\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-systemd\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891185    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.892301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-slash\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891227    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5a86802-8113-42ea-aa36-498e3e37a8bf-kubelet-config\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891244    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-var-lib-kubelet\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-host\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-system-cni-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891321    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-hostroot\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-systemd-units\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovnkube-script-lib\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-serviceca\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891401    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-systemd\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7gt\" (UniqueName: \"kubernetes.io/projected/13e4fcf0-4a19-49b4-99e4-6e18280585d4-kube-api-access-kz7gt\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8bd0ee6b-40df-4489-a633-7fc7f7797b88-agent-certs\") pod \"konnectivity-agent-gjvn5\" (UID: \"8bd0ee6b-40df-4489-a633-7fc7f7797b88\") " pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-tmp\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysconfig\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891534    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-kubernetes\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0dcedff-c06c-430c-943d-c125f46afe03-cni-binary-copy\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.893174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-conf-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.894184 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891584    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cnibin\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.894184 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891599    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-cni-bin\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.894184 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.891630    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d0047ff-cf80-47c5-8986-aa7cfae2c623-iptables-alerter-script\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:15.966484 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.966447    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:13:15.991954 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.991927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-sys\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.991982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-host\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992008    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0dcedff-c06c-430c-943d-c125f46afe03-multus-daemon-config\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-device-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992060    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-sys\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-var-lib-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992109    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-host\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992123    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-var-lib-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-device-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.992166 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992169    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992210    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-modprobe-d\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992217    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992241    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-run\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-etc-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-run\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992300    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-log-socket\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992324    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-modprobe-d\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992343    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992348    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-log-socket\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992366    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-etc-openvswitch\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992378    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-os-release\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992389    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992416    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-etc-kubernetes\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992436    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-os-release\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992443    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-sys-fs\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992453    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-etc-kubernetes\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992473    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62fqb\" (UniqueName: \"kubernetes.io/projected/4677dd29-51b6-432c-a9e4-3f68e230926b-kube-api-access-62fqb\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:15.992685 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-env-overrides\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992527    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-sys-fs\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-cni-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pt8z\" (UniqueName: \"kubernetes.io/projected/6f6ddb13-cc71-4f4e-970d-82c5568b989a-kube-api-access-2pt8z\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992710    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-cni-netd\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992736    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-kubelet\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992792    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-socket-dir-parent\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-multus-certs\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992824    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-cni-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992840    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysctl-d\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992868    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-428p4\" (UniqueName: \"kubernetes.io/projected/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-kube-api-access-428p4\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992925    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0dcedff-c06c-430c-943d-c125f46afe03-multus-daemon-config\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.992965    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-cni-netd\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.993414 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.993057    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-kubelet\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993920 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.993717    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-socket-dir-parent\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.993974 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.993029    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysctl-d\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.994480 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994084    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-env-overrides\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.994480 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994136    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.994480 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.993067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-multus-certs\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.994480 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994525    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-socket-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994527    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-socket-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994588    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-registration-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994671    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4677dd29-51b6-432c-a9e4-3f68e230926b-tmp-dir\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-system-cni-dir\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994801    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-run-netns\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994840    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994875    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4677dd29-51b6-432c-a9e4-3f68e230926b-hosts-file\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994902    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5a86802-8113-42ea-aa36-498e3e37a8bf-dbus\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-lib-modules\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.994970    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bhl\" (UniqueName: \"kubernetes.io/projected/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-kube-api-access-k9bhl\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crcn9\" (UniqueName: \"kubernetes.io/projected/e0dcedff-c06c-430c-943d-c125f46afe03-kube-api-access-crcn9\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-node-log\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995100    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovn-node-metrics-cert\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-cni-bin\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.998797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-kubelet\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995221    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovnkube-config\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995256    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2nlr\" (UniqueName: \"kubernetes.io/projected/2d0047ff-cf80-47c5-8986-aa7cfae2c623-kube-api-access-s2nlr\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995287    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995319    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhdnv\" (UniqueName: \"kubernetes.io/projected/209e3a07-8da7-4c79-9aee-87568a5f3c9d-kube-api-access-dhdnv\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995391    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-ovn\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995433    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995462    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d0047ff-cf80-47c5-8986-aa7cfae2c623-host-slash\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995496    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysctl-conf\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995550    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-tuned\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995587    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-os-release\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995652    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-cnibin\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995746    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-k8s-cni-cncf-io\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995784    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-netns\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:15.999748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995802    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-cni-bin\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995825    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvjdt\" (UniqueName: \"kubernetes.io/projected/74ff4ead-9b53-434a-b8fd-8a5e289877ad-kube-api-access-tvjdt\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995881    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-registration-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0ee6b-40df-4489-a633-7fc7f7797b88-konnectivity-ca\") pod \"konnectivity-agent-gjvn5\" (UID: \"8bd0ee6b-40df-4489-a633-7fc7f7797b88\") " pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-cni-multus\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.995991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-systemd\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996060    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-slash\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5a86802-8113-42ea-aa36-498e3e37a8bf-kubelet-config\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996149    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-var-lib-kubelet\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996179    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-host\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996224    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-system-cni-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996282    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-hostroot\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-systemd-units\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996346    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovnkube-script-lib\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996378    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-serviceca\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-systemd\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.000947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7gt\" (UniqueName: \"kubernetes.io/projected/13e4fcf0-4a19-49b4-99e4-6e18280585d4-kube-api-access-kz7gt\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8bd0ee6b-40df-4489-a633-7fc7f7797b88-agent-certs\") pod \"konnectivity-agent-gjvn5\" (UID: \"8bd0ee6b-40df-4489-a633-7fc7f7797b88\") " pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996508    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-tmp\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996541    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996568    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysconfig\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996600    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-kubernetes\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996635    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0dcedff-c06c-430c-943d-c125f46afe03-cni-binary-copy\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996667    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-conf-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996716    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cnibin\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-cni-bin\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d0047ff-cf80-47c5-8986-aa7cfae2c623-iptables-alerter-script\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996838    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovnkube-config\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996973    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74ff4ead-9b53-434a-b8fd-8a5e289877ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997165    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4677dd29-51b6-432c-a9e4-3f68e230926b-tmp-dir\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.996223    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-kubelet\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997374    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-systemd\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997386    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-system-cni-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.997513    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:16.001856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997556    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysctl-conf\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997626    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-k8s-cni-cncf-io\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.997642    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret podName:b5a86802-8113-42ea-aa36-498e3e37a8bf nodeName:}" failed. No retries permitted until 2026-07-16 00:13:16.497588748 +0000 UTC m=+2.069185051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret") pod "global-pull-secret-syncer-9w6gf" (UID: "b5a86802-8113-42ea-aa36-498e3e37a8bf") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997726    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-node-log\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997731    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-cnibin\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997773    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-systemd-units\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997908    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.997939    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997992    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-os-release\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998002    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-hostroot\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998012    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:15.998060    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:13:16.498043135 +0000 UTC m=+2.069639419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998066    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-systemd\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998182    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4677dd29-51b6-432c-a9e4-3f68e230926b-hosts-file\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998243    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-var-lib-cni-multus\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998364    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-slash\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998364    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovnkube-script-lib\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.003203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998412    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d0047ff-cf80-47c5-8986-aa7cfae2c623-iptables-alerter-script\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998430    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-host-run-netns\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998433    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-serviceca\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998370    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5a86802-8113-42ea-aa36-498e3e37a8bf-dbus\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998583    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-lib-modules\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998636    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998644    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5a86802-8113-42ea-aa36-498e3e37a8bf-kubelet-config\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.998975    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.999175    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-var-lib-kubelet\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.000240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-system-cni-dir\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.000293    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-host\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:15.997387    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d0047ff-cf80-47c5-8986-aa7cfae2c623-host-slash\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.001806    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-sysconfig\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.001845    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-kubernetes\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.001865    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0dcedff-c06c-430c-943d-c125f46afe03-multus-conf-dir\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.001918    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002267    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-cni-bin\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.004136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002384    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002633    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-run-ovn\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002634    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0ee6b-40df-4489-a633-7fc7f7797b88-konnectivity-ca\") pod \"konnectivity-agent-gjvn5\" (UID: \"8bd0ee6b-40df-4489-a633-7fc7f7797b88\") " pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002733    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/209e3a07-8da7-4c79-9aee-87568a5f3c9d-cnibin\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002830    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0dcedff-c06c-430c-943d-c125f46afe03-cni-binary-copy\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002884    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-etc-tuned\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.002904    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13e4fcf0-4a19-49b4-99e4-6e18280585d4-host-run-netns\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.003401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62fqb\" (UniqueName: \"kubernetes.io/projected/4677dd29-51b6-432c-a9e4-3f68e230926b-kube-api-access-62fqb\") pod \"node-resolver-rlk2r\" (UID: \"4677dd29-51b6-432c-a9e4-3f68e230926b\") " pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.003465    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-428p4\" (UniqueName: \"kubernetes.io/projected/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-kube-api-access-428p4\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.003237    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13e4fcf0-4a19-49b4-99e4-6e18280585d4-ovn-node-metrics-cert\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.003822    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8bd0ee6b-40df-4489-a633-7fc7f7797b88-agent-certs\") pod \"konnectivity-agent-gjvn5\" (UID: \"8bd0ee6b-40df-4489-a633-7fc7f7797b88\") " pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.004634    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.004658    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.004671    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zqdn7 for pod openshift-network-diagnostics/network-check-target-jsrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:16.005030 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.004739    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7 podName:db269f0b-da22-40b4-8f57-b08edca25c06 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:16.504721047 +0000 UTC m=+2.076317354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zqdn7" (UniqueName: "kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7") pod "network-check-target-jsrpt" (UID: "db269f0b-da22-40b4-8f57-b08edca25c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:16.005586 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.005225    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pt8z\" (UniqueName: \"kubernetes.io/projected/6f6ddb13-cc71-4f4e-970d-82c5568b989a-kube-api-access-2pt8z\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:16.006075 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.006049    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941-tmp\") pod \"tuned-w58fj\" (UID: \"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941\") " pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.007305 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.006368    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvjdt\" (UniqueName: \"kubernetes.io/projected/74ff4ead-9b53-434a-b8fd-8a5e289877ad-kube-api-access-tvjdt\") pod \"aws-ebs-csi-driver-node-6xlwg\" (UID: \"74ff4ead-9b53-434a-b8fd-8a5e289877ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:16.007305 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.007296    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:13:16.007874 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.007849    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhdnv\" (UniqueName: \"kubernetes.io/projected/209e3a07-8da7-4c79-9aee-87568a5f3c9d-kube-api-access-dhdnv\") pod \"multus-additional-cni-plugins-fh55z\" (UID: \"209e3a07-8da7-4c79-9aee-87568a5f3c9d\") " pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.008099 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.008081    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7gt\" (UniqueName: \"kubernetes.io/projected/13e4fcf0-4a19-49b4-99e4-6e18280585d4-kube-api-access-kz7gt\") pod \"ovnkube-node-sgxtj\" (UID: \"13e4fcf0-4a19-49b4-99e4-6e18280585d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.009483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.009461    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crcn9\" (UniqueName: \"kubernetes.io/projected/e0dcedff-c06c-430c-943d-c125f46afe03-kube-api-access-crcn9\") pod \"multus-b2hlj\" (UID: \"e0dcedff-c06c-430c-943d-c125f46afe03\") " pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.016941 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.016903    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2nlr\" (UniqueName: \"kubernetes.io/projected/2d0047ff-cf80-47c5-8986-aa7cfae2c623-kube-api-access-s2nlr\") pod \"iptables-alerter-r8zqz\" (UID: \"2d0047ff-cf80-47c5-8986-aa7cfae2c623\") " pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:16.017317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.017297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bhl\" (UniqueName: \"kubernetes.io/projected/74346c98-2a0c-4a75-8ae1-cfc18955b9bb-kube-api-access-k9bhl\") pod \"node-ca-7r8gq\" (UID: \"74346c98-2a0c-4a75-8ae1-cfc18955b9bb\") " pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:16.109554 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.109458    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w58fj"
Jul 16 00:13:16.119207 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.119167    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2dc5fa_393b_4e85_bb2d_bdd12cfc9941.slice/crio-84e3ae130ec52025334ed6dec48a355e05fce339dc73566b1f9f09d816f18799 WatchSource:0}: Error finding container 84e3ae130ec52025334ed6dec48a355e05fce339dc73566b1f9f09d816f18799: Status 404 returned error can't find the container with id 84e3ae130ec52025334ed6dec48a355e05fce339dc73566b1f9f09d816f18799
Jul 16 00:13:16.126431 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.126406    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rlk2r"
Jul 16 00:13:16.135785 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.135537    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4677dd29_51b6_432c_a9e4_3f68e230926b.slice/crio-26fdc6b2b9240e3c44afabaf62373693319c91b9c7edcaa02804f6890fc42d53 WatchSource:0}: Error finding container 26fdc6b2b9240e3c44afabaf62373693319c91b9c7edcaa02804f6890fc42d53: Status 404 returned error can't find the container with id 26fdc6b2b9240e3c44afabaf62373693319c91b9c7edcaa02804f6890fc42d53
Jul 16 00:13:16.154453 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.154408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7r8gq"
Jul 16 00:13:16.163743 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.163715    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fh55z"
Jul 16 00:13:16.165427 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.165397    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74346c98_2a0c_4a75_8ae1_cfc18955b9bb.slice/crio-cf865c3edada466e63cc5e01cad06962619b1e74e0655b2cf7741f19d3a51085 WatchSource:0}: Error finding container cf865c3edada466e63cc5e01cad06962619b1e74e0655b2cf7741f19d3a51085: Status 404 returned error can't find the container with id cf865c3edada466e63cc5e01cad06962619b1e74e0655b2cf7741f19d3a51085
Jul 16 00:13:16.172888 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.172858    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209e3a07_8da7_4c79_9aee_87568a5f3c9d.slice/crio-26a179dd52e3688f4af1c8e6422c63293ec52ee5ca2391e55ba11bbe084ea5cd WatchSource:0}: Error finding container 26a179dd52e3688f4af1c8e6422c63293ec52ee5ca2391e55ba11bbe084ea5cd: Status 404 returned error can't find the container with id 26a179dd52e3688f4af1c8e6422c63293ec52ee5ca2391e55ba11bbe084ea5cd
Jul 16 00:13:16.177717 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.177696    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b2hlj"
Jul 16 00:13:16.186004 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.185973    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0dcedff_c06c_430c_943d_c125f46afe03.slice/crio-28a4866d9ee603df5654dd4ef25c902ddf15d783cedbb79bfd807e8cba9ee874 WatchSource:0}: Error finding container 28a4866d9ee603df5654dd4ef25c902ddf15d783cedbb79bfd807e8cba9ee874: Status 404 returned error can't find the container with id 28a4866d9ee603df5654dd4ef25c902ddf15d783cedbb79bfd807e8cba9ee874
Jul 16 00:13:16.201776 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.201745    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:16.210090 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.210063    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e4fcf0_4a19_49b4_99e4_6e18280585d4.slice/crio-e5814e72229085c4a28a574bd47495cb10b7b01ed19c828ee1e4e0a2c4491257 WatchSource:0}: Error finding container e5814e72229085c4a28a574bd47495cb10b7b01ed19c828ee1e4e0a2c4491257: Status 404 returned error can't find the container with id e5814e72229085c4a28a574bd47495cb10b7b01ed19c828ee1e4e0a2c4491257
Jul 16 00:13:16.213520 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.213496    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:16.222075 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.222043    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd0ee6b_40df_4489_a633_7fc7f7797b88.slice/crio-e2347f648f32e58f8cbabeab5635bce2eb26318a48035c4426e6d8c4c5f436b9 WatchSource:0}: Error finding container e2347f648f32e58f8cbabeab5635bce2eb26318a48035c4426e6d8c4c5f436b9: Status 404 returned error can't find the container with id e2347f648f32e58f8cbabeab5635bce2eb26318a48035c4426e6d8c4c5f436b9
Jul 16 00:13:16.233001 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.232972    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg"
Jul 16 00:13:16.239413 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.239386    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r8zqz"
Jul 16 00:13:16.242796 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.242751    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ff4ead_9b53_434a_b8fd_8a5e289877ad.slice/crio-dbd143624d6adcffd370395b4318a5d63b316fae605efdc703f3866c357ee20f WatchSource:0}: Error finding container dbd143624d6adcffd370395b4318a5d63b316fae605efdc703f3866c357ee20f: Status 404 returned error can't find the container with id dbd143624d6adcffd370395b4318a5d63b316fae605efdc703f3866c357ee20f
Jul 16 00:13:16.248321 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:16.248285    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0047ff_cf80_47c5_8986_aa7cfae2c623.slice/crio-8462f830b7289b990205f907cf4c95f62b35ced770375473fb846f30a2505496 WatchSource:0}: Error finding container 8462f830b7289b990205f907cf4c95f62b35ced770375473fb846f30a2505496: Status 404 returned error can't find the container with id 8462f830b7289b990205f907cf4c95f62b35ced770375473fb846f30a2505496
Jul 16 00:13:16.501141 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.501001    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:16.501141 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.501053    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:16.501381 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.501208    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:16.501381 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.501214    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:16.501381 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.501273    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:13:17.501256991 +0000 UTC m=+3.072853272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:16.501381 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.501287    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret podName:b5a86802-8113-42ea-aa36-498e3e37a8bf nodeName:}" failed. No retries permitted until 2026-07-16 00:13:17.501280948 +0000 UTC m=+3.072877228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret") pod "global-pull-secret-syncer-9w6gf" (UID: "b5a86802-8113-42ea-aa36-498e3e37a8bf") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:16.602084 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.601790    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:16.602084 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.601993    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:13:16.602084 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.602024    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:13:16.602084 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.602070    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zqdn7 for pod openshift-network-diagnostics/network-check-target-jsrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:16.602496 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:16.602179    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7 podName:db269f0b-da22-40b4-8f57-b08edca25c06 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:17.602155878 +0000 UTC m=+3.173752180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqdn7" (UniqueName: "kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7") pod "network-check-target-jsrpt" (UID: "db269f0b-da22-40b4-8f57-b08edca25c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:16.834992 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.834784    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:08:16 +0000 UTC" deadline="2028-01-19 18:08:45.503225481 +0000 UTC"
Jul 16 00:13:16.834992 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.834851    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13265h55m28.668378864s"
Jul 16 00:13:16.990219 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:16.990146    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"e5814e72229085c4a28a574bd47495cb10b7b01ed19c828ee1e4e0a2c4491257"}
Jul 16 00:13:17.004272 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.004219    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b2hlj" event={"ID":"e0dcedff-c06c-430c-943d-c125f46afe03","Type":"ContainerStarted","Data":"28a4866d9ee603df5654dd4ef25c902ddf15d783cedbb79bfd807e8cba9ee874"}
Jul 16 00:13:17.022549 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.022509    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7r8gq" event={"ID":"74346c98-2a0c-4a75-8ae1-cfc18955b9bb","Type":"ContainerStarted","Data":"cf865c3edada466e63cc5e01cad06962619b1e74e0655b2cf7741f19d3a51085"}
Jul 16 00:13:17.032290 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.032255    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:13:17.057122 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.057077    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w58fj" event={"ID":"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941","Type":"ContainerStarted","Data":"84e3ae130ec52025334ed6dec48a355e05fce339dc73566b1f9f09d816f18799"}
Jul 16 00:13:17.069017 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.068870    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal" event={"ID":"db40c023a867f1bc28c53e6c270c084a","Type":"ContainerStarted","Data":"ab621991fde13c5f902661d1fd605f4a9b377d32a5c95ef4b0072b740c2eab1c"}
Jul 16 00:13:17.090749 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.088209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal" event={"ID":"161e034c1359394ff1bdcb207faeb1e3","Type":"ContainerStarted","Data":"00671edbab5a39b04f649cf18580d8c6086779e59bb95826eff8cdd5cf3cc927"}
Jul 16 00:13:17.096910 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.096875    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg" event={"ID":"74ff4ead-9b53-434a-b8fd-8a5e289877ad","Type":"ContainerStarted","Data":"dbd143624d6adcffd370395b4318a5d63b316fae605efdc703f3866c357ee20f"}
Jul 16 00:13:17.103845 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.103814    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:13:17.111620 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.111587    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjvn5" event={"ID":"8bd0ee6b-40df-4489-a633-7fc7f7797b88","Type":"ContainerStarted","Data":"e2347f648f32e58f8cbabeab5635bce2eb26318a48035c4426e6d8c4c5f436b9"}
Jul 16 00:13:17.123029 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.122939    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerStarted","Data":"26a179dd52e3688f4af1c8e6422c63293ec52ee5ca2391e55ba11bbe084ea5cd"}
Jul 16 00:13:17.135404 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.134986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rlk2r" event={"ID":"4677dd29-51b6-432c-a9e4-3f68e230926b","Type":"ContainerStarted","Data":"26fdc6b2b9240e3c44afabaf62373693319c91b9c7edcaa02804f6890fc42d53"}
Jul 16 00:13:17.149625 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.149596    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8zqz" event={"ID":"2d0047ff-cf80-47c5-8986-aa7cfae2c623","Type":"ContainerStarted","Data":"8462f830b7289b990205f907cf4c95f62b35ced770375473fb846f30a2505496"}
Jul 16 00:13:17.509091 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.509056    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:17.509249 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.509123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:17.509324 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.509255    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:17.509324 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.509318    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret podName:b5a86802-8113-42ea-aa36-498e3e37a8bf nodeName:}" failed. No retries permitted until 2026-07-16 00:13:19.509298646 +0000 UTC m=+5.080894942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret") pod "global-pull-secret-syncer-9w6gf" (UID: "b5a86802-8113-42ea-aa36-498e3e37a8bf") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:17.509765 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.509746    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:17.509871 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.509817    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:13:19.509800568 +0000 UTC m=+5.081396851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:17.610476 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.610442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:17.610710 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.610680    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:13:17.610797 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.610714    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:13:17.610797 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.610730    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zqdn7 for pod openshift-network-diagnostics/network-check-target-jsrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:17.610906 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.610800    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7 podName:db269f0b-da22-40b4-8f57-b08edca25c06 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:19.610776158 +0000 UTC m=+5.182372455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqdn7" (UniqueName: "kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7") pod "network-check-target-jsrpt" (UID: "db269f0b-da22-40b4-8f57-b08edca25c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:17.790992 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.790900    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 00:13:17.835693 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.835638    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:08:16 +0000 UTC" deadline="2027-12-31 20:48:18.35418322 +0000 UTC"
Jul 16 00:13:17.835693 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.835684    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12812h35m0.518504836s"
Jul 16 00:13:17.966312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.965159    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:17.966312 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.965313    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:17.966312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.965964    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:17.966312 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.966089    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:17.966312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:17.966180    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:17.966312 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:17.966263    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:19.529225 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:19.529161    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:19.529225 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:19.529220    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:19.529962 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.529364    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:19.529962 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.529430    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret podName:b5a86802-8113-42ea-aa36-498e3e37a8bf nodeName:}" failed. No retries permitted until 2026-07-16 00:13:23.529411366 +0000 UTC m=+9.101007661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret") pod "global-pull-secret-syncer-9w6gf" (UID: "b5a86802-8113-42ea-aa36-498e3e37a8bf") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:19.529962 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.529911    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:19.530140 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.529975    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:13:23.529956918 +0000 UTC m=+9.101553213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:19.630906 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:19.630113    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:19.630906 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.630363    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:13:19.630906 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.630389    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:13:19.630906 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.630403    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zqdn7 for pod openshift-network-diagnostics/network-check-target-jsrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:19.630906 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.630470    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7 podName:db269f0b-da22-40b4-8f57-b08edca25c06 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:23.630448125 +0000 UTC m=+9.202044421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqdn7" (UniqueName: "kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7") pod "network-check-target-jsrpt" (UID: "db269f0b-da22-40b4-8f57-b08edca25c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:19.965781 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:19.964955    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:19.965781 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.965084    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:19.965781 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:19.965470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:19.965781 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.965577    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:19.965781 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:19.965639    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:19.965781 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:19.965747    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:21.965624 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:21.965564    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:21.965624 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:21.965622    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:21.966089 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:21.965812    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:21.966240 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:21.966210    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:21.966308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:21.966275    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:21.966341 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:21.966331    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:23.563942 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:23.563599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:23.563942 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:23.563678    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:23.563942 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.563837    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:23.563942 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.563837    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:23.563942 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.563901    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret podName:b5a86802-8113-42ea-aa36-498e3e37a8bf nodeName:}" failed. No retries permitted until 2026-07-16 00:13:31.563883497 +0000 UTC m=+17.135479786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret") pod "global-pull-secret-syncer-9w6gf" (UID: "b5a86802-8113-42ea-aa36-498e3e37a8bf") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:23.563942 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.563920    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:13:31.563909975 +0000 UTC m=+17.135506259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:23.664739 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:23.664061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:23.664739 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.664273    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:13:23.664739 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.664297    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:13:23.664739 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.664310    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zqdn7 for pod openshift-network-diagnostics/network-check-target-jsrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:23.664739 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.664366    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7 podName:db269f0b-da22-40b4-8f57-b08edca25c06 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:31.664349774 +0000 UTC m=+17.235946067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqdn7" (UniqueName: "kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7") pod "network-check-target-jsrpt" (UID: "db269f0b-da22-40b4-8f57-b08edca25c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:23.965140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:23.965049    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:23.965289 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.965162    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:23.965578 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:23.965544    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:23.965703 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.965663    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:23.965749 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:23.965724    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:23.965828 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:23.965805    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:25.964838 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:25.964810    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:25.965254 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:25.964848    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:25.965254 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:25.964811    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:25.965254 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:25.964934    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:25.965254 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:25.965063    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:25.965254 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:25.965125    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:27.965598 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:27.965553    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:27.966129 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:27.965553    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:27.966129 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:27.965702    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:27.966129 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:27.965718    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:27.966129 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:27.965809    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:27.966129 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:27.965912    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:29.964812 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:29.964769    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:29.965246 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:29.964782    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:29.965246 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:29.964915    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:29.965246 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:29.964782    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:29.965246 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:29.964989    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:29.965246 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:29.965073    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:31.624924 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:31.624882    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:31.624924 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:31.624927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:31.625515 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.625059    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:31.625515 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.625075    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:31.625515 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.625133    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret podName:b5a86802-8113-42ea-aa36-498e3e37a8bf nodeName:}" failed. No retries permitted until 2026-07-16 00:13:47.625111845 +0000 UTC m=+33.196708144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret") pod "global-pull-secret-syncer-9w6gf" (UID: "b5a86802-8113-42ea-aa36-498e3e37a8bf") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:31.625515 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.625152    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:13:47.625143054 +0000 UTC m=+33.196739332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:31.725978 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:31.725936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:31.726150 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.726135    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:13:31.726203 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.726162    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:13:31.726203 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.726175    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zqdn7 for pod openshift-network-diagnostics/network-check-target-jsrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:31.726285 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.726241    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7 podName:db269f0b-da22-40b4-8f57-b08edca25c06 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:47.726221756 +0000 UTC m=+33.297818040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqdn7" (UniqueName: "kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7") pod "network-check-target-jsrpt" (UID: "db269f0b-da22-40b4-8f57-b08edca25c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:31.965134 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:31.965047    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:31.965134 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:31.965079    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:31.965134 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:31.965091    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:31.965343 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.965168    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:31.965343 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.965239    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:31.965450 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:31.965344    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:33.965505 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:33.965456    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:33.965505 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:33.965500    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:33.966069 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:33.965470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:33.966069 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:33.965624    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:33.966069 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:33.965752    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:33.966069 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:33.965868    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:35.965160 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:35.965119    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:35.965581 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:35.965123    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:35.965581 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:35.965269    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:35.965581 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:35.965134    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:35.965581 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:35.965305    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:35.965581 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:35.965409    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:37.208997 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.208959    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"3db402b1ce5af6a7ca6629297622a682352fbe8ace3cd4b5c3f0ae8860def824"}
Jul 16 00:13:37.209521 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.209062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"c5ac51118a2618cd1a49e4515e595174eea0b0b9e8e831829bace95decea1bc5"}
Jul 16 00:13:37.210435 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.210409    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b2hlj" event={"ID":"e0dcedff-c06c-430c-943d-c125f46afe03","Type":"ContainerStarted","Data":"2c745d7aae2e93c9d4dd6d383629e1fa8d6806d10ff8c134b7e16aaa91630609"}
Jul 16 00:13:37.211829 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.211806    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w58fj" event={"ID":"2c2dc5fa-393b-4e85-bb2d-bdd12cfc9941","Type":"ContainerStarted","Data":"6f1ea8ccfd451c828a4ca7d78505c12cc70fffd9a2e5923a9104ea8f181efe32"}
Jul 16 00:13:37.222809 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.222675    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal" event={"ID":"161e034c1359394ff1bdcb207faeb1e3","Type":"ContainerStarted","Data":"25f782ad40ff07f879fa46f6fc8e78baa2336c79d4a31874f93882ed2281cf23"}
Jul 16 00:13:37.229718 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.229673    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b2hlj" podStartSLOduration=1.504318127 podStartE2EDuration="22.229659849s" totalImagesPullingTime="20.725341722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:37.22920385 +0000 UTC m=+22.800800148" watchObservedRunningTime="2026-07-16 00:13:37.229659849 +0000 UTC m=+22.801256149"
Jul 16 00:13:37.245460 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.245410    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w58fj" podStartSLOduration=1.500012167 podStartE2EDuration="22.245393496s" totalImagesPullingTime="20.745381329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:37.245277261 +0000 UTC m=+22.816873563" watchObservedRunningTime="2026-07-16 00:13:37.245393496 +0000 UTC m=+22.816989796"
Jul 16 00:13:37.257911 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.257850    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-233.ec2.internal" podStartSLOduration=21.257828156 podStartE2EDuration="21.257828156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:37.257644316 +0000 UTC m=+22.829240619" watchObservedRunningTime="2026-07-16 00:13:37.257828156 +0000 UTC m=+22.829424458"
Jul 16 00:13:37.965837 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.965601    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:37.965990 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.965625    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:37.965990 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:37.965939    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:37.966089 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:37.965996    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:37.966089 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:37.965684    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:37.966150 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:37.966102    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:38.226047 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.226008    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r8zqz" event={"ID":"2d0047ff-cf80-47c5-8986-aa7cfae2c623","Type":"ContainerStarted","Data":"a7c5fa800ee6fd930899a6cf282fd0df7315fd5ccfb2d25af9d2b6f7fcbce35c"}
Jul 16 00:13:38.228843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.228820    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:13:38.229201 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.229181    2556 generic.go:356] "Generic (PLEG): container finished" podID="13e4fcf0-4a19-49b4-99e4-6e18280585d4" containerID="3db402b1ce5af6a7ca6629297622a682352fbe8ace3cd4b5c3f0ae8860def824" exitCode=1
Jul 16 00:13:38.229275 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.229209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerDied","Data":"3db402b1ce5af6a7ca6629297622a682352fbe8ace3cd4b5c3f0ae8860def824"}
Jul 16 00:13:38.229332 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.229294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"f3b6308be37009df1e89adcf06f0de9fa94890ed3d4f851627c81ebe3b539c31"}
Jul 16 00:13:38.229391 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.229344    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"0593da6409ad47d49f4faadaa0e35a824d52c923d8d4fa2fc4f61187cd73a340"}
Jul 16 00:13:38.229391 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.229382    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"1ef7dfb60fda08de1cfb705007b0fda0aa3218031c36314efb6b2c5909d18fda"}
Jul 16 00:13:38.229485 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.229422    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"0c5ec45204acdfe0c77f22a321a9515cb51e61614138c33cfedbb82deb3ee7c6"}
Jul 16 00:13:38.230777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.230746    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7r8gq" event={"ID":"74346c98-2a0c-4a75-8ae1-cfc18955b9bb","Type":"ContainerStarted","Data":"bfdeddb616ac27dab8e05983bedcbe36f91014b6369c0e41964ee7c999b56a19"}
Jul 16 00:13:38.232233 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.232212    2556 generic.go:356] "Generic (PLEG): container finished" podID="db40c023a867f1bc28c53e6c270c084a" containerID="eb073afc6d5531a8de97abef36c1fe0ae539e4f219184b65609ac236a70a99ad" exitCode=0
Jul 16 00:13:38.232347 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.232286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal" event={"ID":"db40c023a867f1bc28c53e6c270c084a","Type":"ContainerDied","Data":"eb073afc6d5531a8de97abef36c1fe0ae539e4f219184b65609ac236a70a99ad"}
Jul 16 00:13:38.233788 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.233769    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg" event={"ID":"74ff4ead-9b53-434a-b8fd-8a5e289877ad","Type":"ContainerStarted","Data":"9cacaac1de2c7202b7a8dc6fceb2073dae5bf81667a64a3bfcd6dcf2b434ca4d"}
Jul 16 00:13:38.235270 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.235250    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjvn5" event={"ID":"8bd0ee6b-40df-4489-a633-7fc7f7797b88","Type":"ContainerStarted","Data":"9f8958ff7763ab19c597bd69d6c255481fe3d01fe733423effb70d2d1facadd4"}
Jul 16 00:13:38.236660 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.236635    2556 generic.go:356] "Generic (PLEG): container finished" podID="209e3a07-8da7-4c79-9aee-87568a5f3c9d" containerID="15894aa3e26afc3a603f9545712cc177e8a4232fd66025a8fcc41f11dab874ed" exitCode=0
Jul 16 00:13:38.236762 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.236704    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerDied","Data":"15894aa3e26afc3a603f9545712cc177e8a4232fd66025a8fcc41f11dab874ed"}
Jul 16 00:13:38.238154 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.238132    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rlk2r" event={"ID":"4677dd29-51b6-432c-a9e4-3f68e230926b","Type":"ContainerStarted","Data":"656cb8126cabd03905382cc948be5b05cd1af7f3b5af0b9b0aaaeba3a11c919f"}
Jul 16 00:13:38.239929 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.239889    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r8zqz" podStartSLOduration=2.631301848 podStartE2EDuration="23.239872469s" totalImagesPullingTime="20.608570621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:38.239663465 +0000 UTC m=+23.811259766" watchObservedRunningTime="2026-07-16 00:13:38.239872469 +0000 UTC m=+23.811468772"
Jul 16 00:13:38.290793 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.290723    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rlk2r" podStartSLOduration=2.569254903 podStartE2EDuration="23.290702107s" totalImagesPullingTime="20.721447204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:38.276098955 +0000 UTC m=+23.847695256" watchObservedRunningTime="2026-07-16 00:13:38.290702107 +0000 UTC m=+23.862298409"
Jul 16 00:13:38.306533 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:38.306481    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gjvn5" podStartSLOduration=2.671292253 podStartE2EDuration="23.306464367s" totalImagesPullingTime="20.635172114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:38.291991533 +0000 UTC m=+23.863587834" watchObservedRunningTime="2026-07-16 00:13:38.306464367 +0000 UTC m=+23.878060727"
Jul 16 00:13:39.075192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.075164    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 00:13:39.242668 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.242540    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal" event={"ID":"db40c023a867f1bc28c53e6c270c084a","Type":"ContainerStarted","Data":"6030995cec1db81c0f3d3692a898a65b9bb1f9841a2a17cb50a4dfc1b1822b4f"}
Jul 16 00:13:39.244590 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.244559    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg" event={"ID":"74ff4ead-9b53-434a-b8fd-8a5e289877ad","Type":"ContainerStarted","Data":"b083636200eb3ec8bb5355155546e4e8540e203f384aaa3e0de3879ead926892"}
Jul 16 00:13:39.257392 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.257355    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-233.ec2.internal" podStartSLOduration=23.257342681 podStartE2EDuration="23.257342681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:39.255960548 +0000 UTC m=+24.827556848" watchObservedRunningTime="2026-07-16 00:13:39.257342681 +0000 UTC m=+24.828938982"
Jul 16 00:13:39.257548 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.257526    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7r8gq" podStartSLOduration=3.565710841 podStartE2EDuration="24.257517902s" totalImagesPullingTime="20.691807061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:38.322276149 +0000 UTC m=+23.893872451" watchObservedRunningTime="2026-07-16 00:13:39.257517902 +0000 UTC m=+24.829114240"
Jul 16 00:13:39.868632 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.868480    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T00:13:39.075186897Z","UUID":"20f0f1cd-a423-4238-84b8-358770873cc1","Handler":null,"Name":"","Endpoint":""}
Jul 16 00:13:39.869054 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.869003    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:39.869815 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.869757    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:39.870720 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.870471    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 00:13:39.870720 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.870508    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 00:13:39.965113 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.965066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:39.965283 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.965176    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:39.965283 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:39.965181    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:39.965283 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:39.965212    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:39.965473 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:39.965289    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:39.965473 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:39.965355    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:40.251338 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:40.251141    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:13:40.252221 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:40.252193    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"8bf9e72bfa8262263724cc5024bd2ce76fc3a0cfcd1669d3b70e51c17a8263bd"}
Jul 16 00:13:40.252792 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:40.252772    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:40.253251 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:40.253235    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gjvn5"
Jul 16 00:13:41.257006 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:41.256961    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg" event={"ID":"74ff4ead-9b53-434a-b8fd-8a5e289877ad","Type":"ContainerStarted","Data":"ddd92a8421a1b1405bb3bc2d4658669a8b67000e5f771f1ed801507426887830"}
Jul 16 00:13:41.965331 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:41.965293    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:41.965536 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:41.965371    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:41.965536 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:41.965483    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:41.965536 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:41.965507    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:41.965718 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:41.965594    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:41.965770 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:41.965742    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:43.267215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.266936    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:13:43.267848 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.267544    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"8b6370fc489fafd591413af506017c8f3042e71072a96f32e705516c4290cd4c"}
Jul 16 00:13:43.267925 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.267853    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:43.267979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.267939    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:43.268034 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.267990    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:43.268082 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.268050    2556 scope.go:117] "RemoveContainer" containerID="3db402b1ce5af6a7ca6629297622a682352fbe8ace3cd4b5c3f0ae8860def824"
Jul 16 00:13:43.270169 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.270142    2556 generic.go:356] "Generic (PLEG): container finished" podID="209e3a07-8da7-4c79-9aee-87568a5f3c9d" containerID="d3d29b9509a829d193fdded9a352e9f73c8569770d5b30753b790aedaab677eb" exitCode=0
Jul 16 00:13:43.270247 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.270184    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerDied","Data":"d3d29b9509a829d193fdded9a352e9f73c8569770d5b30753b790aedaab677eb"}
Jul 16 00:13:43.284751 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.284735    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:43.288049 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.288032    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:13:43.294312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.294269    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xlwg" podStartSLOduration=5.098732763 podStartE2EDuration="28.29425126s" totalImagesPullingTime="23.195518497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:41.274919581 +0000 UTC m=+26.846515896" watchObservedRunningTime="2026-07-16 00:13:43.29425126 +0000 UTC m=+28.865847561"
Jul 16 00:13:43.964663 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.964629    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:43.964887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.964738    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:43.964887 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:43.964743    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:43.964887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:43.964770    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:43.964887 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:43.964874    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:43.965033 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:43.964937    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:44.276896 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.276867    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:13:44.277368 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.277283    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" event={"ID":"13e4fcf0-4a19-49b4-99e4-6e18280585d4","Type":"ContainerStarted","Data":"0eaccf82977fdbcc703d707a2cbc31ad8d24b6c1d0b2b168d3ea74d0af814daf"}
Jul 16 00:13:44.303683 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.303569    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj" podStartSLOduration=8.58350477 podStartE2EDuration="29.303546892s" totalImagesPullingTime="20.720042122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:44.302355778 +0000 UTC m=+29.873952080" watchObservedRunningTime="2026-07-16 00:13:44.303546892 +0000 UTC m=+29.875143195"
Jul 16 00:13:44.468916 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.468670    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsrpt"]
Jul 16 00:13:44.469105 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.469026    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:44.469168 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:44.469146    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:44.474530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.473788    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9w6gf"]
Jul 16 00:13:44.474530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.473862    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dsphw"]
Jul 16 00:13:44.474530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.473943    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:44.474530 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:44.474055    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:44.474530 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:44.474114    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:44.474530 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:44.474178    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:45.281294 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:45.281257    2556 generic.go:356] "Generic (PLEG): container finished" podID="209e3a07-8da7-4c79-9aee-87568a5f3c9d" containerID="73b67c3b43966e364804b8cd1387ae0a386c144dc6a0b5d9901a26419a1c9254" exitCode=0
Jul 16 00:13:45.282010 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:45.281347    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerDied","Data":"73b67c3b43966e364804b8cd1387ae0a386c144dc6a0b5d9901a26419a1c9254"}
Jul 16 00:13:45.965408 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:45.965375    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:45.965591 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:45.965490    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:45.965591 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:45.965549    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:45.965699 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:45.965680    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:46.965751 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:46.965671    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:46.966507 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:46.965794    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:47.288714 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:47.288682    2556 generic.go:356] "Generic (PLEG): container finished" podID="209e3a07-8da7-4c79-9aee-87568a5f3c9d" containerID="633dcc9d9856458151eb8828b7885523d9336a5bbc9961ee9c5023466cb953b3" exitCode=0
Jul 16 00:13:47.288927 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:47.288744    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerDied","Data":"633dcc9d9856458151eb8828b7885523d9336a5bbc9961ee9c5023466cb953b3"}
Jul 16 00:13:47.648343 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:47.648240    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:47.648343 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:47.648288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:47.648573 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.648397    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:47.648573 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.648397    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:47.648573 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.648469    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret podName:b5a86802-8113-42ea-aa36-498e3e37a8bf nodeName:}" failed. No retries permitted until 2026-07-16 00:14:19.648449187 +0000 UTC m=+65.220045465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret") pod "global-pull-secret-syncer-9w6gf" (UID: "b5a86802-8113-42ea-aa36-498e3e37a8bf") : object "kube-system"/"original-pull-secret" not registered
Jul 16 00:13:47.648573 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.648488    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:14:19.648479063 +0000 UTC m=+65.220075341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 00:13:47.749104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:47.749066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:47.749261 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.749226    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 00:13:47.749261 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.749243    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 00:13:47.749261 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.749256    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zqdn7 for pod openshift-network-diagnostics/network-check-target-jsrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:47.749359 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.749307    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7 podName:db269f0b-da22-40b4-8f57-b08edca25c06 nodeName:}" failed. No retries permitted until 2026-07-16 00:14:19.74929292 +0000 UTC m=+65.320889202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqdn7" (UniqueName: "kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7") pod "network-check-target-jsrpt" (UID: "db269f0b-da22-40b4-8f57-b08edca25c06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 00:13:47.965048 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:47.964951    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:47.965048 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:47.964990    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:47.965279 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.965085    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9w6gf" podUID="b5a86802-8113-42ea-aa36-498e3e37a8bf"
Jul 16 00:13:47.965279 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:47.965223    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsrpt" podUID="db269f0b-da22-40b4-8f57-b08edca25c06"
Jul 16 00:13:48.965676 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:48.965642    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:48.966256 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:48.965778    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:13:49.769979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.769798    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-233.ec2.internal" event="NodeReady"
Jul 16 00:13:49.770147 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.770077    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 00:13:49.817952 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.817860    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qxlqb"]
Jul 16 00:13:49.838721 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.838687    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2vj8z"]
Jul 16 00:13:49.838907 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.838846    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:49.841031 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.841000    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 00:13:49.841178 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.841107    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 00:13:49.841400 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.841236    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djqcn\""
Jul 16 00:13:49.862912 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.862869    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qxlqb"]
Jul 16 00:13:49.862912 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.862914    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2vj8z"]
Jul 16 00:13:49.863116 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.862991    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:49.865333 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.865311    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 00:13:49.865483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.865371    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kj65f\""
Jul 16 00:13:49.865483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.865310    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 00:13:49.865483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.865379    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 00:13:49.965143 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965099    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:13:49.965333 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965105    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:13:49.965333 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-tmp-dir\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:49.965333 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-config-volume\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:49.965497 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:49.965497 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8797115-44b2-452b-a8d6-57a20d7fe31a-cert\") pod \"ingress-canary-2vj8z\" (UID: \"e8797115-44b2-452b-a8d6-57a20d7fe31a\") " pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:49.965497 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965438    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67rqd\" (UniqueName: \"kubernetes.io/projected/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-kube-api-access-67rqd\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:49.965497 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.965469    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwrjf\" (UniqueName: \"kubernetes.io/projected/e8797115-44b2-452b-a8d6-57a20d7fe31a-kube-api-access-cwrjf\") pod \"ingress-canary-2vj8z\" (UID: \"e8797115-44b2-452b-a8d6-57a20d7fe31a\") " pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:49.968867 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.968840    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 00:13:49.969274 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.968880    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 00:13:49.969274 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.969141    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 00:13:49.969392 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:49.969365    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9p7\""
Jul 16 00:13:50.066322 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.066286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.066322 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.066330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8797115-44b2-452b-a8d6-57a20d7fe31a-cert\") pod \"ingress-canary-2vj8z\" (UID: \"e8797115-44b2-452b-a8d6-57a20d7fe31a\") " pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:50.066568 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.066368    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67rqd\" (UniqueName: \"kubernetes.io/projected/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-kube-api-access-67rqd\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.066568 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.066393    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrjf\" (UniqueName: \"kubernetes.io/projected/e8797115-44b2-452b-a8d6-57a20d7fe31a-kube-api-access-cwrjf\") pod \"ingress-canary-2vj8z\" (UID: \"e8797115-44b2-452b-a8d6-57a20d7fe31a\") " pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:50.066568 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.066439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-tmp-dir\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.066568 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:50.066481    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:13:50.066568 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.066491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-config-volume\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.066568 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:50.066555    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:50.566535036 +0000 UTC m=+36.138131331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:13:50.066934 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.066912    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-tmp-dir\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.067098 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.067082    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-config-volume\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.071654 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.071570    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8797115-44b2-452b-a8d6-57a20d7fe31a-cert\") pod \"ingress-canary-2vj8z\" (UID: \"e8797115-44b2-452b-a8d6-57a20d7fe31a\") " pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:50.077735 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.077706    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67rqd\" (UniqueName: \"kubernetes.io/projected/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-kube-api-access-67rqd\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.077880 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.077840    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwrjf\" (UniqueName: \"kubernetes.io/projected/e8797115-44b2-452b-a8d6-57a20d7fe31a-kube-api-access-cwrjf\") pod \"ingress-canary-2vj8z\" (UID: \"e8797115-44b2-452b-a8d6-57a20d7fe31a\") " pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:50.174105 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.174072    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2vj8z"
Jul 16 00:13:50.571112 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.571073    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:50.571314 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:50.571226    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:13:50.571385 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:50.571326    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:51.571301058 +0000 UTC m=+37.142897342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:13:50.965371 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.965275    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:13:50.967971 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.967943    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 00:13:50.968294 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:50.968275    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct92c\""
Jul 16 00:13:51.538756 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:51.538725    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2vj8z"]
Jul 16 00:13:51.579230 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:51.579201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:51.579358 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:51.579348    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:13:51.579423 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:51.579412    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:53.579391831 +0000 UTC m=+39.150988129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:13:51.588978 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:13:51.588938    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8797115_44b2_452b_a8d6_57a20d7fe31a.slice/crio-ded2153fb2833a95121d0d3cce4feb57a3b1ebb6a11add83a8b84ce95b3cec71 WatchSource:0}: Error finding container ded2153fb2833a95121d0d3cce4feb57a3b1ebb6a11add83a8b84ce95b3cec71: Status 404 returned error can't find the container with id ded2153fb2833a95121d0d3cce4feb57a3b1ebb6a11add83a8b84ce95b3cec71
Jul 16 00:13:52.303467 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:52.303425    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2vj8z" event={"ID":"e8797115-44b2-452b-a8d6-57a20d7fe31a","Type":"ContainerStarted","Data":"ded2153fb2833a95121d0d3cce4feb57a3b1ebb6a11add83a8b84ce95b3cec71"}
Jul 16 00:13:52.306548 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:52.306514    2556 generic.go:356] "Generic (PLEG): container finished" podID="209e3a07-8da7-4c79-9aee-87568a5f3c9d" containerID="11df7c821de05ab97219b00a06dc554ecf795fce8d88a79a377d89ad6b6eddb3" exitCode=0
Jul 16 00:13:52.306713 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:52.306564    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerDied","Data":"11df7c821de05ab97219b00a06dc554ecf795fce8d88a79a377d89ad6b6eddb3"}
Jul 16 00:13:53.313938 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:53.313685    2556 generic.go:356] "Generic (PLEG): container finished" podID="209e3a07-8da7-4c79-9aee-87568a5f3c9d" containerID="e1b238d534a38c3d1102f2ba1b8cb7c73f3a1e163b7cc91ff31d250df955c4de" exitCode=0
Jul 16 00:13:53.314381 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:53.313759    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerDied","Data":"e1b238d534a38c3d1102f2ba1b8cb7c73f3a1e163b7cc91ff31d250df955c4de"}
Jul 16 00:13:53.593813 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:53.593708    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:53.594011 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:53.593891    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:13:53.594011 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:53.593978    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:57.593953304 +0000 UTC m=+43.165549590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:13:54.317906 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:54.317871    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2vj8z" event={"ID":"e8797115-44b2-452b-a8d6-57a20d7fe31a","Type":"ContainerStarted","Data":"aeced8f35d4cf04c055e6242972ad4034179bffd72314f817e61ee3faa361c16"}
Jul 16 00:13:54.321273 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:54.321244    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh55z" event={"ID":"209e3a07-8da7-4c79-9aee-87568a5f3c9d","Type":"ContainerStarted","Data":"414954d95426b3458eba1e4a793e415c57cf0d4b18ae54d967f02f99a44e279b"}
Jul 16 00:13:54.332525 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:54.332465    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2vj8z" podStartSLOduration=3.003107342 podStartE2EDuration="5.332447074s" totalImagesPullingTime="2.329339732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:54.332304602 +0000 UTC m=+39.903900917" watchObservedRunningTime="2026-07-16 00:13:54.332447074 +0000 UTC m=+39.904043368"
Jul 16 00:13:54.354637 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:54.354566    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fh55z" podStartSLOduration=7.707531454 podStartE2EDuration="39.354544418s" totalImagesPullingTime="31.647012964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:54.35293071 +0000 UTC m=+39.924527011" watchObservedRunningTime="2026-07-16 00:13:54.354544418 +0000 UTC m=+39.926140720"
Jul 16 00:13:57.623701 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:13:57.623659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:13:57.624152 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:57.623789    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:13:57.624152 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:13:57.623843    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:14:05.623828879 +0000 UTC m=+51.195425158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:14:05.684716 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:05.684673    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:14:05.685206 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:05.684792    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:14:05.685206 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:05.684848    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:14:21.684831196 +0000 UTC m=+67.256427475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:14:09.109403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.109368    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"]
Jul 16 00:14:09.124897 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.124873    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.128548 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.128522    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"]
Jul 16 00:14:09.129369 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.129331    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 00:14:09.129903 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.129445    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 00:14:09.129903 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.129632    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 00:14:09.130902 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.130712    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 00:14:09.130902 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.130776    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 00:14:09.130902 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.130817    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 00:14:09.131719 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.131698    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 00:14:09.312395 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.312357    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-ca\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.312395 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.312394    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.312665 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.312444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.312665 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.312519    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9647\" (UniqueName: \"kubernetes.io/projected/6f3997b5-aaac-4918-950c-eb2477caaf6d-kube-api-access-f9647\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.312665 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.312555    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-hub\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.312665 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.312572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3997b5-aaac-4918-950c-eb2477caaf6d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.413777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.413686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.413915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.413776    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.413915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.413837    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9647\" (UniqueName: \"kubernetes.io/projected/6f3997b5-aaac-4918-950c-eb2477caaf6d-kube-api-access-f9647\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.413915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.413863    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-hub\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.413915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.413886    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3997b5-aaac-4918-950c-eb2477caaf6d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.414100 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.413941    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-ca\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.414644 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.414552    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f3997b5-aaac-4918-950c-eb2477caaf6d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.417836 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.417804    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-ca\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.417982 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.417906    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.417982 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.417923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.417982 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.417975    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f3997b5-aaac-4918-950c-eb2477caaf6d-hub\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.422280 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.422256    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9647\" (UniqueName: \"kubernetes.io/projected/6f3997b5-aaac-4918-950c-eb2477caaf6d-kube-api-access-f9647\") pod \"cluster-proxy-proxy-agent-7764964bff-cgq94\" (UID: \"6f3997b5-aaac-4918-950c-eb2477caaf6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.451213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.451178    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:14:09.595511 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:09.595477    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"]
Jul 16 00:14:09.598371 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:14:09.598347    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f3997b5_aaac_4918_950c_eb2477caaf6d.slice/crio-6527022c7a385d045475c2649d07571e7f68625eda38925b2a08d811237b8910 WatchSource:0}: Error finding container 6527022c7a385d045475c2649d07571e7f68625eda38925b2a08d811237b8910: Status 404 returned error can't find the container with id 6527022c7a385d045475c2649d07571e7f68625eda38925b2a08d811237b8910
Jul 16 00:14:10.362845 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:10.362804    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" event={"ID":"6f3997b5-aaac-4918-950c-eb2477caaf6d","Type":"ContainerStarted","Data":"6527022c7a385d045475c2649d07571e7f68625eda38925b2a08d811237b8910"}
Jul 16 00:14:14.375734 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:14.375698    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" event={"ID":"6f3997b5-aaac-4918-950c-eb2477caaf6d","Type":"ContainerStarted","Data":"0dea5d003f8284f84c57e839b0bbeda341e67f48ffb52fceecff57f367f23a5a"}
Jul 16 00:14:14.376149 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:14.375743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" event={"ID":"6f3997b5-aaac-4918-950c-eb2477caaf6d","Type":"ContainerStarted","Data":"306d23a3bd9d310e24373616df59a71c930002e6e42b9b29d26148890ac5f769"}
Jul 16 00:14:14.376149 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:14.375757    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" event={"ID":"6f3997b5-aaac-4918-950c-eb2477caaf6d","Type":"ContainerStarted","Data":"5e2b3b6911447d5112a46f18b4d82072339fcd8d007793cc80e7be99276f158d"}
Jul 16 00:14:14.392738 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:14.392692    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" podStartSLOduration=1.229868424 podStartE2EDuration="5.392680194s" totalImagesPullingTime="4.16281177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:14:14.391475728 +0000 UTC m=+59.963072020" watchObservedRunningTime="2026-07-16 00:14:14.392680194 +0000 UTC m=+59.964276495"
Jul 16 00:14:15.292805 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:15.292776    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgxtj"
Jul 16 00:14:19.687231 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.687186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:14:19.687727 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.687277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:14:19.689698 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.689678    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 00:14:19.689771 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.689723    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 00:14:19.697862 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:19.697848    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 00:14:19.697941 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:19.697916    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:15:23.697897551 +0000 UTC m=+129.269493831 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : secret "metrics-daemon-secret" not found
Jul 16 00:14:19.700063 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.700046    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5a86802-8113-42ea-aa36-498e3e37a8bf-original-pull-secret\") pod \"global-pull-secret-syncer-9w6gf\" (UID: \"b5a86802-8113-42ea-aa36-498e3e37a8bf\") " pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:14:19.787713 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.787659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:14:19.790042 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.790023    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 00:14:19.801223 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.801196    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 00:14:19.811705 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.811675    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqdn7\" (UniqueName: \"kubernetes.io/projected/db269f0b-da22-40b4-8f57-b08edca25c06-kube-api-access-zqdn7\") pod \"network-check-target-jsrpt\" (UID: \"db269f0b-da22-40b4-8f57-b08edca25c06\") " pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:14:19.977739 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.977649    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9w6gf"
Jul 16 00:14:19.986337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.986315    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9p7\""
Jul 16 00:14:19.994402 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:19.994369    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:14:20.129254 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:20.129221    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9w6gf"]
Jul 16 00:14:20.132798 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:14:20.132772    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a86802_8113_42ea_aa36_498e3e37a8bf.slice/crio-96b678f9f41fa19e7ce554bc103af76d951a1f9a01765b73521ab278fda4191c WatchSource:0}: Error finding container 96b678f9f41fa19e7ce554bc103af76d951a1f9a01765b73521ab278fda4191c: Status 404 returned error can't find the container with id 96b678f9f41fa19e7ce554bc103af76d951a1f9a01765b73521ab278fda4191c
Jul 16 00:14:20.147051 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:20.147018    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsrpt"]
Jul 16 00:14:20.149926 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:14:20.149892    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb269f0b_da22_40b4_8f57_b08edca25c06.slice/crio-106d75ea36489abfaa1c73f21f14d40e611d7cc3ad4ab944df53467b4cc66db1 WatchSource:0}: Error finding container 106d75ea36489abfaa1c73f21f14d40e611d7cc3ad4ab944df53467b4cc66db1: Status 404 returned error can't find the container with id 106d75ea36489abfaa1c73f21f14d40e611d7cc3ad4ab944df53467b4cc66db1
Jul 16 00:14:20.391914 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:20.391874    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9w6gf" event={"ID":"b5a86802-8113-42ea-aa36-498e3e37a8bf","Type":"ContainerStarted","Data":"96b678f9f41fa19e7ce554bc103af76d951a1f9a01765b73521ab278fda4191c"}
Jul 16 00:14:20.393029 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:20.393005    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsrpt" event={"ID":"db269f0b-da22-40b4-8f57-b08edca25c06","Type":"ContainerStarted","Data":"106d75ea36489abfaa1c73f21f14d40e611d7cc3ad4ab944df53467b4cc66db1"}
Jul 16 00:14:21.700929 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:21.700890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:14:21.701385 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:21.701090    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:14:21.701385 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:21.701170    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:14:53.701147675 +0000 UTC m=+99.272743958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:14:25.412673 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:25.412632    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9w6gf" event={"ID":"b5a86802-8113-42ea-aa36-498e3e37a8bf","Type":"ContainerStarted","Data":"10c969a7a32bbab3db5232f1ea0ae5b822f2090805bbadbd0d4ce37a85cd00a1"}
Jul 16 00:14:25.414176 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:25.414147    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsrpt" event={"ID":"db269f0b-da22-40b4-8f57-b08edca25c06","Type":"ContainerStarted","Data":"4ec0fba82491362ccf91fa3d35cce01708978740b91df567b124d87b312ccb24"}
Jul 16 00:14:25.414308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:25.414205    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:14:25.427832 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:25.427771    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9w6gf" podStartSLOduration=65.666414364 podStartE2EDuration="1m10.427752224s" totalImagesPullingTime="4.76133786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:14:25.426635805 +0000 UTC m=+70.998232108" watchObservedRunningTime="2026-07-16 00:14:25.427752224 +0000 UTC m=+70.999348526"
Jul 16 00:14:25.442337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:25.442279    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jsrpt" podStartSLOduration=65.709313157 podStartE2EDuration="1m10.442259969s" totalImagesPullingTime="4.732946812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:14:25.440997502 +0000 UTC m=+71.012593801" watchObservedRunningTime="2026-07-16 00:14:25.442259969 +0000 UTC m=+71.013856268"
Jul 16 00:14:53.716418 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:53.716365    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:14:53.716949 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:53.716525    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:14:53.716949 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:14:53.716601    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:15:57.71658417 +0000 UTC m=+163.288180451 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:14:56.421259 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:14:56.421227    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jsrpt"
Jul 16 00:15:23.721110 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:15:23.721063    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:15:23.721600 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:15:23.721206    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 00:15:23.721600 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:15:23.721285    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs podName:6f6ddb13-cc71-4f4e-970d-82c5568b989a nodeName:}" failed. No retries permitted until 2026-07-16 00:17:25.721267928 +0000 UTC m=+251.292864209 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs") pod "network-metrics-daemon-dsphw" (UID: "6f6ddb13-cc71-4f4e-970d-82c5568b989a") : secret "metrics-daemon-secret" not found
Jul 16 00:15:52.850004 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:15:52.849938    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qxlqb" podUID="ca7a43bf-ae34-40f8-b956-ca74a7d00afd"
Jul 16 00:15:53.666438 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:15:53.666408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:15:53.977836 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:15:53.977737    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dsphw" podUID="6f6ddb13-cc71-4f4e-970d-82c5568b989a"
Jul 16 00:15:57.764986 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:15:57.764934    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:15:57.765393 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:15:57.765091    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 00:15:57.765393 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:15:57.765167    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls podName:ca7a43bf-ae34-40f8-b956-ca74a7d00afd nodeName:}" failed. No retries permitted until 2026-07-16 00:17:59.765150844 +0000 UTC m=+285.336747123 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls") pod "dns-default-qxlqb" (UID: "ca7a43bf-ae34-40f8-b956-ca74a7d00afd") : secret "dns-default-metrics-tls" not found
Jul 16 00:16:06.965512 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:16:06.965426    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:17:05.408205 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.408173    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vsk2z"]
Jul 16 00:17:05.410458 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.410434    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.412939 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.412914    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 00:17:05.413238 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.412955    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 00:17:05.413238 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.413004    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 00:17:05.413238 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.413061    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 00:17:05.414041 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.414027    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hdqj5\""
Jul 16 00:17:05.423470 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.423439    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vsk2z"]
Jul 16 00:17:05.529972 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.529932    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.530153 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.530012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65608478-eba4-4ec8-b08b-5f4e56ef0fff-crio-socket\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.530153 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.530046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65608478-eba4-4ec8-b08b-5f4e56ef0fff-data-volume\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.530153 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.530064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qpb\" (UniqueName: \"kubernetes.io/projected/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-api-access-t5qpb\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.530153 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.530085    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.631317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.631286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65608478-eba4-4ec8-b08b-5f4e56ef0fff-crio-socket\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.631437 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.631330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65608478-eba4-4ec8-b08b-5f4e56ef0fff-data-volume\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.631437 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.631346    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qpb\" (UniqueName: \"kubernetes.io/projected/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-api-access-t5qpb\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.631437 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.631363    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.631437 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.631409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.631595 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.631451    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65608478-eba4-4ec8-b08b-5f4e56ef0fff-crio-socket\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.631595 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:05.631498    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:05.631595 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:05.631507    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:17:05.631595 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:05.631581    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:06.131556675 +0000 UTC m=+231.703152955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:05.631864 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:05.631630    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:06.131592227 +0000 UTC m=+231.703188508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : configmap "kube-rbac-proxy" not found
Jul 16 00:17:05.631864 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.631713    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65608478-eba4-4ec8-b08b-5f4e56ef0fff-data-volume\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:05.639957 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:05.639932    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qpb\" (UniqueName: \"kubernetes.io/projected/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-api-access-t5qpb\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:06.134840 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:06.134809    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:06.135036 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:06.134874    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:06.135036 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:06.134943    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:17:06.135036 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:06.134968    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:06.135036 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:06.135008    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:07.134992365 +0000 UTC m=+232.706588645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : configmap "kube-rbac-proxy" not found
Jul 16 00:17:06.135036 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:06.135022    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:07.135016108 +0000 UTC m=+232.706612386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:07.141913 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:07.141852    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:07.142323 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:07.141944    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:07.142323 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:07.142025    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:07.142323 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:07.142072    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:17:07.142323 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:07.142087    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:09.142073193 +0000 UTC m=+234.713669472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:07.142323 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:07.142149    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:09.142129374 +0000 UTC m=+234.713725667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : configmap "kube-rbac-proxy" not found
Jul 16 00:17:08.404044 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:08.404017    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rlk2r_4677dd29-51b6-432c-a9e4-3f68e230926b/dns-node-resolver/0.log"
Jul 16 00:17:09.004529 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:09.004501    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7r8gq_74346c98-2a0c-4a75-8ae1-cfc18955b9bb/node-ca/0.log"
Jul 16 00:17:09.158496 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:09.158463    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:09.158660 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:09.158520    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:09.158660 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:09.158645    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:17:09.158660 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:09.158651    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:09.158774 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:09.158725    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:13.158704577 +0000 UTC m=+238.730300861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : configmap "kube-rbac-proxy" not found
Jul 16 00:17:09.158774 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:09.158739    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:13.158733685 +0000 UTC m=+238.730329963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:09.804772 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:09.804746    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2vj8z_e8797115-44b2-452b-a8d6-57a20d7fe31a/serve-healthcheck-canary/0.log"
Jul 16 00:17:13.189550 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:13.189512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:13.190040 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:13.189585    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:13.190040 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:13.189676    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 00:17:13.190040 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:13.189733    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:13.190040 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:13.189774    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:21.189753649 +0000 UTC m=+246.761349943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : configmap "kube-rbac-proxy" not found
Jul 16 00:17:13.190040 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:13.189793    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls podName:65608478-eba4-4ec8-b08b-5f4e56ef0fff nodeName:}" failed. No retries permitted until 2026-07-16 00:17:21.189786647 +0000 UTC m=+246.761382926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vsk2z" (UID: "65608478-eba4-4ec8-b08b-5f4e56ef0fff") : secret "insights-runtime-extractor-tls" not found
Jul 16 00:17:21.249273 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.249238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:21.249765 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.249294    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:21.249765 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.249753    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65608478-eba4-4ec8-b08b-5f4e56ef0fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:21.251736 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.251701    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65608478-eba4-4ec8-b08b-5f4e56ef0fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsk2z\" (UID: \"65608478-eba4-4ec8-b08b-5f4e56ef0fff\") " pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:21.322044 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.322008    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hdqj5\""
Jul 16 00:17:21.330112 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.330093    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vsk2z"
Jul 16 00:17:21.453387 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.453361    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vsk2z"]
Jul 16 00:17:21.455881 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:21.455854    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65608478_eba4_4ec8_b08b_5f4e56ef0fff.slice/crio-8771d7699d553056947723da2b0fb82ec88b8605b6457cab4d61f3d43cb50850 WatchSource:0}: Error finding container 8771d7699d553056947723da2b0fb82ec88b8605b6457cab4d61f3d43cb50850: Status 404 returned error can't find the container with id 8771d7699d553056947723da2b0fb82ec88b8605b6457cab4d61f3d43cb50850
Jul 16 00:17:21.926337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:21.926296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsk2z" event={"ID":"65608478-eba4-4ec8-b08b-5f4e56ef0fff","Type":"ContainerStarted","Data":"8771d7699d553056947723da2b0fb82ec88b8605b6457cab4d61f3d43cb50850"}
Jul 16 00:17:25.779969 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:25.779927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:17:25.782410 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:25.782380    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f6ddb13-cc71-4f4e-970d-82c5568b989a-metrics-certs\") pod \"network-metrics-daemon-dsphw\" (UID: \"6f6ddb13-cc71-4f4e-970d-82c5568b989a\") " pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:17:25.869104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:25.869074    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct92c\""
Jul 16 00:17:25.877085 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:25.877062    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsphw"
Jul 16 00:17:26.371200 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.371166    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dsphw"]
Jul 16 00:17:26.374814 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:26.374772    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6ddb13_cc71_4f4e_970d_82c5568b989a.slice/crio-9249aad10483b5898648dd3a0c9acea32f12a5d8f462918eeb98d02fa8f7b699 WatchSource:0}: Error finding container 9249aad10483b5898648dd3a0c9acea32f12a5d8f462918eeb98d02fa8f7b699: Status 404 returned error can't find the container with id 9249aad10483b5898648dd3a0c9acea32f12a5d8f462918eeb98d02fa8f7b699
Jul 16 00:17:26.945805 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.945735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dsphw" event={"ID":"6f6ddb13-cc71-4f4e-970d-82c5568b989a","Type":"ContainerStarted","Data":"9249aad10483b5898648dd3a0c9acea32f12a5d8f462918eeb98d02fa8f7b699"}
Jul 16 00:17:26.948532 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.948471    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsk2z" event={"ID":"65608478-eba4-4ec8-b08b-5f4e56ef0fff","Type":"ContainerStarted","Data":"8e32571b166ea2674d0aa16db59ddda7818e166979f08e204e1c842be7177403"}
Jul 16 00:17:26.953952 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.953924    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-755b6c84bf-k4dh9"]
Jul 16 00:17:26.956374 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.956353    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:26.959196 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.959171    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 00:17:26.959438 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.959420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 00:17:26.959717 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.959687    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cws9t\""
Jul 16 00:17:26.959817 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.959745    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 00:17:26.970474 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.970438    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 00:17:26.973104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:26.973058    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755b6c84bf-k4dh9"]
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.090827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-ca-trust-extracted\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.090884    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tnfx\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-kube-api-access-5tnfx\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.090927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-registry-tls\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.090954    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-registry-certificates\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.090978    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-trusted-ca\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.091021    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-image-registry-private-configuration\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.091047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-installation-pull-secrets\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.091248 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.091081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-bound-sa-token\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-ca-trust-extracted\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192386    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tnfx\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-kube-api-access-5tnfx\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-registry-tls\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192453    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-registry-certificates\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192479    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-trusted-ca\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192519    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-image-registry-private-configuration\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-installation-pull-secrets\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192576    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-bound-sa-token\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193215 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.192867    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-ca-trust-extracted\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193967 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.193758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-registry-certificates\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.193967 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.193878    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-trusted-ca\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.197126 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.197050    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-image-registry-private-configuration\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.198837 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.198809    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-installation-pull-secrets\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.199583 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.199535    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-registry-tls\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.207396 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.207192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-bound-sa-token\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.207669 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.207645    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tnfx\" (UniqueName: \"kubernetes.io/projected/c7f0640e-2b7d-400c-94a0-8e53a7a3762b-kube-api-access-5tnfx\") pod \"image-registry-755b6c84bf-k4dh9\" (UID: \"c7f0640e-2b7d-400c-94a0-8e53a7a3762b\") " pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.272743 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.272706    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.536855 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.536835    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755b6c84bf-k4dh9"]
Jul 16 00:17:27.539892 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:27.539851    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f0640e_2b7d_400c_94a0_8e53a7a3762b.slice/crio-adb4a62a6c7040af0d50372cfccd68afd1e565a8c83f10f3fc6c3bfd20589ce2 WatchSource:0}: Error finding container adb4a62a6c7040af0d50372cfccd68afd1e565a8c83f10f3fc6c3bfd20589ce2: Status 404 returned error can't find the container with id adb4a62a6c7040af0d50372cfccd68afd1e565a8c83f10f3fc6c3bfd20589ce2
Jul 16 00:17:27.959315 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.959263    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dsphw" event={"ID":"6f6ddb13-cc71-4f4e-970d-82c5568b989a","Type":"ContainerStarted","Data":"cfc7c24c8a8aad20e001f593935733ead98b5f9f991685f832e663109bc8deac"}
Jul 16 00:17:27.959785 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.959362    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dsphw" event={"ID":"6f6ddb13-cc71-4f4e-970d-82c5568b989a","Type":"ContainerStarted","Data":"1006992fd1990be3b559de11542c291881b325a0fd55ac6366f9970c04f7dff2"}
Jul 16 00:17:27.961593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.961533    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9" event={"ID":"c7f0640e-2b7d-400c-94a0-8e53a7a3762b","Type":"ContainerStarted","Data":"96f1b60072312d07f05f902f38b8005df6f7a877351285b52cb8e0a5cc486db2"}
Jul 16 00:17:27.961593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.961577    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9" event={"ID":"c7f0640e-2b7d-400c-94a0-8e53a7a3762b","Type":"ContainerStarted","Data":"adb4a62a6c7040af0d50372cfccd68afd1e565a8c83f10f3fc6c3bfd20589ce2"}
Jul 16 00:17:27.961791 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.961662    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:27.976740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.976341    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dsphw" podStartSLOduration=251.924739024 podStartE2EDuration="4m12.976323125s" totalImagesPullingTime="1.051584101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:27.975632321 +0000 UTC m=+253.547228636" watchObservedRunningTime="2026-07-16 00:17:27.976323125 +0000 UTC m=+253.547919427"
Jul 16 00:17:27.996743 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:27.996671    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9" podStartSLOduration=1.9966443059999999 podStartE2EDuration="1.996644306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:27.995824046 +0000 UTC m=+253.567420352" watchObservedRunningTime="2026-07-16 00:17:27.996644306 +0000 UTC m=+253.568240614"
Jul 16 00:17:29.969856 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:29.969820    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsk2z" event={"ID":"65608478-eba4-4ec8-b08b-5f4e56ef0fff","Type":"ContainerStarted","Data":"f90f9cceab36ebfb6609d7e16ada8236a1ca95e997281becdf38f38a6cb537a0"}
Jul 16 00:17:33.986967 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:33.986933    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsk2z" event={"ID":"65608478-eba4-4ec8-b08b-5f4e56ef0fff","Type":"ContainerStarted","Data":"eb98286e9120f2c71fe4f8cfa92082badbf6360b1d2ce35a1e4447368f8c812a"}
Jul 16 00:17:34.028464 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:34.028407    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vsk2z" podStartSLOduration=17.266104887 podStartE2EDuration="29.028388873s" totalImagesPullingTime="11.762283986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:17:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:34.028036933 +0000 UTC m=+259.599633235" watchObservedRunningTime="2026-07-16 00:17:34.028388873 +0000 UTC m=+259.599985173"
Jul 16 00:17:36.920006 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.919915    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wdktq"]
Jul 16 00:17:36.922328 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.922306    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.925920 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.925896    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 00:17:36.926051 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.925924    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 00:17:36.926051 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.925897    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 00:17:36.926051 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.925902    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 00:17:36.926212 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.925909    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 00:17:36.926212 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.925896    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2h5dm\""
Jul 16 00:17:36.926212 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.925940    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 00:17:36.970442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-root\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970446    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970658 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-wtmp\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970658 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970519    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194f7b7c-0adf-45ec-9420-9b97fe752524-metrics-client-ca\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970658 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970580    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-tls\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970658 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-sys\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970783 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970671    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970783 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4ch\" (UniqueName: \"kubernetes.io/projected/194f7b7c-0adf-45ec-9420-9b97fe752524-kube-api-access-rk4ch\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:36.970783 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:36.970720    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-textfile\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071367 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071331    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-tls\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071367 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-sys\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071661 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071661 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071449    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4ch\" (UniqueName: \"kubernetes.io/projected/194f7b7c-0adf-45ec-9420-9b97fe752524-kube-api-access-rk4ch\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071661 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071489    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-sys\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071661 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071572    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-textfile\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-root\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071695    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071743    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-wtmp\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071778    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194f7b7c-0adf-45ec-9420-9b97fe752524-metrics-client-ca\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.071887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071866    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-root\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.072191 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.071918    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-textfile\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.072191 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.072014    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-wtmp\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.072455 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.072433    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194f7b7c-0adf-45ec-9420-9b97fe752524-metrics-client-ca\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.072555 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.072506    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.073933 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.073911    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.074035 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.074018    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/194f7b7c-0adf-45ec-9420-9b97fe752524-node-exporter-tls\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.079786 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.079762    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4ch\" (UniqueName: \"kubernetes.io/projected/194f7b7c-0adf-45ec-9420-9b97fe752524-kube-api-access-rk4ch\") pod \"node-exporter-wdktq\" (UID: \"194f7b7c-0adf-45ec-9420-9b97fe752524\") " pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.232330 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.232243    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdktq"
Jul 16 00:17:37.243876 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:37.243843    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194f7b7c_0adf_45ec_9420_9b97fe752524.slice/crio-9911c25a6ee1ce2badc78417be4597b725fc777b2797bc743e49e40fdfacdd32 WatchSource:0}: Error finding container 9911c25a6ee1ce2badc78417be4597b725fc777b2797bc743e49e40fdfacdd32: Status 404 returned error can't find the container with id 9911c25a6ee1ce2badc78417be4597b725fc777b2797bc743e49e40fdfacdd32
Jul 16 00:17:37.535634 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.535573    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f9d7555-2hdwz"]
Jul 16 00:17:37.537763 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.537745    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.540462 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.540435    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 00:17:37.540647 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.540536    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 00:17:37.540647 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.540623    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 00:17:37.540784 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.540663    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 00:17:37.540784 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.540670    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ht6jq\""
Jul 16 00:17:37.540873 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.540807    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 00:17:37.541830 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.541804    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 00:17:37.542132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.542059    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 00:17:37.548259 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.548231    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f9d7555-2hdwz"]
Jul 16 00:17:37.576300 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.576260    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jvfg\" (UniqueName: \"kubernetes.io/projected/93cc8a44-5ac5-447b-93f5-212f16f12c48-kube-api-access-7jvfg\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.576300 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.576303    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-service-ca\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.576517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.576331    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-oauth-serving-cert\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.576517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.576419    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-config\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.576517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.576475    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-serving-cert\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.576517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.576508    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-oauth-config\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.677755 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.677722    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-oauth-serving-cert\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.677919 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.677768    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-config\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.677919 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.677803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-serving-cert\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.677919 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.677902    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-oauth-config\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.678081 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.677966    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jvfg\" (UniqueName: \"kubernetes.io/projected/93cc8a44-5ac5-447b-93f5-212f16f12c48-kube-api-access-7jvfg\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.678081 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.677997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-service-ca\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.678575 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.678545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-oauth-serving-cert\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.678575 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.678564    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-service-ca\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.678774 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.678750    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-config\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.680402 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.680382    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-serving-cert\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.680516 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.680421    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-oauth-config\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.688033 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.688009    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jvfg\" (UniqueName: \"kubernetes.io/projected/93cc8a44-5ac5-447b-93f5-212f16f12c48-kube-api-access-7jvfg\") pod \"console-84f9d7555-2hdwz\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") " pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.852527 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.852443    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:37.966595 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.966555    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:17:37.969490 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.969465    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:37.972203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.971960    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 00:17:37.972203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.971991    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 00:17:37.972203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972065    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 00:17:37.972461 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972361    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 00:17:37.972461 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972369    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 00:17:37.972461 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972447    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 00:17:37.972695 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972671    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 00:17:37.972843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972725    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 00:17:37.972843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972672    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s5gkv\""
Jul 16 00:17:37.972843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.972731    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 00:17:37.985327 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.985302    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:17:37.999133 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:37.999057    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f9d7555-2hdwz"]
Jul 16 00:17:38.001228 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.001202    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdktq" event={"ID":"194f7b7c-0adf-45ec-9420-9b97fe752524","Type":"ContainerStarted","Data":"9911c25a6ee1ce2badc78417be4597b725fc777b2797bc743e49e40fdfacdd32"}
Jul 16 00:17:38.081627 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.081583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.081808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.081668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.081808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.081713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.081808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.081739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2zgj\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-kube-api-access-x2zgj\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.081808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.081784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-config-out\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082486 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082455    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-config-volume\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082521    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082687    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082940 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082940 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.082940 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.082794    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-web-config\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.168399 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:38.168320    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cc8a44_5ac5_447b_93f5_212f16f12c48.slice/crio-0243a663158c0945d5d61ac88fd1233756adbdd6ddbfaabdc03ccbbabf2f88cc WatchSource:0}: Error finding container 0243a663158c0945d5d61ac88fd1233756adbdd6ddbfaabdc03ccbbabf2f88cc: Status 404 returned error can't find the container with id 0243a663158c0945d5d61ac88fd1233756adbdd6ddbfaabdc03ccbbabf2f88cc
Jul 16 00:17:38.183799 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.183765    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.183886 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.183809    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.183886 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.183828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.183945 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.183880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-web-config\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.183945 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.183920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.183948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.183990    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.184018    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2zgj\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-kube-api-access-x2zgj\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184164 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.184045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-config-out\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184164 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.184082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-config-volume\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184259 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.184184    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184259 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:38.184186    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle podName:57710085-c82b-496e-9e04-10dc697dd21f nodeName:}" failed. No retries permitted until 2026-07-16 00:17:38.684161423 +0000 UTC m=+264.255757707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "57710085-c82b-496e-9e04-10dc697dd21f") : configmap references non-existent config key: ca-bundle.crt
Jul 16 00:17:38.184259 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.184226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.184269    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.184403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.184293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.185307 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.185260    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.187396 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.187161    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.187782 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.187594    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.187782 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.187715    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.187908 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.187888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.188088 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.188048    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-web-config\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.188443 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.188398    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-config-out\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.188598 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.188576    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-config-volume\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.189316 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.189295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.189506 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.189486    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.192389 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.192367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2zgj\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-kube-api-access-x2zgj\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.690140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.690101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.690953 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.690922    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:38.881077 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:38.881038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:17:39.005836 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:39.005806    2556 generic.go:356] "Generic (PLEG): container finished" podID="194f7b7c-0adf-45ec-9420-9b97fe752524" containerID="4988d3080d747770f56b99c40dafe3a52bbc28e6f00d6a44ea1857b66f3d933f" exitCode=0
Jul 16 00:17:39.006227 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:39.005882    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdktq" event={"ID":"194f7b7c-0adf-45ec-9420-9b97fe752524","Type":"ContainerDied","Data":"4988d3080d747770f56b99c40dafe3a52bbc28e6f00d6a44ea1857b66f3d933f"}
Jul 16 00:17:39.007129 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:39.007098    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f9d7555-2hdwz" event={"ID":"93cc8a44-5ac5-447b-93f5-212f16f12c48","Type":"ContainerStarted","Data":"0243a663158c0945d5d61ac88fd1233756adbdd6ddbfaabdc03ccbbabf2f88cc"}
Jul 16 00:17:39.023862 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:39.023054    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:17:39.028810 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:39.028775    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57710085_c82b_496e_9e04_10dc697dd21f.slice/crio-4643ddd7c53663586ef3f37e514c51ce7210a425fc8ad4098f2e9375a6754d5b WatchSource:0}: Error finding container 4643ddd7c53663586ef3f37e514c51ce7210a425fc8ad4098f2e9375a6754d5b: Status 404 returned error can't find the container with id 4643ddd7c53663586ef3f37e514c51ce7210a425fc8ad4098f2e9375a6754d5b
Jul 16 00:17:40.014783 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:40.014392    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdktq" event={"ID":"194f7b7c-0adf-45ec-9420-9b97fe752524","Type":"ContainerStarted","Data":"5d53ca1149d47b4017184299476cd1da369464a05f6d59f34bf9b46e040b671e"}
Jul 16 00:17:40.014783 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:40.014465    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdktq" event={"ID":"194f7b7c-0adf-45ec-9420-9b97fe752524","Type":"ContainerStarted","Data":"b65827bcf1bb2ef27fa6c5bfba52d767bc54f5b7ac66de174598372d576faa4c"}
Jul 16 00:17:40.016189 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:40.016159    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerStarted","Data":"4643ddd7c53663586ef3f37e514c51ce7210a425fc8ad4098f2e9375a6754d5b"}
Jul 16 00:17:40.036409 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:40.036347    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wdktq" podStartSLOduration=2.997718333 podStartE2EDuration="4.036329001s" totalImagesPullingTime="968.353878ms" totalInitContainerRuntime="70.25679ms" isStatefulPod=true podCreationTimestamp="2026-07-16 00:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:40.035565699 +0000 UTC m=+265.607162001" watchObservedRunningTime="2026-07-16 00:17:40.036329001 +0000 UTC m=+265.607925303"
Jul 16 00:17:41.022734 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.022694    2556 generic.go:356] "Generic (PLEG): container finished" podID="57710085-c82b-496e-9e04-10dc697dd21f" containerID="59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc" exitCode=0
Jul 16 00:17:41.023200 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.022753    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc"}
Jul 16 00:17:41.308916 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.308836    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65b5bbd795-dwffs"]
Jul 16 00:17:41.317579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.317543    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.321663 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.321632    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a1ooio5bt0rkq\""
Jul 16 00:17:41.321663 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.321657    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 16 00:17:41.321885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.321631    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 00:17:41.321885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.321681    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 16 00:17:41.322630 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.322595    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4zjqz\""
Jul 16 00:17:41.322630 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.322622    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 16 00:17:41.326048 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.325946    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65b5bbd795-dwffs"]
Jul 16 00:17:41.414693 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.414664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-secret-metrics-server-client-certs\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.414850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.414756    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-secret-metrics-server-tls\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.414850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.414794    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c38067-c631-451d-aaae-408ea5b3d5f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.414850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.414817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/82c38067-c631-451d-aaae-408ea5b3d5f3-audit-log\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.414850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.414844    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/82c38067-c631-451d-aaae-408ea5b3d5f3-metrics-server-audit-profiles\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.414991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.414878    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47z7c\" (UniqueName: \"kubernetes.io/projected/82c38067-c631-451d-aaae-408ea5b3d5f3-kube-api-access-47z7c\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.414991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.414906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-client-ca-bundle\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.515960 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.515919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-client-ca-bundle\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.516101 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.515999    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-secret-metrics-server-client-certs\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.516101 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.516064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-secret-metrics-server-tls\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.516183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.516102    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c38067-c631-451d-aaae-408ea5b3d5f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.516183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.516130    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/82c38067-c631-451d-aaae-408ea5b3d5f3-audit-log\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.516183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.516164    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/82c38067-c631-451d-aaae-408ea5b3d5f3-metrics-server-audit-profiles\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.516320 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.516202    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47z7c\" (UniqueName: \"kubernetes.io/projected/82c38067-c631-451d-aaae-408ea5b3d5f3-kube-api-access-47z7c\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.516635 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.516583    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/82c38067-c631-451d-aaae-408ea5b3d5f3-audit-log\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.517075 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.517010    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c38067-c631-451d-aaae-408ea5b3d5f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.517213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.517192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/82c38067-c631-451d-aaae-408ea5b3d5f3-metrics-server-audit-profiles\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.518884 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.518856    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-secret-metrics-server-tls\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.518970 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.518868    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-secret-metrics-server-client-certs\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.518970 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.518935    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c38067-c631-451d-aaae-408ea5b3d5f3-client-ca-bundle\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.527726 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.527690    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47z7c\" (UniqueName: \"kubernetes.io/projected/82c38067-c631-451d-aaae-408ea5b3d5f3-kube-api-access-47z7c\") pod \"metrics-server-65b5bbd795-dwffs\" (UID: \"82c38067-c631-451d-aaae-408ea5b3d5f3\") " pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.629850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.629752    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:17:41.773926 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:41.773897    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65b5bbd795-dwffs"]
Jul 16 00:17:41.776998 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:41.776972    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c38067_c631_451d_aaae_408ea5b3d5f3.slice/crio-09922f7f3fe66b9355038a97760e83859a4cdb850108f778fcfd5eae4c2f9204 WatchSource:0}: Error finding container 09922f7f3fe66b9355038a97760e83859a4cdb850108f778fcfd5eae4c2f9204: Status 404 returned error can't find the container with id 09922f7f3fe66b9355038a97760e83859a4cdb850108f778fcfd5eae4c2f9204
Jul 16 00:17:42.027693 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:42.027650    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f9d7555-2hdwz" event={"ID":"93cc8a44-5ac5-447b-93f5-212f16f12c48","Type":"ContainerStarted","Data":"dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1"}
Jul 16 00:17:42.028831 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:42.028808    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs" event={"ID":"82c38067-c631-451d-aaae-408ea5b3d5f3","Type":"ContainerStarted","Data":"09922f7f3fe66b9355038a97760e83859a4cdb850108f778fcfd5eae4c2f9204"}
Jul 16 00:17:42.044622 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:42.044562    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f9d7555-2hdwz" podStartSLOduration=1.747099908 podStartE2EDuration="5.044547183s" totalImagesPullingTime="3.297447275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:42.043353598 +0000 UTC m=+267.614949899" watchObservedRunningTime="2026-07-16 00:17:42.044547183 +0000 UTC m=+267.616143533"
Jul 16 00:17:43.036147 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:43.036100    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerStarted","Data":"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"}
Jul 16 00:17:43.036504 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:43.036190    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerStarted","Data":"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"}
Jul 16 00:17:43.036504 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:43.036220    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerStarted","Data":"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"}
Jul 16 00:17:44.041363 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:44.041324    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs" event={"ID":"82c38067-c631-451d-aaae-408ea5b3d5f3","Type":"ContainerStarted","Data":"badb6095cd11c23639922ebad47bfc28dcb451a192a807fef40e95920c5e1ffb"}
Jul 16 00:17:44.044465 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:44.044432    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerStarted","Data":"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"}
Jul 16 00:17:44.044636 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:44.044509    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerStarted","Data":"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"}
Jul 16 00:17:44.060101 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:44.060042    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs" podStartSLOduration=1.51855088 podStartE2EDuration="3.060026345s" totalImagesPullingTime="1.541475465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:44.058719065 +0000 UTC m=+269.630315367" watchObservedRunningTime="2026-07-16 00:17:44.060026345 +0000 UTC m=+269.631622645"
Jul 16 00:17:45.051297 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:45.051263    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerStarted","Data":"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"}
Jul 16 00:17:45.079518 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:45.079474    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.253169201 podStartE2EDuration="8.079459985s" totalImagesPullingTime="3.806874935s" totalInitContainerRuntime="19.415849ms" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:45.07722965 +0000 UTC m=+270.648825987" watchObservedRunningTime="2026-07-16 00:17:45.079459985 +0000 UTC m=+270.651056287"
Jul 16 00:17:47.277877 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.277837    2556 patch_prober.go:28] interesting pod/image-registry-755b6c84bf-k4dh9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 00:17:47.278230 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.277889    2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9" podUID="c7f0640e-2b7d-400c-94a0-8e53a7a3762b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 00:17:47.725853 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.725768    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6fc9999b-dnwpz"]
Jul 16 00:17:47.729101 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.729084    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.739232 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.739204    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 00:17:47.739928 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.739904    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6fc9999b-dnwpz"]
Jul 16 00:17:47.853021 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.852985    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:47.853167 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.853040    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:47.857846 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.857820    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:47.874601 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.874569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-trusted-ca-bundle\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.874601 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.874602    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-service-ca\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.874786 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.874681    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-console-config\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.874786 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.874735    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-serving-cert\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.874786 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.874768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-oauth-config\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.874890 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.874839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-oauth-serving-cert\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.874890 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.874879    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4p44\" (UniqueName: \"kubernetes.io/projected/cc287138-2b49-4f99-82d2-067459f1d1c2-kube-api-access-f4p44\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.976207 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.976107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-console-config\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.976207 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.976168    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-serving-cert\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.976429 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.976211    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-oauth-config\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.976429 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.976247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-oauth-serving-cert\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.976429 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.976293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4p44\" (UniqueName: \"kubernetes.io/projected/cc287138-2b49-4f99-82d2-067459f1d1c2-kube-api-access-f4p44\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.976429 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.976403    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-trusted-ca-bundle\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.976676 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.976456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-service-ca\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.977026 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.977000    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-console-config\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.977114 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.977059    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-oauth-serving-cert\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.977173 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.977139    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-service-ca\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.977173 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.977151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-trusted-ca-bundle\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.978960 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.978934    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-oauth-config\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.979749 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.979731    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-serving-cert\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:47.984294 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:47.984265    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4p44\" (UniqueName: \"kubernetes.io/projected/cc287138-2b49-4f99-82d2-067459f1d1c2-kube-api-access-f4p44\") pod \"console-6d6fc9999b-dnwpz\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") " pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:48.038321 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:48.038278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:48.066679 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:48.066649    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:17:48.188154 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:48.188127    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6fc9999b-dnwpz"]
Jul 16 00:17:48.191072 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:17:48.191035    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc287138_2b49_4f99_82d2_067459f1d1c2.slice/crio-be8652eeadd4c272ae15d76df45697a60a9bc927b6a5418eedcc194d6526e688 WatchSource:0}: Error finding container be8652eeadd4c272ae15d76df45697a60a9bc927b6a5418eedcc194d6526e688: Status 404 returned error can't find the container with id be8652eeadd4c272ae15d76df45697a60a9bc927b6a5418eedcc194d6526e688
Jul 16 00:17:48.970120 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:48.970092    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-755b6c84bf-k4dh9"
Jul 16 00:17:49.067987 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:49.067950    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6fc9999b-dnwpz" event={"ID":"cc287138-2b49-4f99-82d2-067459f1d1c2","Type":"ContainerStarted","Data":"d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640"}
Jul 16 00:17:49.068138 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:49.068003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6fc9999b-dnwpz" event={"ID":"cc287138-2b49-4f99-82d2-067459f1d1c2","Type":"ContainerStarted","Data":"be8652eeadd4c272ae15d76df45697a60a9bc927b6a5418eedcc194d6526e688"}
Jul 16 00:17:49.086241 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:49.086179    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6fc9999b-dnwpz" podStartSLOduration=2.086162453 podStartE2EDuration="2.086162453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:49.085292331 +0000 UTC m=+274.656888632" watchObservedRunningTime="2026-07-16 00:17:49.086162453 +0000 UTC m=+274.657758755"
Jul 16 00:17:49.452680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:49.452645    2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" podUID="6f3997b5-aaac-4918-950c-eb2477caaf6d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 00:17:56.667656 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:17:56.667577    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qxlqb" podUID="ca7a43bf-ae34-40f8-b956-ca74a7d00afd"
Jul 16 00:17:57.092238 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:57.092209    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:17:58.039026 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:58.038978    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:58.039512 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:58.039049    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:58.043937 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:58.043912    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:58.100095 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:58.100068    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:17:58.142578 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:58.142547    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f9d7555-2hdwz"]
Jul 16 00:17:59.453234 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:59.453172    2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" podUID="6f3997b5-aaac-4918-950c-eb2477caaf6d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 00:17:59.777968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:59.777939    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:17:59.780379 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:59.780348    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca7a43bf-ae34-40f8-b956-ca74a7d00afd-metrics-tls\") pod \"dns-default-qxlqb\" (UID: \"ca7a43bf-ae34-40f8-b956-ca74a7d00afd\") " pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:17:59.795769 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:59.795748    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djqcn\""
Jul 16 00:17:59.803816 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:17:59.803796    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:18:00.118511 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:00.118436    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qxlqb"]
Jul 16 00:18:00.121238 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:18:00.121208    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7a43bf_ae34_40f8_b956_ca74a7d00afd.slice/crio-8ca170228dff9f3a68d40313bbcf00782d124c70279b613a0a54c3e5d8dfa8bd WatchSource:0}: Error finding container 8ca170228dff9f3a68d40313bbcf00782d124c70279b613a0a54c3e5d8dfa8bd: Status 404 returned error can't find the container with id 8ca170228dff9f3a68d40313bbcf00782d124c70279b613a0a54c3e5d8dfa8bd
Jul 16 00:18:01.108965 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:01.108928    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxlqb" event={"ID":"ca7a43bf-ae34-40f8-b956-ca74a7d00afd","Type":"ContainerStarted","Data":"8ca170228dff9f3a68d40313bbcf00782d124c70279b613a0a54c3e5d8dfa8bd"}
Jul 16 00:18:01.630260 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:01.630212    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:18:01.630471 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:01.630301    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:18:03.118213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:03.118125    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxlqb" event={"ID":"ca7a43bf-ae34-40f8-b956-ca74a7d00afd","Type":"ContainerStarted","Data":"6f62609537d6726a5f4c41a09e0ee6599350890731ef5ea4386ae30952b11441"}
Jul 16 00:18:03.118213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:03.118185    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxlqb" event={"ID":"ca7a43bf-ae34-40f8-b956-ca74a7d00afd","Type":"ContainerStarted","Data":"ee46f9a4bfa5278cde4d9511258108edde69851da9caa5c750a6ed4322a87719"}
Jul 16 00:18:03.118701 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:03.118255    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:18:03.136285 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:03.136232    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qxlqb" podStartSLOduration=251.466464596 podStartE2EDuration="4m14.136211037s" totalImagesPullingTime="2.669746441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:18:03.134786311 +0000 UTC m=+288.706382613" watchObservedRunningTime="2026-07-16 00:18:03.136211037 +0000 UTC m=+288.707807338"
Jul 16 00:18:09.452697 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:09.452654    2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" podUID="6f3997b5-aaac-4918-950c-eb2477caaf6d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 00:18:09.453222 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:09.452732    2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94"
Jul 16 00:18:09.453267 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:09.453214    2556 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0dea5d003f8284f84c57e839b0bbeda341e67f48ffb52fceecff57f367f23a5a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 16 00:18:09.453308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:09.453265    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" podUID="6f3997b5-aaac-4918-950c-eb2477caaf6d" containerName="service-proxy" containerID="cri-o://0dea5d003f8284f84c57e839b0bbeda341e67f48ffb52fceecff57f367f23a5a" gracePeriod=30
Jul 16 00:18:10.143943 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:10.143908    2556 generic.go:356] "Generic (PLEG): container finished" podID="6f3997b5-aaac-4918-950c-eb2477caaf6d" containerID="0dea5d003f8284f84c57e839b0bbeda341e67f48ffb52fceecff57f367f23a5a" exitCode=2
Jul 16 00:18:10.144114 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:10.143966    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" event={"ID":"6f3997b5-aaac-4918-950c-eb2477caaf6d","Type":"ContainerDied","Data":"0dea5d003f8284f84c57e839b0bbeda341e67f48ffb52fceecff57f367f23a5a"}
Jul 16 00:18:10.144114 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:10.144003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764964bff-cgq94" event={"ID":"6f3997b5-aaac-4918-950c-eb2477caaf6d","Type":"ContainerStarted","Data":"58364df8172f630950e30dbd113b435941add38cdac7a3b73dad80afd712b483"}
Jul 16 00:18:13.124302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:13.124268    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qxlqb"
Jul 16 00:18:14.801419 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:14.801383    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:18:14.803623 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:14.803583    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:18:14.807987 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:14.807963    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 00:18:21.635447 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:21.635418    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:18:21.639144 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:21.639120    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65b5bbd795-dwffs"
Jul 16 00:18:23.164553 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.164512    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84f9d7555-2hdwz" podUID="93cc8a44-5ac5-447b-93f5-212f16f12c48" containerName="console" containerID="cri-o://dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1" gracePeriod=15
Jul 16 00:18:23.418251 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.418187    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:18:23.462589 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.462550    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-oauth-config\") pod \"93cc8a44-5ac5-447b-93f5-212f16f12c48\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") "
Jul 16 00:18:23.462589 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.462617    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-serving-cert\") pod \"93cc8a44-5ac5-447b-93f5-212f16f12c48\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") "
Jul 16 00:18:23.462853 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.462687    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-oauth-serving-cert\") pod \"93cc8a44-5ac5-447b-93f5-212f16f12c48\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") "
Jul 16 00:18:23.462853 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.462710    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-config\") pod \"93cc8a44-5ac5-447b-93f5-212f16f12c48\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") "
Jul 16 00:18:23.462853 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.462737    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jvfg\" (UniqueName: \"kubernetes.io/projected/93cc8a44-5ac5-447b-93f5-212f16f12c48-kube-api-access-7jvfg\") pod \"93cc8a44-5ac5-447b-93f5-212f16f12c48\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") "
Jul 16 00:18:23.462853 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.462759    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-service-ca\") pod \"93cc8a44-5ac5-447b-93f5-212f16f12c48\" (UID: \"93cc8a44-5ac5-447b-93f5-212f16f12c48\") "
Jul 16 00:18:23.463162 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.463134    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-config" (OuterVolumeSpecName: "console-config") pod "93cc8a44-5ac5-447b-93f5-212f16f12c48" (UID: "93cc8a44-5ac5-447b-93f5-212f16f12c48"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:18:23.463162 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.463144    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "93cc8a44-5ac5-447b-93f5-212f16f12c48" (UID: "93cc8a44-5ac5-447b-93f5-212f16f12c48"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:18:23.463509 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.463202    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-service-ca" (OuterVolumeSpecName: "service-ca") pod "93cc8a44-5ac5-447b-93f5-212f16f12c48" (UID: "93cc8a44-5ac5-447b-93f5-212f16f12c48"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:18:23.465030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.465012    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "93cc8a44-5ac5-447b-93f5-212f16f12c48" (UID: "93cc8a44-5ac5-447b-93f5-212f16f12c48"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:23.465128 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.465114    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "93cc8a44-5ac5-447b-93f5-212f16f12c48" (UID: "93cc8a44-5ac5-447b-93f5-212f16f12c48"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:23.465201 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.465185    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93cc8a44-5ac5-447b-93f5-212f16f12c48-kube-api-access-7jvfg" (OuterVolumeSpecName: "kube-api-access-7jvfg") pod "93cc8a44-5ac5-447b-93f5-212f16f12c48" (UID: "93cc8a44-5ac5-447b-93f5-212f16f12c48"). InnerVolumeSpecName "kube-api-access-7jvfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:18:23.563887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.563831    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-oauth-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:23.563887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.563876    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:23.563887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.563887    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-oauth-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:23.563887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.563897    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-console-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:23.563887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.563906    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jvfg\" (UniqueName: \"kubernetes.io/projected/93cc8a44-5ac5-447b-93f5-212f16f12c48-kube-api-access-7jvfg\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:23.564180 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:23.563915    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93cc8a44-5ac5-447b-93f5-212f16f12c48-service-ca\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:24.199854 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.199819    2556 generic.go:356] "Generic (PLEG): container finished" podID="93cc8a44-5ac5-447b-93f5-212f16f12c48" containerID="dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1" exitCode=0
Jul 16 00:18:24.200303 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.199865    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f9d7555-2hdwz"
Jul 16 00:18:24.200303 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.199911    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f9d7555-2hdwz" event={"ID":"93cc8a44-5ac5-447b-93f5-212f16f12c48","Type":"ContainerDied","Data":"dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1"}
Jul 16 00:18:24.200303 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.199972    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f9d7555-2hdwz" event={"ID":"93cc8a44-5ac5-447b-93f5-212f16f12c48","Type":"ContainerDied","Data":"0243a663158c0945d5d61ac88fd1233756adbdd6ddbfaabdc03ccbbabf2f88cc"}
Jul 16 00:18:24.200303 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.200008    2556 scope.go:117] "RemoveContainer" containerID="dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1"
Jul 16 00:18:24.208445 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.208427    2556 scope.go:117] "RemoveContainer" containerID="dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1"
Jul 16 00:18:24.208775 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:24.208753    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1\": container with ID starting with dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1 not found: ID does not exist" containerID="dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1"
Jul 16 00:18:24.208854 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.208788    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1"} err="failed to get container status \"dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1\": rpc error: code = NotFound desc = could not find container \"dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1\": container with ID starting with dd0bc43f9a1075ad9ff5f62f8e46cd20bfbb268fdfcbeae95e8263a08a1ce9f1 not found: ID does not exist"
Jul 16 00:18:24.220226 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.220184    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f9d7555-2hdwz"]
Jul 16 00:18:24.226664 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.226630    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f9d7555-2hdwz"]
Jul 16 00:18:24.969465 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:24.969432    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93cc8a44-5ac5-447b-93f5-212f16f12c48" path="/var/lib/kubelet/pods/93cc8a44-5ac5-447b-93f5-212f16f12c48/volumes"
Jul 16 00:18:57.267183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:57.267148    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:18:57.267730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:57.267419    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="alertmanager" containerID="cri-o://e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2" gracePeriod=120
Jul 16 00:18:57.267730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:57.267504    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="prom-label-proxy" containerID="cri-o://cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e" gracePeriod=120
Jul 16 00:18:57.267730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:57.267499    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-metric" containerID="cri-o://763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884" gracePeriod=120
Jul 16 00:18:57.267730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:57.267545    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="config-reloader" containerID="cri-o://dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb" gracePeriod=120
Jul 16 00:18:57.267730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:57.267557    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy" containerID="cri-o://bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f" gracePeriod=120
Jul 16 00:18:57.267730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:57.267524    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-web" containerID="cri-o://f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852" gracePeriod=120
Jul 16 00:18:58.320807 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.320775    2556 generic.go:356] "Generic (PLEG): container finished" podID="57710085-c82b-496e-9e04-10dc697dd21f" containerID="cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e" exitCode=0
Jul 16 00:18:58.320807 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.320801    2556 generic.go:356] "Generic (PLEG): container finished" podID="57710085-c82b-496e-9e04-10dc697dd21f" containerID="bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f" exitCode=0
Jul 16 00:18:58.320807 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.320807    2556 generic.go:356] "Generic (PLEG): container finished" podID="57710085-c82b-496e-9e04-10dc697dd21f" containerID="dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb" exitCode=0
Jul 16 00:18:58.320807 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.320813    2556 generic.go:356] "Generic (PLEG): container finished" podID="57710085-c82b-496e-9e04-10dc697dd21f" containerID="e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2" exitCode=0
Jul 16 00:18:58.321403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.320843    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"}
Jul 16 00:18:58.321403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.320934    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"}
Jul 16 00:18:58.321403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.320961    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"}
Jul 16 00:18:58.321403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.321003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"}
Jul 16 00:18:58.515144 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.515108    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:58.650677 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.650550    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.650677 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.650592    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.650677 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.650658    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-web\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.650891 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.650852    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2zgj\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-kube-api-access-x2zgj\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.650940 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.650903    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-main-db\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.650999 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.650938    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-web-config\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.650999 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.650968    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-config-out\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.651109 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651004    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.651109 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651038    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-config-volume\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.651109 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651050    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:18:58.651109 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651075    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-metrics-client-ca\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.651302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651223    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-cluster-tls-config\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.651302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651260    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-main-tls\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.651302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651232    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:58.651302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651288    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-tls-assets\") pod \"57710085-c82b-496e-9e04-10dc697dd21f\" (UID: \"57710085-c82b-496e-9e04-10dc697dd21f\") "
Jul 16 00:18:58.651580 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651551    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:18:58.652068 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651766    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.652068 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651791    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-alertmanager-main-db\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.652068 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.651808    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57710085-c82b-496e-9e04-10dc697dd21f-metrics-client-ca\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.653835 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.653805    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:58.653934 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.653912    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-config-out" (OuterVolumeSpecName: "config-out") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:18:58.654007 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.653947    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:58.654115 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.654089    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:18:58.654115 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.654099    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-kube-api-access-x2zgj" (OuterVolumeSpecName: "kube-api-access-x2zgj") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "kube-api-access-x2zgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:18:58.654222 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.654164    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:58.654679 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.654657    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-config-volume" (OuterVolumeSpecName: "config-volume") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:58.656175 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.656146    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:58.659684 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.659658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:58.665227 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.665193    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-web-config" (OuterVolumeSpecName: "web-config") pod "57710085-c82b-496e-9e04-10dc697dd21f" (UID: "57710085-c82b-496e-9e04-10dc697dd21f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:18:58.753169 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753127    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753169 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753163    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2zgj\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-kube-api-access-x2zgj\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753169 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753174    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-web-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753169 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753183    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57710085-c82b-496e-9e04-10dc697dd21f-config-out\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753191    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753200    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-config-volume\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753208    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-cluster-tls-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753216    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-main-tls\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753224    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57710085-c82b-496e-9e04-10dc697dd21f-tls-assets\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:58.753417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:58.753232    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57710085-c82b-496e-9e04-10dc697dd21f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:18:59.327264 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.327229    2556 generic.go:356] "Generic (PLEG): container finished" podID="57710085-c82b-496e-9e04-10dc697dd21f" containerID="763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884" exitCode=0
Jul 16 00:18:59.327264 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.327263    2556 generic.go:356] "Generic (PLEG): container finished" podID="57710085-c82b-496e-9e04-10dc697dd21f" containerID="f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852" exitCode=0
Jul 16 00:18:59.327779 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.327310    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"}
Jul 16 00:18:59.327779 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.327381    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"}
Jul 16 00:18:59.327779 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.327323    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.327779 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.327411    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57710085-c82b-496e-9e04-10dc697dd21f","Type":"ContainerDied","Data":"4643ddd7c53663586ef3f37e514c51ce7210a425fc8ad4098f2e9375a6754d5b"}
Jul 16 00:18:59.327779 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.327444    2556 scope.go:117] "RemoveContainer" containerID="cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"
Jul 16 00:18:59.337500 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.337482    2556 scope.go:117] "RemoveContainer" containerID="763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"
Jul 16 00:18:59.344589 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.344574    2556 scope.go:117] "RemoveContainer" containerID="bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"
Jul 16 00:18:59.351958 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.351941    2556 scope.go:117] "RemoveContainer" containerID="f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"
Jul 16 00:18:59.352018 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.351965    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:18:59.356104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.356083    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:18:59.359532 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.359516    2556 scope.go:117] "RemoveContainer" containerID="dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"
Jul 16 00:18:59.366819 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.366804    2556 scope.go:117] "RemoveContainer" containerID="e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"
Jul 16 00:18:59.373829 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.373813    2556 scope.go:117] "RemoveContainer" containerID="59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc"
Jul 16 00:18:59.380337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.380320    2556 scope.go:117] "RemoveContainer" containerID="cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"
Jul 16 00:18:59.380587 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:59.380569    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e\": container with ID starting with cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e not found: ID does not exist" containerID="cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"
Jul 16 00:18:59.380680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.380602    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"} err="failed to get container status \"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e\": rpc error: code = NotFound desc = could not find container \"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e\": container with ID starting with cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e not found: ID does not exist"
Jul 16 00:18:59.380680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.380647    2556 scope.go:117] "RemoveContainer" containerID="763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"
Jul 16 00:18:59.380921 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:59.380904    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884\": container with ID starting with 763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884 not found: ID does not exist" containerID="763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"
Jul 16 00:18:59.380968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.380927    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"} err="failed to get container status \"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884\": rpc error: code = NotFound desc = could not find container \"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884\": container with ID starting with 763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884 not found: ID does not exist"
Jul 16 00:18:59.380968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.380942    2556 scope.go:117] "RemoveContainer" containerID="bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"
Jul 16 00:18:59.381148 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:59.381133    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f\": container with ID starting with bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f not found: ID does not exist" containerID="bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"
Jul 16 00:18:59.381187 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381153    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"} err="failed to get container status \"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f\": rpc error: code = NotFound desc = could not find container \"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f\": container with ID starting with bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f not found: ID does not exist"
Jul 16 00:18:59.381187 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381167    2556 scope.go:117] "RemoveContainer" containerID="f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"
Jul 16 00:18:59.381378 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:59.381364    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852\": container with ID starting with f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852 not found: ID does not exist" containerID="f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"
Jul 16 00:18:59.381421 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381382    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"} err="failed to get container status \"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852\": rpc error: code = NotFound desc = could not find container \"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852\": container with ID starting with f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852 not found: ID does not exist"
Jul 16 00:18:59.381421 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381395    2556 scope.go:117] "RemoveContainer" containerID="dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"
Jul 16 00:18:59.381587 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:59.381572    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb\": container with ID starting with dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb not found: ID does not exist" containerID="dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"
Jul 16 00:18:59.381652 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381590    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"} err="failed to get container status \"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb\": rpc error: code = NotFound desc = could not find container \"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb\": container with ID starting with dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb not found: ID does not exist"
Jul 16 00:18:59.381652 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381624    2556 scope.go:117] "RemoveContainer" containerID="e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"
Jul 16 00:18:59.381845 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:59.381828    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2\": container with ID starting with e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2 not found: ID does not exist" containerID="e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"
Jul 16 00:18:59.381890 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381849    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"} err="failed to get container status \"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2\": rpc error: code = NotFound desc = could not find container \"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2\": container with ID starting with e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2 not found: ID does not exist"
Jul 16 00:18:59.381890 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.381860    2556 scope.go:117] "RemoveContainer" containerID="59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc"
Jul 16 00:18:59.382054 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:18:59.382039    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc\": container with ID starting with 59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc not found: ID does not exist" containerID="59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc"
Jul 16 00:18:59.382091 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382058    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc"} err="failed to get container status \"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc\": rpc error: code = NotFound desc = could not find container \"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc\": container with ID starting with 59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc not found: ID does not exist"
Jul 16 00:18:59.382091 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382071    2556 scope.go:117] "RemoveContainer" containerID="cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"
Jul 16 00:18:59.382253 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382234    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e"} err="failed to get container status \"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e\": rpc error: code = NotFound desc = could not find container \"cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e\": container with ID starting with cdebc4775b3b1f66d7824dbe195fd2c5971b43310ca8eea1924ca3294f20472e not found: ID does not exist"
Jul 16 00:18:59.382320 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382255    2556 scope.go:117] "RemoveContainer" containerID="763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"
Jul 16 00:18:59.382509 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382490    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884"} err="failed to get container status \"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884\": rpc error: code = NotFound desc = could not find container \"763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884\": container with ID starting with 763c7aa00f7a3f1f613d2ac9883e90034605ac88390a71f94df0f74383ddb884 not found: ID does not exist"
Jul 16 00:18:59.382549 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382510    2556 scope.go:117] "RemoveContainer" containerID="bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"
Jul 16 00:18:59.382754 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382735    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f"} err="failed to get container status \"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f\": rpc error: code = NotFound desc = could not find container \"bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f\": container with ID starting with bfd2695669468e8e9ce818b95d3c8bc93f3b09e001f8fd7382dd4e1c4e573b6f not found: ID does not exist"
Jul 16 00:18:59.382815 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382754    2556 scope.go:117] "RemoveContainer" containerID="f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"
Jul 16 00:18:59.382993 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382976    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852"} err="failed to get container status \"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852\": rpc error: code = NotFound desc = could not find container \"f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852\": container with ID starting with f9a7b72bd1ed4f4747f935ce8ae09585bd4acde0be31e5cba7a33bebc3699852 not found: ID does not exist"
Jul 16 00:18:59.383051 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.382994    2556 scope.go:117] "RemoveContainer" containerID="dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"
Jul 16 00:18:59.383205 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.383190    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb"} err="failed to get container status \"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb\": rpc error: code = NotFound desc = could not find container \"dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb\": container with ID starting with dfc699ac9691868605ac321b70cb3b3da92229eda6daea7accfb5ac3972470fb not found: ID does not exist"
Jul 16 00:18:59.383250 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.383206    2556 scope.go:117] "RemoveContainer" containerID="e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"
Jul 16 00:18:59.383399 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.383382    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2"} err="failed to get container status \"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2\": rpc error: code = NotFound desc = could not find container \"e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2\": container with ID starting with e9c08cc11b0cf49281218b6e7cda133216d9acdf1ce1dbb1c737871faa9a80e2 not found: ID does not exist"
Jul 16 00:18:59.383447 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.383400    2556 scope.go:117] "RemoveContainer" containerID="59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc"
Jul 16 00:18:59.383616 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.383586    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc"} err="failed to get container status \"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc\": rpc error: code = NotFound desc = could not find container \"59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc\": container with ID starting with 59467a6d5ae88387d27d1c99525d179e9527f9a126a1c9ae7a2a806fd1b458fc not found: ID does not exist"
Jul 16 00:18:59.389712 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.389691    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:18:59.389941 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.389926    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy"
Jul 16 00:18:59.390015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.389944    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy"
Jul 16 00:18:59.390015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.389960    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93cc8a44-5ac5-447b-93f5-212f16f12c48" containerName="console"
Jul 16 00:18:59.390015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.389968    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="93cc8a44-5ac5-447b-93f5-212f16f12c48" containerName="console"
Jul 16 00:18:59.390015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.389982    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="init-config-reloader"
Jul 16 00:18:59.390015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.389991    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="init-config-reloader"
Jul 16 00:18:59.390015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390008    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-web"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390016    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-web"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390027    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-metric"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390035    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-metric"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390052    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="prom-label-proxy"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390060    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="prom-label-proxy"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390073    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="alertmanager"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390080    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="alertmanager"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390088    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="config-reloader"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390096    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="config-reloader"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390156    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="alertmanager"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390168    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390179    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="prom-label-proxy"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390189    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="93cc8a44-5ac5-447b-93f5-212f16f12c48" containerName="console"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390199    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="config-reloader"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390207    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-web"
Jul 16 00:18:59.390308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.390215    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="57710085-c82b-496e-9e04-10dc697dd21f" containerName="kube-rbac-proxy-metric"
Jul 16 00:18:59.394404 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.394386    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.397274 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.397258    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 00:18:59.397682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.397665    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 00:18:59.397786 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.397770    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 00:18:59.397852 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.397819    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 00:18:59.397909 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.397886    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 00:18:59.398005 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.397991    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 00:18:59.398056 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.398039    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 00:18:59.398141 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.398046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 00:18:59.398233 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.398219    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s5gkv\""
Jul 16 00:18:59.404469 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.404452    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 00:18:59.414898 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.414869    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:18:59.559561 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559523    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559561 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559562    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559561 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e0eec50-61f3-4156-8fba-fd0e018b0d54-config-out\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559630    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gld9v\" (UniqueName: \"kubernetes.io/projected/6e0eec50-61f3-4156-8fba-fd0e018b0d54-kube-api-access-gld9v\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559694    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e0eec50-61f3-4156-8fba-fd0e018b0d54-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559742    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-web-config\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559792    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559819    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e0eec50-61f3-4156-8fba-fd0e018b0d54-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.559860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.560066 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e0eec50-61f3-4156-8fba-fd0e018b0d54-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.560066 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e0eec50-61f3-4156-8fba-fd0e018b0d54-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.560066 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.559917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.660915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.660834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e0eec50-61f3-4156-8fba-fd0e018b0d54-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.660915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.660880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.660915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.660908    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.660929    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.660946    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e0eec50-61f3-4156-8fba-fd0e018b0d54-config-out\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.660970    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gld9v\" (UniqueName: \"kubernetes.io/projected/6e0eec50-61f3-4156-8fba-fd0e018b0d54-kube-api-access-gld9v\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.660988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e0eec50-61f3-4156-8fba-fd0e018b0d54-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.661008    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.661026    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-web-config\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.661053    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.661107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e0eec50-61f3-4156-8fba-fd0e018b0d54-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.661137    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.661173    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e0eec50-61f3-4156-8fba-fd0e018b0d54-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.661860 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.661833    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e0eec50-61f3-4156-8fba-fd0e018b0d54-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.662408 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.662382    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e0eec50-61f3-4156-8fba-fd0e018b0d54-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.663159 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.663139    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e0eec50-61f3-4156-8fba-fd0e018b0d54-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.664208 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.664180    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e0eec50-61f3-4156-8fba-fd0e018b0d54-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.664303 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.664185    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e0eec50-61f3-4156-8fba-fd0e018b0d54-config-out\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.664303 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.664194    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.664303 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.664238    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.664582 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.664560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.664840 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.664825    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.664988 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.664964    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.665552 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.665538    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.666534 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.666518    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e0eec50-61f3-4156-8fba-fd0e018b0d54-web-config\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.670487 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.670469    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gld9v\" (UniqueName: \"kubernetes.io/projected/6e0eec50-61f3-4156-8fba-fd0e018b0d54-kube-api-access-gld9v\") pod \"alertmanager-main-0\" (UID: \"6e0eec50-61f3-4156-8fba-fd0e018b0d54\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.703584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.703545    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 00:18:59.841893 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:18:59.841843    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 00:18:59.847064 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:18:59.847035    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0eec50_61f3_4156_8fba_fd0e018b0d54.slice/crio-c53a90c59b5ad47b874cdbb81f003b06229d1787fd9438743a3a63851160973b WatchSource:0}: Error finding container c53a90c59b5ad47b874cdbb81f003b06229d1787fd9438743a3a63851160973b: Status 404 returned error can't find the container with id c53a90c59b5ad47b874cdbb81f003b06229d1787fd9438743a3a63851160973b
Jul 16 00:19:00.333016 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:00.332985    2556 generic.go:356] "Generic (PLEG): container finished" podID="6e0eec50-61f3-4156-8fba-fd0e018b0d54" containerID="426f82fc9d7678314421795ca8dc2938a446dbb72f624189e47006a24c92e5c5" exitCode=0
Jul 16 00:19:00.333471 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:00.333079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerDied","Data":"426f82fc9d7678314421795ca8dc2938a446dbb72f624189e47006a24c92e5c5"}
Jul 16 00:19:00.333471 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:00.333188    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerStarted","Data":"c53a90c59b5ad47b874cdbb81f003b06229d1787fd9438743a3a63851160973b"}
Jul 16 00:19:00.969983 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:00.969904    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57710085-c82b-496e-9e04-10dc697dd21f" path="/var/lib/kubelet/pods/57710085-c82b-496e-9e04-10dc697dd21f/volumes"
Jul 16 00:19:01.342172 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.342140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerStarted","Data":"135e94ae5536c763caa1ccc728be7efc042cce142fd988c3fa4b6b34cdc83ff1"}
Jul 16 00:19:01.342593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.342216    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerStarted","Data":"38cc939d620f457efb148507729312d3b559fabeca1d59ea489ac62443b41923"}
Jul 16 00:19:01.342593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.342260    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerStarted","Data":"51fa67a6fb837496a8c299727bb5b9360c40f315e0900cfc9be1e6bd6a94a756"}
Jul 16 00:19:01.342593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.342303    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerStarted","Data":"299e3c8821a5ee1e45210c8ed627d2f46c896ef953ea2932b34cadbd0a45a70d"}
Jul 16 00:19:01.342593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.342344    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerStarted","Data":"1781aff33859530fd22f70b4ccc3871dc9e9ffc238bc340c47300a4fb084197f"}
Jul 16 00:19:01.342593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.342384    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e0eec50-61f3-4156-8fba-fd0e018b0d54","Type":"ContainerStarted","Data":"702f6daa700ccbbbe2b4a22788bce4b09f5888596c43560a176fb0656d56e8d5"}
Jul 16 00:19:01.383264 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.383230    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5898fc968-9fmbl"]
Jul 16 00:19:01.385908 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.385889    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.390309 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.390277    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 16 00:19:01.390522 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.390399    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 16 00:19:01.390729 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.390711    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mnw5b\""
Jul 16 00:19:01.390812 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.390731    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 16 00:19:01.390812 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.390791    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 16 00:19:01.391004 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.390991    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 16 00:19:01.395729 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.395672    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.376789355 podStartE2EDuration="2.395656272s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.866917ms" isStatefulPod=false podCreationTimestamp="2026-07-16 00:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:19:01.392067712 +0000 UTC m=+346.963664014" watchObservedRunningTime="2026-07-16 00:19:01.395656272 +0000 UTC m=+346.967252572"
Jul 16 00:19:01.411268 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.411243    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 16 00:19:01.421869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.421836    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5898fc968-9fmbl"]
Jul 16 00:19:01.476171 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476130    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mp5x\" (UniqueName: \"kubernetes.io/projected/35cda1e9-866f-4788-80f2-aeefa7f5fb61-kube-api-access-6mp5x\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.476171 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476176    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.476464 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-secret-telemeter-client\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.476464 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-telemeter-client-tls\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.476583 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-serving-certs-ca-bundle\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.476661 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476641    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-federate-client-tls\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.476726 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476683    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.476726 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.476703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-metrics-client-ca\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.577952 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.577916    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-secret-telemeter-client\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.577952 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.577959    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-telemeter-client-tls\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.578183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578006    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-serving-certs-ca-bundle\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.578183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-federate-client-tls\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.578183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.578183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578076    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-metrics-client-ca\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.578183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mp5x\" (UniqueName: \"kubernetes.io/projected/35cda1e9-866f-4788-80f2-aeefa7f5fb61-kube-api-access-6mp5x\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.578183 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578164    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.578936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578902    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-serving-certs-ca-bundle\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.579112 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.578933    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-metrics-client-ca\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.579240 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.579219    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35cda1e9-866f-4788-80f2-aeefa7f5fb61-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.580699 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.580674    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-secret-telemeter-client\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.580815 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.580757    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-federate-client-tls\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.581116 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.581095    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-telemeter-client-tls\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.581150 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.581095    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35cda1e9-866f-4788-80f2-aeefa7f5fb61-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.589059 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.589040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mp5x\" (UniqueName: \"kubernetes.io/projected/35cda1e9-866f-4788-80f2-aeefa7f5fb61-kube-api-access-6mp5x\") pod \"telemeter-client-5898fc968-9fmbl\" (UID: \"35cda1e9-866f-4788-80f2-aeefa7f5fb61\") " pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.695841 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.695754    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl"
Jul 16 00:19:01.855198 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.855163    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5898fc968-9fmbl"]
Jul 16 00:19:01.859051 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:19:01.859031    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35cda1e9_866f_4788_80f2_aeefa7f5fb61.slice/crio-c5a9bb2879557769235f80c47e6db8672a3ec2540cd90b251f04fda8655a146c WatchSource:0}: Error finding container c5a9bb2879557769235f80c47e6db8672a3ec2540cd90b251f04fda8655a146c: Status 404 returned error can't find the container with id c5a9bb2879557769235f80c47e6db8672a3ec2540cd90b251f04fda8655a146c
Jul 16 00:19:01.861070 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:01.861049    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:19:02.347775 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:02.347735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl" event={"ID":"35cda1e9-866f-4788-80f2-aeefa7f5fb61","Type":"ContainerStarted","Data":"c5a9bb2879557769235f80c47e6db8672a3ec2540cd90b251f04fda8655a146c"}
Jul 16 00:19:04.356683 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:04.356645    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl" event={"ID":"35cda1e9-866f-4788-80f2-aeefa7f5fb61","Type":"ContainerStarted","Data":"3e0fa648d3c6163f9b1177b43bee1bab00d4da6a27f14f73039a0fafe94e5566"}
Jul 16 00:19:04.357202 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:04.356711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl" event={"ID":"35cda1e9-866f-4788-80f2-aeefa7f5fb61","Type":"ContainerStarted","Data":"537dcb69a2e6a971c77749757d0a7d2527e66b5c1df2b7df1fe5f0bc2f672399"}
Jul 16 00:19:04.357202 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:04.356741    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl" event={"ID":"35cda1e9-866f-4788-80f2-aeefa7f5fb61","Type":"ContainerStarted","Data":"bc6320beece5f38dd7fb3095ded433d3cb56fd391b93f33283aec9afb1bdfe1b"}
Jul 16 00:19:04.382018 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:04.381973    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5898fc968-9fmbl" podStartSLOduration=1.280725275 podStartE2EDuration="3.381955297s" totalImagesPullingTime="2.101230022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:19:04.380513709 +0000 UTC m=+349.952110030" watchObservedRunningTime="2026-07-16 00:19:04.381955297 +0000 UTC m=+349.953551599"
Jul 16 00:19:05.090184 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.090146    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df8fcf78b-lxbhs"]
Jul 16 00:19:05.092086 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.092068    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.117281 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.117250    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df8fcf78b-lxbhs"]
Jul 16 00:19:05.212890 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.212847    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-oauth-serving-cert\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.212890 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.212890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-config\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.213104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.212948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-trusted-ca-bundle\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.213104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.213021    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-serving-cert\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.213104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.213045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2zc9\" (UniqueName: \"kubernetes.io/projected/afac3c97-9677-4f97-b73b-4761fc9fe66a-kube-api-access-h2zc9\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.213104 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.213078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-oauth-config\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.213229 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.213121    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-service-ca\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.314335 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.314297    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-service-ca\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.314456 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.314357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-oauth-serving-cert\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.314456 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.314383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-config\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.314456 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.314405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-trusted-ca-bundle\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.314549 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.314461    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-serving-cert\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.314958 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.314928    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2zc9\" (UniqueName: \"kubernetes.io/projected/afac3c97-9677-4f97-b73b-4761fc9fe66a-kube-api-access-h2zc9\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.315097 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.314992    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-oauth-config\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.315577 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.315546    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-oauth-serving-cert\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.315725 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.315627    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-config\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.320846 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.317748    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-oauth-config\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.320846 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.317757    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-trusted-ca-bundle\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.320846 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.318222    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-serving-cert\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.321591 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.321567    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-service-ca\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.326574 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.326540    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2zc9\" (UniqueName: \"kubernetes.io/projected/afac3c97-9677-4f97-b73b-4761fc9fe66a-kube-api-access-h2zc9\") pod \"console-6df8fcf78b-lxbhs\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") " pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.401584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.401487    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:05.560836 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:19:05.560793    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafac3c97_9677_4f97_b73b_4761fc9fe66a.slice/crio-9834617a1c7206493b7404f53f5660b2efc513339c82fee7bd51962b63b5dff4 WatchSource:0}: Error finding container 9834617a1c7206493b7404f53f5660b2efc513339c82fee7bd51962b63b5dff4: Status 404 returned error can't find the container with id 9834617a1c7206493b7404f53f5660b2efc513339c82fee7bd51962b63b5dff4
Jul 16 00:19:05.564529 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:05.564509    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df8fcf78b-lxbhs"]
Jul 16 00:19:06.365575 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:06.365536    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df8fcf78b-lxbhs" event={"ID":"afac3c97-9677-4f97-b73b-4761fc9fe66a","Type":"ContainerStarted","Data":"6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057"}
Jul 16 00:19:06.365789 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:06.365587    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df8fcf78b-lxbhs" event={"ID":"afac3c97-9677-4f97-b73b-4761fc9fe66a","Type":"ContainerStarted","Data":"9834617a1c7206493b7404f53f5660b2efc513339c82fee7bd51962b63b5dff4"}
Jul 16 00:19:06.386038 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:06.385992    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df8fcf78b-lxbhs" podStartSLOduration=1.385977389 podStartE2EDuration="1.385977389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:19:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:19:06.384412106 +0000 UTC m=+351.956008407" watchObservedRunningTime="2026-07-16 00:19:06.385977389 +0000 UTC m=+351.957573750"
Jul 16 00:19:15.402599 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:15.402565    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:15.403061 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:15.402631    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:15.407364 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:15.407336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:16.407358 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:16.407328    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:19:16.452439 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:16.452396    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6fc9999b-dnwpz"]
Jul 16 00:19:41.479123 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.479062    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d6fc9999b-dnwpz" podUID="cc287138-2b49-4f99-82d2-067459f1d1c2" containerName="console" containerID="cri-o://d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640" gracePeriod=15
Jul 16 00:19:41.732357 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.732291    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:19:41.816039 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816014    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-service-ca\") pod \"cc287138-2b49-4f99-82d2-067459f1d1c2\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") "
Jul 16 00:19:41.816186 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816076    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-oauth-serving-cert\") pod \"cc287138-2b49-4f99-82d2-067459f1d1c2\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") "
Jul 16 00:19:41.816186 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816119    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4p44\" (UniqueName: \"kubernetes.io/projected/cc287138-2b49-4f99-82d2-067459f1d1c2-kube-api-access-f4p44\") pod \"cc287138-2b49-4f99-82d2-067459f1d1c2\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") "
Jul 16 00:19:41.816186 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816153    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-trusted-ca-bundle\") pod \"cc287138-2b49-4f99-82d2-067459f1d1c2\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") "
Jul 16 00:19:41.816186 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816179    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-oauth-config\") pod \"cc287138-2b49-4f99-82d2-067459f1d1c2\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") "
Jul 16 00:19:41.816338 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816227    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-console-config\") pod \"cc287138-2b49-4f99-82d2-067459f1d1c2\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") "
Jul 16 00:19:41.816338 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816252    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-serving-cert\") pod \"cc287138-2b49-4f99-82d2-067459f1d1c2\" (UID: \"cc287138-2b49-4f99-82d2-067459f1d1c2\") "
Jul 16 00:19:41.816597 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816499    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc287138-2b49-4f99-82d2-067459f1d1c2" (UID: "cc287138-2b49-4f99-82d2-067459f1d1c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:19:41.816730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816591    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc287138-2b49-4f99-82d2-067459f1d1c2" (UID: "cc287138-2b49-4f99-82d2-067459f1d1c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:19:41.816730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816601    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc287138-2b49-4f99-82d2-067459f1d1c2" (UID: "cc287138-2b49-4f99-82d2-067459f1d1c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:19:41.816814 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816717    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-console-config" (OuterVolumeSpecName: "console-config") pod "cc287138-2b49-4f99-82d2-067459f1d1c2" (UID: "cc287138-2b49-4f99-82d2-067459f1d1c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:19:41.816871 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816853    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-oauth-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:19:41.816905 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816878    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-trusted-ca-bundle\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:19:41.816905 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816893    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-console-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:19:41.816980 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.816906    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc287138-2b49-4f99-82d2-067459f1d1c2-service-ca\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:19:41.818441 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.818420    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc287138-2b49-4f99-82d2-067459f1d1c2-kube-api-access-f4p44" (OuterVolumeSpecName: "kube-api-access-f4p44") pod "cc287138-2b49-4f99-82d2-067459f1d1c2" (UID: "cc287138-2b49-4f99-82d2-067459f1d1c2"). InnerVolumeSpecName "kube-api-access-f4p44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:19:41.818507 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.818454    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc287138-2b49-4f99-82d2-067459f1d1c2" (UID: "cc287138-2b49-4f99-82d2-067459f1d1c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:19:41.818543 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.818519    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc287138-2b49-4f99-82d2-067459f1d1c2" (UID: "cc287138-2b49-4f99-82d2-067459f1d1c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:19:41.917859 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.917822    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-oauth-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:19:41.917859 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.917852    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc287138-2b49-4f99-82d2-067459f1d1c2-console-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:19:41.917859 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:41.917861    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4p44\" (UniqueName: \"kubernetes.io/projected/cc287138-2b49-4f99-82d2-067459f1d1c2-kube-api-access-f4p44\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:19:42.499133 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.499098    2556 generic.go:356] "Generic (PLEG): container finished" podID="cc287138-2b49-4f99-82d2-067459f1d1c2" containerID="d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640" exitCode=0
Jul 16 00:19:42.499602 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.499143    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6fc9999b-dnwpz"
Jul 16 00:19:42.499602 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.499192    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6fc9999b-dnwpz" event={"ID":"cc287138-2b49-4f99-82d2-067459f1d1c2","Type":"ContainerDied","Data":"d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640"}
Jul 16 00:19:42.499602 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.499254    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6fc9999b-dnwpz" event={"ID":"cc287138-2b49-4f99-82d2-067459f1d1c2","Type":"ContainerDied","Data":"be8652eeadd4c272ae15d76df45697a60a9bc927b6a5418eedcc194d6526e688"}
Jul 16 00:19:42.499602 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.499285    2556 scope.go:117] "RemoveContainer" containerID="d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640"
Jul 16 00:19:42.508018 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.508004    2556 scope.go:117] "RemoveContainer" containerID="d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640"
Jul 16 00:19:42.508266 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:19:42.508244    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640\": container with ID starting with d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640 not found: ID does not exist" containerID="d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640"
Jul 16 00:19:42.508315 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.508280    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640"} err="failed to get container status \"d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640\": rpc error: code = NotFound desc = could not find container \"d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640\": container with ID starting with d8cc6b31c8cbf1de8f5d98da5786c9c5c296cbafd601e7ead7a79b2f9420d640 not found: ID does not exist"
Jul 16 00:19:42.520468 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.520448    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6fc9999b-dnwpz"]
Jul 16 00:19:42.524118 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.524099    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6fc9999b-dnwpz"]
Jul 16 00:19:42.973770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:19:42.973727    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc287138-2b49-4f99-82d2-067459f1d1c2" path="/var/lib/kubelet/pods/cc287138-2b49-4f99-82d2-067459f1d1c2/volumes"
Jul 16 00:20:15.349025 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.348991    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8dfb4cb-7p5t6"]
Jul 16 00:20:15.349425 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.349280    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc287138-2b49-4f99-82d2-067459f1d1c2" containerName="console"
Jul 16 00:20:15.349425 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.349294    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc287138-2b49-4f99-82d2-067459f1d1c2" containerName="console"
Jul 16 00:20:15.349425 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.349356    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc287138-2b49-4f99-82d2-067459f1d1c2" containerName="console"
Jul 16 00:20:15.353208 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.353185    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.362497 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.362464    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8dfb4cb-7p5t6"]
Jul 16 00:20:15.405917 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.405872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-config\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.405917 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.405921    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7229\" (UniqueName: \"kubernetes.io/projected/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-kube-api-access-m7229\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.406140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.405999    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-serving-cert\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.406140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.406059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-oauth-serving-cert\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.406140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.406086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-oauth-config\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.406140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.406116    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-trusted-ca-bundle\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.406302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.406164    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-service-ca\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.507418 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.507362    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-config\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.507418 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.507421    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7229\" (UniqueName: \"kubernetes.io/projected/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-kube-api-access-m7229\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.507687 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.507461    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-serving-cert\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.507687 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.507514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-oauth-serving-cert\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.507687 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.507659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-oauth-config\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.507866 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.507732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-trusted-ca-bundle\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.507866 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.507763    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-service-ca\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.508224 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.508194    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-config\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.508224 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.508213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-oauth-serving-cert\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.508532 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.508508    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-trusted-ca-bundle\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.508629 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.508589    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-service-ca\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.510232 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.510212    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-oauth-config\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.510301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.510278    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-serving-cert\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.515436 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.515401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7229\" (UniqueName: \"kubernetes.io/projected/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-kube-api-access-m7229\") pod \"console-6b8dfb4cb-7p5t6\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") " pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.664924 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.664827    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:15.804431 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:15.804289    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8dfb4cb-7p5t6"]
Jul 16 00:20:15.807387 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:20:15.807351    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92c2790_8da4_4e4f_9f2a_c0057689d9b0.slice/crio-efd671bff320a9195044d9e58c9a2ed747abf1c810fa550cb199535cee8f685f WatchSource:0}: Error finding container efd671bff320a9195044d9e58c9a2ed747abf1c810fa550cb199535cee8f685f: Status 404 returned error can't find the container with id efd671bff320a9195044d9e58c9a2ed747abf1c810fa550cb199535cee8f685f
Jul 16 00:20:16.624620 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:16.624576    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dfb4cb-7p5t6" event={"ID":"b92c2790-8da4-4e4f-9f2a-c0057689d9b0","Type":"ContainerStarted","Data":"e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7"}
Jul 16 00:20:16.625125 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:16.624657    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dfb4cb-7p5t6" event={"ID":"b92c2790-8da4-4e4f-9f2a-c0057689d9b0","Type":"ContainerStarted","Data":"efd671bff320a9195044d9e58c9a2ed747abf1c810fa550cb199535cee8f685f"}
Jul 16 00:20:16.643816 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:16.643715    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b8dfb4cb-7p5t6" podStartSLOduration=1.6436800520000001 podStartE2EDuration="1.643680052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:20:16.643051804 +0000 UTC m=+422.214648105" watchObservedRunningTime="2026-07-16 00:20:16.643680052 +0000 UTC m=+422.215276358"
Jul 16 00:20:25.665916 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:25.665879    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:25.666410 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:25.665950    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:25.670731 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:25.670708    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:26.664976 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:26.664946    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:20:26.715122 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:26.715094    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df8fcf78b-lxbhs"]
Jul 16 00:20:51.735777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:51.735713    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6df8fcf78b-lxbhs" podUID="afac3c97-9677-4f97-b73b-4761fc9fe66a" containerName="console" containerID="cri-o://6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057" gracePeriod=15
Jul 16 00:20:51.977017 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:51.976994    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:20:52.119820 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.119782    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-config\") pod \"afac3c97-9677-4f97-b73b-4761fc9fe66a\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") "
Jul 16 00:20:52.119820 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.119818    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-trusted-ca-bundle\") pod \"afac3c97-9677-4f97-b73b-4761fc9fe66a\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") "
Jul 16 00:20:52.120079 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.119835    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-service-ca\") pod \"afac3c97-9677-4f97-b73b-4761fc9fe66a\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") "
Jul 16 00:20:52.120079 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.119896    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-oauth-serving-cert\") pod \"afac3c97-9677-4f97-b73b-4761fc9fe66a\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") "
Jul 16 00:20:52.120187 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120095    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-serving-cert\") pod \"afac3c97-9677-4f97-b73b-4761fc9fe66a\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") "
Jul 16 00:20:52.120187 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120153    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-oauth-config\") pod \"afac3c97-9677-4f97-b73b-4761fc9fe66a\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") "
Jul 16 00:20:52.120289 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120206    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2zc9\" (UniqueName: \"kubernetes.io/projected/afac3c97-9677-4f97-b73b-4761fc9fe66a-kube-api-access-h2zc9\") pod \"afac3c97-9677-4f97-b73b-4761fc9fe66a\" (UID: \"afac3c97-9677-4f97-b73b-4761fc9fe66a\") "
Jul 16 00:20:52.120394 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120328    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "afac3c97-9677-4f97-b73b-4761fc9fe66a" (UID: "afac3c97-9677-4f97-b73b-4761fc9fe66a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:20:52.120481 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120399    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-config" (OuterVolumeSpecName: "console-config") pod "afac3c97-9677-4f97-b73b-4761fc9fe66a" (UID: "afac3c97-9677-4f97-b73b-4761fc9fe66a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:20:52.120481 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120436    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-service-ca" (OuterVolumeSpecName: "service-ca") pod "afac3c97-9677-4f97-b73b-4761fc9fe66a" (UID: "afac3c97-9677-4f97-b73b-4761fc9fe66a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:20:52.120561 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120518    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-oauth-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:20:52.120561 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120537    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:20:52.120561 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120551    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-service-ca\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:20:52.120688 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.120586    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "afac3c97-9677-4f97-b73b-4761fc9fe66a" (UID: "afac3c97-9677-4f97-b73b-4761fc9fe66a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:20:52.122307 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.122282    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afac3c97-9677-4f97-b73b-4761fc9fe66a-kube-api-access-h2zc9" (OuterVolumeSpecName: "kube-api-access-h2zc9") pod "afac3c97-9677-4f97-b73b-4761fc9fe66a" (UID: "afac3c97-9677-4f97-b73b-4761fc9fe66a"). InnerVolumeSpecName "kube-api-access-h2zc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:20:52.122433 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.122409    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "afac3c97-9677-4f97-b73b-4761fc9fe66a" (UID: "afac3c97-9677-4f97-b73b-4761fc9fe66a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:20:52.122493 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.122475    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "afac3c97-9677-4f97-b73b-4761fc9fe66a" (UID: "afac3c97-9677-4f97-b73b-4761fc9fe66a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:20:52.220878 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.220859    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:20:52.220956 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.220880    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afac3c97-9677-4f97-b73b-4761fc9fe66a-console-oauth-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:20:52.220956 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.220890    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2zc9\" (UniqueName: \"kubernetes.io/projected/afac3c97-9677-4f97-b73b-4761fc9fe66a-kube-api-access-h2zc9\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:20:52.220956 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.220899    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afac3c97-9677-4f97-b73b-4761fc9fe66a-trusted-ca-bundle\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:20:52.760032 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.760000    2556 generic.go:356] "Generic (PLEG): container finished" podID="afac3c97-9677-4f97-b73b-4761fc9fe66a" containerID="6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057" exitCode=0
Jul 16 00:20:52.760473 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.760041    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df8fcf78b-lxbhs"
Jul 16 00:20:52.760473 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.760083    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df8fcf78b-lxbhs" event={"ID":"afac3c97-9677-4f97-b73b-4761fc9fe66a","Type":"ContainerDied","Data":"6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057"}
Jul 16 00:20:52.760473 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.760155    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df8fcf78b-lxbhs" event={"ID":"afac3c97-9677-4f97-b73b-4761fc9fe66a","Type":"ContainerDied","Data":"9834617a1c7206493b7404f53f5660b2efc513339c82fee7bd51962b63b5dff4"}
Jul 16 00:20:52.760473 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.760175    2556 scope.go:117] "RemoveContainer" containerID="6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057"
Jul 16 00:20:52.768519 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.768503    2556 scope.go:117] "RemoveContainer" containerID="6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057"
Jul 16 00:20:52.768745 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:20:52.768729    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057\": container with ID starting with 6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057 not found: ID does not exist" containerID="6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057"
Jul 16 00:20:52.768809 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.768753    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057"} err="failed to get container status \"6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057\": rpc error: code = NotFound desc = could not find container \"6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057\": container with ID starting with 6f1193ddb9bd7511d4ba0577a28a51691f0c7fd63f285951f6246b29cb27b057 not found: ID does not exist"
Jul 16 00:20:52.781633 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.781589    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df8fcf78b-lxbhs"]
Jul 16 00:20:52.785583 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.785557    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df8fcf78b-lxbhs"]
Jul 16 00:20:52.969730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:20:52.969698    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afac3c97-9677-4f97-b73b-4761fc9fe66a" path="/var/lib/kubelet/pods/afac3c97-9677-4f97-b73b-4761fc9fe66a/volumes"
Jul 16 00:21:59.209936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.209897    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b958z"]
Jul 16 00:21:59.210535 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.210290    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afac3c97-9677-4f97-b73b-4761fc9fe66a" containerName="console"
Jul 16 00:21:59.210535 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.210309    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="afac3c97-9677-4f97-b73b-4761fc9fe66a" containerName="console"
Jul 16 00:21:59.210535 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.210369    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="afac3c97-9677-4f97-b73b-4761fc9fe66a" containerName="console"
Jul 16 00:21:59.213185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.213161    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.216164 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.216143    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 00:21:59.216285 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.216170    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 00:21:59.217313 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.217295    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2pjl6\""
Jul 16 00:21:59.223317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.223290    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b958z"]
Jul 16 00:21:59.339202 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.339165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl48p\" (UniqueName: \"kubernetes.io/projected/e522edb6-e366-45cd-8efb-a7290e94f994-kube-api-access-cl48p\") pod \"cert-manager-webhook-6486ffd997-b958z\" (UID: \"e522edb6-e366-45cd-8efb-a7290e94f994\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.339403 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.339293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e522edb6-e366-45cd-8efb-a7290e94f994-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b958z\" (UID: \"e522edb6-e366-45cd-8efb-a7290e94f994\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.440323 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.440268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e522edb6-e366-45cd-8efb-a7290e94f994-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b958z\" (UID: \"e522edb6-e366-45cd-8efb-a7290e94f994\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.440535 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.440354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl48p\" (UniqueName: \"kubernetes.io/projected/e522edb6-e366-45cd-8efb-a7290e94f994-kube-api-access-cl48p\") pod \"cert-manager-webhook-6486ffd997-b958z\" (UID: \"e522edb6-e366-45cd-8efb-a7290e94f994\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.448462 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.448425    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e522edb6-e366-45cd-8efb-a7290e94f994-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b958z\" (UID: \"e522edb6-e366-45cd-8efb-a7290e94f994\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.448598 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.448504    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl48p\" (UniqueName: \"kubernetes.io/projected/e522edb6-e366-45cd-8efb-a7290e94f994-kube-api-access-cl48p\") pod \"cert-manager-webhook-6486ffd997-b958z\" (UID: \"e522edb6-e366-45cd-8efb-a7290e94f994\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.522331 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.522298    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:21:59.651038 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:21:59.651016    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b958z"]
Jul 16 00:21:59.653254 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:21:59.653219    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode522edb6_e366_45cd_8efb_a7290e94f994.slice/crio-588b23a577fe5dc0a857f644cff19d41ece2f108816752ead0d603a3bf0cabd0 WatchSource:0}: Error finding container 588b23a577fe5dc0a857f644cff19d41ece2f108816752ead0d603a3bf0cabd0: Status 404 returned error can't find the container with id 588b23a577fe5dc0a857f644cff19d41ece2f108816752ead0d603a3bf0cabd0
Jul 16 00:22:00.006266 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:00.006173    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b958z" event={"ID":"e522edb6-e366-45cd-8efb-a7290e94f994","Type":"ContainerStarted","Data":"588b23a577fe5dc0a857f644cff19d41ece2f108816752ead0d603a3bf0cabd0"}
Jul 16 00:22:03.022340 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:03.022305    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b958z" event={"ID":"e522edb6-e366-45cd-8efb-a7290e94f994","Type":"ContainerStarted","Data":"be9d12a11a7f98097228028dfdab2c8573396dd5dadcb0d6dc8496b104c16aff"}
Jul 16 00:22:03.022772 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:03.022358    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:22:03.038895 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:03.038849    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-b958z" podStartSLOduration=1.230589896 podStartE2EDuration="4.038837981s" totalImagesPullingTime="2.808248085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:03.037550145 +0000 UTC m=+528.609146446" watchObservedRunningTime="2026-07-16 00:22:03.038837981 +0000 UTC m=+528.610434281"
Jul 16 00:22:09.028389 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:09.028301    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b958z"
Jul 16 00:22:24.322939 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.322895    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"]
Jul 16 00:22:24.325576 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.325559    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.329502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.329476    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 00:22:24.329660 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.329482    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 00:22:24.329878 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.329860    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 00:22:24.329962 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.329882    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 00:22:24.330054 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.329889    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pzpg8\""
Jul 16 00:22:24.341044 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.341013    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"]
Jul 16 00:22:24.455989 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.455951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-tmp\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.455989 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.455991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.456197 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.456015    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-webhook-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.456197 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.456129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-manifests\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.456197 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.456162    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd8t6\" (UniqueName: \"kubernetes.io/projected/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-kube-api-access-fd8t6\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.557364 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.557318    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-manifests\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.557364 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.557365    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd8t6\" (UniqueName: \"kubernetes.io/projected/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-kube-api-access-fd8t6\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.557640 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.557404    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-tmp\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.557640 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.557424    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.557640 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.557448    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-webhook-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.557805 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.557753    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-manifests\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.559974 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.559947    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-tmp\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.560098 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.560054    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.560156 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.560110    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-webhook-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.578504 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.578422    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd8t6\" (UniqueName: \"kubernetes.io/projected/1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b-kube-api-access-fd8t6\") pod \"opendatahub-operator-controller-manager-dd579ccfb-28l9m\" (UID: \"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.635460 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.635421    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:24.784550 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:24.784520    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"]
Jul 16 00:22:24.786213 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:22:24.786182    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0ea0ed_b39b_4fa0_90ee_43c6c60a477b.slice/crio-55650b7a4175658077425b9f479f9045993e036b74a6bb07890b12822dc17f54 WatchSource:0}: Error finding container 55650b7a4175658077425b9f479f9045993e036b74a6bb07890b12822dc17f54: Status 404 returned error can't find the container with id 55650b7a4175658077425b9f479f9045993e036b74a6bb07890b12822dc17f54
Jul 16 00:22:25.101800 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:25.101767    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m" event={"ID":"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b","Type":"ContainerStarted","Data":"55650b7a4175658077425b9f479f9045993e036b74a6bb07890b12822dc17f54"}
Jul 16 00:22:29.125915 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:29.125877    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m" event={"ID":"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b","Type":"ContainerStarted","Data":"f0b40470eec0f524eb52efbcafd1551b0d883090e3d35e71fb853b80fa5e9922"}
Jul 16 00:22:30.131418 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:30.131375    2556 generic.go:356] "Generic (PLEG): container finished" podID="1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b" containerID="f0b40470eec0f524eb52efbcafd1551b0d883090e3d35e71fb853b80fa5e9922" exitCode=0
Jul 16 00:22:30.131928 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:30.131428    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m" event={"ID":"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b","Type":"ContainerDied","Data":"f0b40470eec0f524eb52efbcafd1551b0d883090e3d35e71fb853b80fa5e9922"}
Jul 16 00:22:31.136724 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:31.136689    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m" event={"ID":"1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b","Type":"ContainerStarted","Data":"c64d15511c9c6925a26b0aa4f9bf8aae267b01c21337f5d80d22f466fac27f36"}
Jul 16 00:22:31.137106 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:31.136823    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:31.160145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:31.160088    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m" podStartSLOduration=2.299250237 podStartE2EDuration="7.160069628s" totalImagesPullingTime="3.772681439s" totalInitContainerRuntime="1.088137952s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:31.159343829 +0000 UTC m=+556.730940130" watchObservedRunningTime="2026-07-16 00:22:31.160069628 +0000 UTC m=+556.731665929"
Jul 16 00:22:42.142658 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:42.142597    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-28l9m"
Jul 16 00:22:44.566172 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.566122    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"]
Jul 16 00:22:44.569266 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.569241    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.572594 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.572567    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 00:22:44.572770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.572729    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 00:22:44.573730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.573702    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 00:22:44.573844 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.573712    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tmnrn\""
Jul 16 00:22:44.580630 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.580591    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 00:22:44.580911 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.580892    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"]
Jul 16 00:22:44.729981 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.729939    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-tmp\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.729981 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.729983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjh94\" (UniqueName: \"kubernetes.io/projected/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-kube-api-access-gjh94\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.730222 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.730063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-tls-certs\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.830770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.830679    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-tmp\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.830770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.830715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjh94\" (UniqueName: \"kubernetes.io/projected/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-kube-api-access-gjh94\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.830995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.830870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-tls-certs\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.833181 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.833146    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-tmp\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.833439 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.833417    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-tls-certs\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.839151 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.839113    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjh94\" (UniqueName: \"kubernetes.io/projected/b898ec25-4f39-4f15-a2cb-c7e5afd44fc1-kube-api-access-gjh94\") pod \"kube-auth-proxy-76b5c6c765-7qmdx\" (UID: \"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:44.879411 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:44.879368    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"
Jul 16 00:22:45.026418 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.026387    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx"]
Jul 16 00:22:45.029637 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:22:45.029588    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb898ec25_4f39_4f15_a2cb_c7e5afd44fc1.slice/crio-4689b408a2caadc0c830714de599d5734675952f5724e85493c2b3a865597b19 WatchSource:0}: Error finding container 4689b408a2caadc0c830714de599d5734675952f5724e85493c2b3a865597b19: Status 404 returned error can't find the container with id 4689b408a2caadc0c830714de599d5734675952f5724e85493c2b3a865597b19
Jul 16 00:22:45.191225 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.191140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx" event={"ID":"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1","Type":"ContainerStarted","Data":"4689b408a2caadc0c830714de599d5734675952f5724e85493c2b3a865597b19"}
Jul 16 00:22:45.786363 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.786327    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"]
Jul 16 00:22:45.788767 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.788741    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:45.791647 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.791576    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 00:22:45.791647 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.791636    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 00:22:45.791923 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.791671    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 00:22:45.792006 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.791983    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 00:22:45.792144 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.791988    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n2mpc\""
Jul 16 00:22:45.807593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.807567    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"]
Jul 16 00:22:45.941818 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.941788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-cacerts\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:45.941995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.941843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:45.941995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.941874    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-istio-token\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:45.941995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.941913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:45.941995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.941962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:45.941995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.941996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdrzc\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-kube-api-access-bdrzc\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:45.942213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:45.942065    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf24de37-de0b-400c-96d7-6937c4946da5-local-certs\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.043216 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043111    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-cacerts\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.043216 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043173    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.043216 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043195    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-istio-token\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.043501 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043227    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.043501 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.043501 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043266    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdrzc\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-kube-api-access-bdrzc\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.043501 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf24de37-de0b-400c-96d7-6937c4946da5-local-certs\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.044030 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.043999    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.045937 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.045905    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.046123 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.045946    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.046123 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.045946    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-cacerts\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.046123 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.045996    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf24de37-de0b-400c-96d7-6937c4946da5-local-certs\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.053087 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.053031    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-istio-token\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.053260 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.053169    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdrzc\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-kube-api-access-bdrzc\") pod \"istiod-openshift-gateway-7574459656-qwv2l\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.100037 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.099996    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:46.255313 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:46.255263    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"]
Jul 16 00:22:46.257822 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:22:46.257786    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf24de37_de0b_400c_96d7_6937c4946da5.slice/crio-f014f388e8cfff5877e454fa1095d49c7b14f4c6e2ce1cb060d4d0aab1efa95b WatchSource:0}: Error finding container f014f388e8cfff5877e454fa1095d49c7b14f4c6e2ce1cb060d4d0aab1efa95b: Status 404 returned error can't find the container with id f014f388e8cfff5877e454fa1095d49c7b14f4c6e2ce1cb060d4d0aab1efa95b
Jul 16 00:22:47.203153 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:47.203113    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l" event={"ID":"cf24de37-de0b-400c-96d7-6937c4946da5","Type":"ContainerStarted","Data":"f014f388e8cfff5877e454fa1095d49c7b14f4c6e2ce1cb060d4d0aab1efa95b"}
Jul 16 00:22:48.834354 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:48.834313    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 16 00:22:48.834782 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:48.834397    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 16 00:22:49.214398 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:49.214298    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l" event={"ID":"cf24de37-de0b-400c-96d7-6937c4946da5","Type":"ContainerStarted","Data":"276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32"}
Jul 16 00:22:49.214558 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:49.214461    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:49.216084 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:49.216056    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx" event={"ID":"b898ec25-4f39-4f15-a2cb-c7e5afd44fc1","Type":"ContainerStarted","Data":"5527a176c5bf8065a250e7a087500a57289502e795914c7133914d9324173389"}
Jul 16 00:22:49.216544 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:49.216510    2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qwv2l container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 00:22:49.216665 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:49.216577    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l" podUID="cf24de37-de0b-400c-96d7-6937c4946da5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 00:22:49.234676 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:49.234600    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l" podStartSLOduration=1.6606157719999999 podStartE2EDuration="4.234583103s" totalImagesPullingTime="2.573967331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:49.233398041 +0000 UTC m=+574.804994355" watchObservedRunningTime="2026-07-16 00:22:49.234583103 +0000 UTC m=+574.806179382"
Jul 16 00:22:49.250843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:49.250786    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-7qmdx" podStartSLOduration=1.448310958 podStartE2EDuration="5.250769995s" totalImagesPullingTime="3.802459037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:49.249898311 +0000 UTC m=+574.821494613" watchObservedRunningTime="2026-07-16 00:22:49.250769995 +0000 UTC m=+574.822366294"
Jul 16 00:22:50.220830 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:50.220806    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:55.226127 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.226090    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"]
Jul 16 00:22:55.228368 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.228350    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.233025 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.232994    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 00:22:55.233194 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.233075    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sb2q6\""
Jul 16 00:22:55.263990 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.263955    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"]
Jul 16 00:22:55.265458 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.265435    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"]
Jul 16 00:22:55.267782 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.267763    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.272118 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.272093    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sdk95\""
Jul 16 00:22:55.272750 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.272727    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 00:22:55.296779 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.296746    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"]
Jul 16 00:22:55.313579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.313540    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkmd6\" (UniqueName: \"kubernetes.io/projected/bb451007-9e82-4aa4-9414-470883dc89c1-kube-api-access-fkmd6\") pod \"llmisvc-controller-manager-777c6bd7d5-9q26d\" (UID: \"bb451007-9e82-4aa4-9414-470883dc89c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.313579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.313585    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm528\" (UniqueName: \"kubernetes.io/projected/02beefdb-f393-47ec-9a92-ddd489c5ecc4-kube-api-access-sm528\") pod \"kserve-controller-manager-d6f4b65b8-qhsq4\" (UID: \"02beefdb-f393-47ec-9a92-ddd489c5ecc4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.313816 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.313672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb451007-9e82-4aa4-9414-470883dc89c1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9q26d\" (UID: \"bb451007-9e82-4aa4-9414-470883dc89c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.313816 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.313697    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02beefdb-f393-47ec-9a92-ddd489c5ecc4-cert\") pod \"kserve-controller-manager-d6f4b65b8-qhsq4\" (UID: \"02beefdb-f393-47ec-9a92-ddd489c5ecc4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.414133 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.414094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkmd6\" (UniqueName: \"kubernetes.io/projected/bb451007-9e82-4aa4-9414-470883dc89c1-kube-api-access-fkmd6\") pod \"llmisvc-controller-manager-777c6bd7d5-9q26d\" (UID: \"bb451007-9e82-4aa4-9414-470883dc89c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.414133 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.414135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm528\" (UniqueName: \"kubernetes.io/projected/02beefdb-f393-47ec-9a92-ddd489c5ecc4-kube-api-access-sm528\") pod \"kserve-controller-manager-d6f4b65b8-qhsq4\" (UID: \"02beefdb-f393-47ec-9a92-ddd489c5ecc4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.414388 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.414195    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb451007-9e82-4aa4-9414-470883dc89c1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9q26d\" (UID: \"bb451007-9e82-4aa4-9414-470883dc89c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.414388 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.414223    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02beefdb-f393-47ec-9a92-ddd489c5ecc4-cert\") pod \"kserve-controller-manager-d6f4b65b8-qhsq4\" (UID: \"02beefdb-f393-47ec-9a92-ddd489c5ecc4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.416984 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.416958    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb451007-9e82-4aa4-9414-470883dc89c1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9q26d\" (UID: \"bb451007-9e82-4aa4-9414-470883dc89c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.417151 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.417129    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02beefdb-f393-47ec-9a92-ddd489c5ecc4-cert\") pod \"kserve-controller-manager-d6f4b65b8-qhsq4\" (UID: \"02beefdb-f393-47ec-9a92-ddd489c5ecc4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.427213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.427179    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm528\" (UniqueName: \"kubernetes.io/projected/02beefdb-f393-47ec-9a92-ddd489c5ecc4-kube-api-access-sm528\") pod \"kserve-controller-manager-d6f4b65b8-qhsq4\" (UID: \"02beefdb-f393-47ec-9a92-ddd489c5ecc4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.428828 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.428804    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkmd6\" (UniqueName: \"kubernetes.io/projected/bb451007-9e82-4aa4-9414-470883dc89c1-kube-api-access-fkmd6\") pod \"llmisvc-controller-manager-777c6bd7d5-9q26d\" (UID: \"bb451007-9e82-4aa4-9414-470883dc89c1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.538527 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.538498    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:22:55.578653 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.578595    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:22:55.717850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.717817    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"]
Jul 16 00:22:55.720937 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:22:55.720907    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02beefdb_f393_47ec_9a92_ddd489c5ecc4.slice/crio-fb58b304daceab548dc7137cdd0b6de53c50f88e10ceb6f8d3286d2277359d19 WatchSource:0}: Error finding container fb58b304daceab548dc7137cdd0b6de53c50f88e10ceb6f8d3286d2277359d19: Status 404 returned error can't find the container with id fb58b304daceab548dc7137cdd0b6de53c50f88e10ceb6f8d3286d2277359d19
Jul 16 00:22:55.725713 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:55.725693    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"]
Jul 16 00:22:55.727223 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:22:55.727197    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb451007_9e82_4aa4_9414_470883dc89c1.slice/crio-563788de3bab1f3a5183eda68b8b8edfdb1dbdf99b693d9663ac5e22743d33b5 WatchSource:0}: Error finding container 563788de3bab1f3a5183eda68b8b8edfdb1dbdf99b693d9663ac5e22743d33b5: Status 404 returned error can't find the container with id 563788de3bab1f3a5183eda68b8b8edfdb1dbdf99b693d9663ac5e22743d33b5
Jul 16 00:22:56.247499 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:56.247447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4" event={"ID":"02beefdb-f393-47ec-9a92-ddd489c5ecc4","Type":"ContainerStarted","Data":"fb58b304daceab548dc7137cdd0b6de53c50f88e10ceb6f8d3286d2277359d19"}
Jul 16 00:22:56.252804 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:56.252771    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d" event={"ID":"bb451007-9e82-4aa4-9414-470883dc89c1","Type":"ContainerStarted","Data":"563788de3bab1f3a5183eda68b8b8edfdb1dbdf99b693d9663ac5e22743d33b5"}
Jul 16 00:22:57.815858 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:57.815827    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"]
Jul 16 00:22:57.816322 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:57.816092    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l" podUID="cf24de37-de0b-400c-96d7-6937c4946da5" containerName="discovery" containerID="cri-o://276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32" gracePeriod=30
Jul 16 00:22:58.109637 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.109598    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:58.137820 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.137793    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-kubeconfig\") pod \"cf24de37-de0b-400c-96d7-6937c4946da5\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") "
Jul 16 00:22:58.137944 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.137828    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-ca-configmap\") pod \"cf24de37-de0b-400c-96d7-6937c4946da5\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") "
Jul 16 00:22:58.137944 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.137880    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-dns-cert\") pod \"cf24de37-de0b-400c-96d7-6937c4946da5\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") "
Jul 16 00:22:58.137944 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.137922    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdrzc\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-kube-api-access-bdrzc\") pod \"cf24de37-de0b-400c-96d7-6937c4946da5\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") "
Jul 16 00:22:58.138091 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.137981    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-istio-token\") pod \"cf24de37-de0b-400c-96d7-6937c4946da5\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") "
Jul 16 00:22:58.138091 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.138021    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf24de37-de0b-400c-96d7-6937c4946da5-local-certs\") pod \"cf24de37-de0b-400c-96d7-6937c4946da5\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") "
Jul 16 00:22:58.138091 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.138054    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-cacerts\") pod \"cf24de37-de0b-400c-96d7-6937c4946da5\" (UID: \"cf24de37-de0b-400c-96d7-6937c4946da5\") "
Jul 16 00:22:58.138289 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.138265    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "cf24de37-de0b-400c-96d7-6937c4946da5" (UID: "cf24de37-de0b-400c-96d7-6937c4946da5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:22:58.141119 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.141056    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf24de37-de0b-400c-96d7-6937c4946da5" (UID: "cf24de37-de0b-400c-96d7-6937c4946da5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:22:58.141119 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.141070    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-kube-api-access-bdrzc" (OuterVolumeSpecName: "kube-api-access-bdrzc") pod "cf24de37-de0b-400c-96d7-6937c4946da5" (UID: "cf24de37-de0b-400c-96d7-6937c4946da5"). InnerVolumeSpecName "kube-api-access-bdrzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:22:58.141286 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.141147    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "cf24de37-de0b-400c-96d7-6937c4946da5" (UID: "cf24de37-de0b-400c-96d7-6937c4946da5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:22:58.141286 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.141269    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf24de37-de0b-400c-96d7-6937c4946da5-local-certs" (OuterVolumeSpecName: "local-certs") pod "cf24de37-de0b-400c-96d7-6937c4946da5" (UID: "cf24de37-de0b-400c-96d7-6937c4946da5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:22:58.141391 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.141307    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "cf24de37-de0b-400c-96d7-6937c4946da5" (UID: "cf24de37-de0b-400c-96d7-6937c4946da5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:22:58.141850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.141815    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-cacerts" (OuterVolumeSpecName: "cacerts") pod "cf24de37-de0b-400c-96d7-6937c4946da5" (UID: "cf24de37-de0b-400c-96d7-6937c4946da5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:22:58.239044 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.239002    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdrzc\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-kube-api-access-bdrzc\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:22:58.239044 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.239041    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf24de37-de0b-400c-96d7-6937c4946da5-istio-token\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:22:58.239044 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.239056    2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf24de37-de0b-400c-96d7-6937c4946da5-local-certs\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:22:58.239291 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.239070    2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-cacerts\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:22:58.239291 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.239082    2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-kubeconfig\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:22:58.239291 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.239093    2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-ca-configmap\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:22:58.239291 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.239104    2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cf24de37-de0b-400c-96d7-6937c4946da5-istio-csr-dns-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:22:58.263968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.263927    2556 generic.go:356] "Generic (PLEG): container finished" podID="cf24de37-de0b-400c-96d7-6937c4946da5" containerID="276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32" exitCode=0
Jul 16 00:22:58.264157 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.263991    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"
Jul 16 00:22:58.264157 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.264009    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l" event={"ID":"cf24de37-de0b-400c-96d7-6937c4946da5","Type":"ContainerDied","Data":"276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32"}
Jul 16 00:22:58.264157 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.264072    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l" event={"ID":"cf24de37-de0b-400c-96d7-6937c4946da5","Type":"ContainerDied","Data":"f014f388e8cfff5877e454fa1095d49c7b14f4c6e2ce1cb060d4d0aab1efa95b"}
Jul 16 00:22:58.264157 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.264100    2556 scope.go:117] "RemoveContainer" containerID="276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32"
Jul 16 00:22:58.290679 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.290651    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"]
Jul 16 00:22:58.295598 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.295574    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qwv2l"]
Jul 16 00:22:58.728097 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.728077    2556 scope.go:117] "RemoveContainer" containerID="276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32"
Jul 16 00:22:58.728444 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:22:58.728420    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32\": container with ID starting with 276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32 not found: ID does not exist" containerID="276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32"
Jul 16 00:22:58.728560 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.728454    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32"} err="failed to get container status \"276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32\": rpc error: code = NotFound desc = could not find container \"276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32\": container with ID starting with 276af74d08776336c44506c79f250c9412dcbda753373e8adc068803a46d3a32 not found: ID does not exist"
Jul 16 00:22:58.971565 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:22:58.971531    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf24de37-de0b-400c-96d7-6937c4946da5" path="/var/lib/kubelet/pods/cf24de37-de0b-400c-96d7-6937c4946da5/volumes"
Jul 16 00:23:00.276812 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:00.276772    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d" event={"ID":"bb451007-9e82-4aa4-9414-470883dc89c1","Type":"ContainerStarted","Data":"3510b083391a941f7e337ddb4ba93bd67d93ce722db39a0221d285ab46df3885"}
Jul 16 00:23:00.277290 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:00.276965    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:23:00.278388 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:00.278366    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4" event={"ID":"02beefdb-f393-47ec-9a92-ddd489c5ecc4","Type":"ContainerStarted","Data":"23014461d9b53f5bf7090616fd588bb7d5ffde3ed8c407d3f84d5d6a9981d5e8"}
Jul 16 00:23:00.278528 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:00.278503    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:23:00.308956 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:00.308895    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d" podStartSLOduration=1.708896859 podStartE2EDuration="5.308878419s" totalImagesPullingTime="3.59998156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:23:00.307899836 +0000 UTC m=+585.879496138" watchObservedRunningTime="2026-07-16 00:23:00.308878419 +0000 UTC m=+585.880474698"
Jul 16 00:23:00.332889 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:00.332826    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4" podStartSLOduration=1.728663595 podStartE2EDuration="5.332808436s" totalImagesPullingTime="3.604144841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:23:00.331243492 +0000 UTC m=+585.902839795" watchObservedRunningTime="2026-07-16 00:23:00.332808436 +0000 UTC m=+585.904404737"
Jul 16 00:23:14.831655 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:14.831623    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:23:14.832150 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:14.831986    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:23:31.284866 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:31.284837    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9q26d"
Jul 16 00:23:31.287917 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:31.287899    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qhsq4"
Jul 16 00:23:45.365424 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.365390    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrn5z"]
Jul 16 00:23:45.365897 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.365705    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf24de37-de0b-400c-96d7-6937c4946da5" containerName="discovery"
Jul 16 00:23:45.365897 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.365717    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf24de37-de0b-400c-96d7-6937c4946da5" containerName="discovery"
Jul 16 00:23:45.365897 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.365769    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf24de37-de0b-400c-96d7-6937c4946da5" containerName="discovery"
Jul 16 00:23:45.367537 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.367521    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z"
Jul 16 00:23:45.370194 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.370170    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 00:23:45.371341 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.371317    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-kxjdx\""
Jul 16 00:23:45.371491 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.371317    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 00:23:45.381629 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.381585    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrn5z"]
Jul 16 00:23:45.443461 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.443431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbjzk\" (UniqueName: \"kubernetes.io/projected/cc02d846-2fd2-4606-86e4-ee79c628981c-kube-api-access-hbjzk\") pod \"kuadrant-operator-catalog-nrn5z\" (UID: \"cc02d846-2fd2-4606-86e4-ee79c628981c\") " pod="kuadrant-system/kuadrant-operator-catalog-nrn5z"
Jul 16 00:23:45.544115 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.544085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbjzk\" (UniqueName: \"kubernetes.io/projected/cc02d846-2fd2-4606-86e4-ee79c628981c-kube-api-access-hbjzk\") pod \"kuadrant-operator-catalog-nrn5z\" (UID: \"cc02d846-2fd2-4606-86e4-ee79c628981c\") " pod="kuadrant-system/kuadrant-operator-catalog-nrn5z"
Jul 16 00:23:45.552042 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.552017    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbjzk\" (UniqueName: \"kubernetes.io/projected/cc02d846-2fd2-4606-86e4-ee79c628981c-kube-api-access-hbjzk\") pod \"kuadrant-operator-catalog-nrn5z\" (UID: \"cc02d846-2fd2-4606-86e4-ee79c628981c\") " pod="kuadrant-system/kuadrant-operator-catalog-nrn5z"
Jul 16 00:23:45.678015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.677921    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z"
Jul 16 00:23:45.733554 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.733515    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrn5z"]
Jul 16 00:23:45.813273 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.813249    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrn5z"]
Jul 16 00:23:45.816079 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:23:45.816051    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc02d846_2fd2_4606_86e4_ee79c628981c.slice/crio-203179446c9fdbc63095f27d47bf6e2c2567c3efa4bededa1da311e155226ed6 WatchSource:0}: Error finding container 203179446c9fdbc63095f27d47bf6e2c2567c3efa4bededa1da311e155226ed6: Status 404 returned error can't find the container with id 203179446c9fdbc63095f27d47bf6e2c2567c3efa4bededa1da311e155226ed6
Jul 16 00:23:45.942918 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.942837    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2cx9"]
Jul 16 00:23:45.945939 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.945921    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:45.953990 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:45.953969    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2cx9"]
Jul 16 00:23:46.047651 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:46.047586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744sz\" (UniqueName: \"kubernetes.io/projected/155c8119-324f-4249-b5ba-001b2df24fd2-kube-api-access-744sz\") pod \"kuadrant-operator-catalog-v2cx9\" (UID: \"155c8119-324f-4249-b5ba-001b2df24fd2\") " pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:46.148578 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:46.148524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744sz\" (UniqueName: \"kubernetes.io/projected/155c8119-324f-4249-b5ba-001b2df24fd2-kube-api-access-744sz\") pod \"kuadrant-operator-catalog-v2cx9\" (UID: \"155c8119-324f-4249-b5ba-001b2df24fd2\") " pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:46.158913 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:46.158877    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-744sz\" (UniqueName: \"kubernetes.io/projected/155c8119-324f-4249-b5ba-001b2df24fd2-kube-api-access-744sz\") pod \"kuadrant-operator-catalog-v2cx9\" (UID: \"155c8119-324f-4249-b5ba-001b2df24fd2\") " pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:46.256186 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:46.256095    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:46.402427 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:46.402399    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2cx9"]
Jul 16 00:23:46.404941 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:23:46.404914    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155c8119_324f_4249_b5ba_001b2df24fd2.slice/crio-642d1898d9ecf0ec300212c5924a06f706ff67c27b0550489914018e588e23db WatchSource:0}: Error finding container 642d1898d9ecf0ec300212c5924a06f706ff67c27b0550489914018e588e23db: Status 404 returned error can't find the container with id 642d1898d9ecf0ec300212c5924a06f706ff67c27b0550489914018e588e23db
Jul 16 00:23:46.474549 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:46.474499    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9" event={"ID":"155c8119-324f-4249-b5ba-001b2df24fd2","Type":"ContainerStarted","Data":"642d1898d9ecf0ec300212c5924a06f706ff67c27b0550489914018e588e23db"}
Jul 16 00:23:46.475738 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:46.475685    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z" event={"ID":"cc02d846-2fd2-4606-86e4-ee79c628981c","Type":"ContainerStarted","Data":"203179446c9fdbc63095f27d47bf6e2c2567c3efa4bededa1da311e155226ed6"}
Jul 16 00:23:48.487049 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.487010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9" event={"ID":"155c8119-324f-4249-b5ba-001b2df24fd2","Type":"ContainerStarted","Data":"b117293b866a67d2bb98064e6b23b5237cad05835e46d716807f13a69a2ee2ea"}
Jul 16 00:23:48.488587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.488558    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z" event={"ID":"cc02d846-2fd2-4606-86e4-ee79c628981c","Type":"ContainerStarted","Data":"3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566"}
Jul 16 00:23:48.488749 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.488629    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z" podUID="cc02d846-2fd2-4606-86e4-ee79c628981c" containerName="registry-server" containerID="cri-o://3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566" gracePeriod=2
Jul 16 00:23:48.507600 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.507542    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9" podStartSLOduration=1.927726608 podStartE2EDuration="3.50752193s" totalImagesPullingTime="1.579795322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:23:48.505964019 +0000 UTC m=+634.077560319" watchObservedRunningTime="2026-07-16 00:23:48.50752193 +0000 UTC m=+634.079118230"
Jul 16 00:23:48.543753 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.543677    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z" podStartSLOduration=1.394032272 podStartE2EDuration="3.543660078s" totalImagesPullingTime="2.149627806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:23:48.542654646 +0000 UTC m=+634.114250948" watchObservedRunningTime="2026-07-16 00:23:48.543660078 +0000 UTC m=+634.115256378"
Jul 16 00:23:48.737542 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.737467    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z"
Jul 16 00:23:48.771872 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.771638    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbjzk\" (UniqueName: \"kubernetes.io/projected/cc02d846-2fd2-4606-86e4-ee79c628981c-kube-api-access-hbjzk\") pod \"cc02d846-2fd2-4606-86e4-ee79c628981c\" (UID: \"cc02d846-2fd2-4606-86e4-ee79c628981c\") "
Jul 16 00:23:48.774029 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.774001    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc02d846-2fd2-4606-86e4-ee79c628981c-kube-api-access-hbjzk" (OuterVolumeSpecName: "kube-api-access-hbjzk") pod "cc02d846-2fd2-4606-86e4-ee79c628981c" (UID: "cc02d846-2fd2-4606-86e4-ee79c628981c"). InnerVolumeSpecName "kube-api-access-hbjzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:23:48.873019 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:48.872974    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbjzk\" (UniqueName: \"kubernetes.io/projected/cc02d846-2fd2-4606-86e4-ee79c628981c-kube-api-access-hbjzk\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:23:49.494483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.494449    2556 generic.go:356] "Generic (PLEG): container finished" podID="cc02d846-2fd2-4606-86e4-ee79c628981c" containerID="3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566" exitCode=0
Jul 16 00:23:49.494921 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.494490    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z"
Jul 16 00:23:49.494921 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.494523    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z" event={"ID":"cc02d846-2fd2-4606-86e4-ee79c628981c","Type":"ContainerDied","Data":"3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566"}
Jul 16 00:23:49.494921 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.494561    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nrn5z" event={"ID":"cc02d846-2fd2-4606-86e4-ee79c628981c","Type":"ContainerDied","Data":"203179446c9fdbc63095f27d47bf6e2c2567c3efa4bededa1da311e155226ed6"}
Jul 16 00:23:49.494921 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.494580    2556 scope.go:117] "RemoveContainer" containerID="3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566"
Jul 16 00:23:49.503039 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.503021    2556 scope.go:117] "RemoveContainer" containerID="3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566"
Jul 16 00:23:49.503273 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:23:49.503254    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566\": container with ID starting with 3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566 not found: ID does not exist" containerID="3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566"
Jul 16 00:23:49.503334 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.503286    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566"} err="failed to get container status \"3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566\": rpc error: code = NotFound desc = could not find container \"3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566\": container with ID starting with 3dfcff8ba3d882a2656c480d4b3202cb6ed108e9e641202bba6ff69a7083c566 not found: ID does not exist"
Jul 16 00:23:49.510473 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.510444    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrn5z"]
Jul 16 00:23:49.514319 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:49.514295    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nrn5z"]
Jul 16 00:23:50.972748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:50.972714    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc02d846-2fd2-4606-86e4-ee79c628981c" path="/var/lib/kubelet/pods/cc02d846-2fd2-4606-86e4-ee79c628981c/volumes"
Jul 16 00:23:56.257338 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:56.257287    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:56.257886 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:56.257395    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:56.280186 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:56.280157    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:23:56.555762 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:23:56.555735    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-v2cx9"
Jul 16 00:24:18.611977 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.611944    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"]
Jul 16 00:24:18.612440 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.612242    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc02d846-2fd2-4606-86e4-ee79c628981c" containerName="registry-server"
Jul 16 00:24:18.612440 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.612252    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc02d846-2fd2-4606-86e4-ee79c628981c" containerName="registry-server"
Jul 16 00:24:18.612440 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.612311    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc02d846-2fd2-4606-86e4-ee79c628981c" containerName="registry-server"
Jul 16 00:24:18.619087 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.619066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"
Jul 16 00:24:18.622889 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.622865    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vs7hb\""
Jul 16 00:24:18.712279 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.712230    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"]
Jul 16 00:24:18.727558 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.727517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rw4\" (UniqueName: \"kubernetes.io/projected/248e2b5a-0600-4236-a71f-583fd9c8e1f5-kube-api-access-t7rw4\") pod \"authorino-operator-75cc8d5cb7-svtqs\" (UID: \"248e2b5a-0600-4236-a71f-583fd9c8e1f5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"
Jul 16 00:24:18.828751 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.828695    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rw4\" (UniqueName: \"kubernetes.io/projected/248e2b5a-0600-4236-a71f-583fd9c8e1f5-kube-api-access-t7rw4\") pod \"authorino-operator-75cc8d5cb7-svtqs\" (UID: \"248e2b5a-0600-4236-a71f-583fd9c8e1f5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"
Jul 16 00:24:18.840827 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.840795    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rw4\" (UniqueName: \"kubernetes.io/projected/248e2b5a-0600-4236-a71f-583fd9c8e1f5-kube-api-access-t7rw4\") pod \"authorino-operator-75cc8d5cb7-svtqs\" (UID: \"248e2b5a-0600-4236-a71f-583fd9c8e1f5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"
Jul 16 00:24:18.928923 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:18.928824    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"
Jul 16 00:24:19.087966 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.087941    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"]
Jul 16 00:24:19.090529 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:24:19.090497    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248e2b5a_0600_4236_a71f_583fd9c8e1f5.slice/crio-ae30a18e96224d07f9605a5f0994f0d04c800bc7ea61bb5a6693fd14509db123 WatchSource:0}: Error finding container ae30a18e96224d07f9605a5f0994f0d04c800bc7ea61bb5a6693fd14509db123: Status 404 returned error can't find the container with id ae30a18e96224d07f9605a5f0994f0d04c800bc7ea61bb5a6693fd14509db123
Jul 16 00:24:19.093289 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.093270    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:24:19.599511 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.599475    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7876967cb5-tqxkm"]
Jul 16 00:24:19.609742 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.609712    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.626348 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.626325    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7876967cb5-tqxkm"]
Jul 16 00:24:19.637376 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.637355    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs" event={"ID":"248e2b5a-0600-4236-a71f-583fd9c8e1f5","Type":"ContainerStarted","Data":"ae30a18e96224d07f9605a5f0994f0d04c800bc7ea61bb5a6693fd14509db123"}
Jul 16 00:24:19.736240 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.736201    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-oauth-config\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.736412 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.736261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-config\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.736412 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.736299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-oauth-serving-cert\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.736412 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.736346    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb2pk\" (UniqueName: \"kubernetes.io/projected/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-kube-api-access-hb2pk\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.736412 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.736383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-trusted-ca-bundle\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.736596 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.736462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-service-ca\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.736596 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.736490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-serving-cert\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.837523 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.837482    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb2pk\" (UniqueName: \"kubernetes.io/projected/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-kube-api-access-hb2pk\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.837731 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.837533    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-trusted-ca-bundle\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.837731 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.837574    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-service-ca\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.837731 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.837626    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-serving-cert\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.837731 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.837673    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-oauth-config\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.837731 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.837709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-config\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.838016 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.837754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-oauth-serving-cert\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.838546 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.838486    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-oauth-serving-cert\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.838546 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.838504    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-config\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.838936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.838561    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-trusted-ca-bundle\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.838936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.838576    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-service-ca\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.840542 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.840522    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-serving-cert\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.840663 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.840645    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-console-oauth-config\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.850350 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.850283    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb2pk\" (UniqueName: \"kubernetes.io/projected/56a3fe03-7a59-4e4d-979e-e3ad15bd351c-kube-api-access-hb2pk\") pod \"console-7876967cb5-tqxkm\" (UID: \"56a3fe03-7a59-4e4d-979e-e3ad15bd351c\") " pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:19.919102 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:19.919059    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:20.089346 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:20.089318    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7876967cb5-tqxkm"]
Jul 16 00:24:20.091126 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:24:20.091087    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a3fe03_7a59_4e4d_979e_e3ad15bd351c.slice/crio-c0f8a0bbafe08d64f1df0ff4d6ce7837b3278a369282d71d93e5f7c542795fd4 WatchSource:0}: Error finding container c0f8a0bbafe08d64f1df0ff4d6ce7837b3278a369282d71d93e5f7c542795fd4: Status 404 returned error can't find the container with id c0f8a0bbafe08d64f1df0ff4d6ce7837b3278a369282d71d93e5f7c542795fd4
Jul 16 00:24:20.644499 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:20.644469    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7876967cb5-tqxkm" event={"ID":"56a3fe03-7a59-4e4d-979e-e3ad15bd351c","Type":"ContainerStarted","Data":"ff2c720e8d690a351d093a49207e5ae0e198c8f6648b5b40292ae4134d8b11a8"}
Jul 16 00:24:20.645003 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:20.644528    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7876967cb5-tqxkm" event={"ID":"56a3fe03-7a59-4e4d-979e-e3ad15bd351c","Type":"ContainerStarted","Data":"c0f8a0bbafe08d64f1df0ff4d6ce7837b3278a369282d71d93e5f7c542795fd4"}
Jul 16 00:24:21.650591 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.650546    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs" event={"ID":"248e2b5a-0600-4236-a71f-583fd9c8e1f5","Type":"ContainerStarted","Data":"bc52f645281b84f320104b039ca4519ee7add33ac4e84a9131e9671f2ef33410"}
Jul 16 00:24:21.675784 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.675729    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7876967cb5-tqxkm" podStartSLOduration=2.675698918 podStartE2EDuration="2.675698918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:24:20.66759844 +0000 UTC m=+666.239194742" watchObservedRunningTime="2026-07-16 00:24:21.675698918 +0000 UTC m=+667.247295219"
Jul 16 00:24:21.676575 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.676543    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs" podStartSLOduration=1.193839624 podStartE2EDuration="3.676530508s" totalImagesPullingTime="2.482690884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:24:21.675375482 +0000 UTC m=+667.246971797" watchObservedRunningTime="2026-07-16 00:24:21.676530508 +0000 UTC m=+667.248126809"
Jul 16 00:24:21.746707 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.746666    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"]
Jul 16 00:24:21.750118 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.750098    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"
Jul 16 00:24:21.753421 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.753399    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ppwjb\""
Jul 16 00:24:21.753583 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.753491    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 00:24:21.765454 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.765419    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"]
Jul 16 00:24:21.856527 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.856429    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qwng\" (UniqueName: \"kubernetes.io/projected/14113433-17be-4477-acbc-92dc82d5d820-kube-api-access-2qwng\") pod \"dns-operator-controller-manager-864dd78c4c-kcpx7\" (UID: \"14113433-17be-4477-acbc-92dc82d5d820\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"
Jul 16 00:24:21.957526 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.957484    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qwng\" (UniqueName: \"kubernetes.io/projected/14113433-17be-4477-acbc-92dc82d5d820-kube-api-access-2qwng\") pod \"dns-operator-controller-manager-864dd78c4c-kcpx7\" (UID: \"14113433-17be-4477-acbc-92dc82d5d820\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"
Jul 16 00:24:21.974206 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:21.974174    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qwng\" (UniqueName: \"kubernetes.io/projected/14113433-17be-4477-acbc-92dc82d5d820-kube-api-access-2qwng\") pod \"dns-operator-controller-manager-864dd78c4c-kcpx7\" (UID: \"14113433-17be-4477-acbc-92dc82d5d820\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"
Jul 16 00:24:22.060500 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:22.060477    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"
Jul 16 00:24:22.206778 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:22.206740    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"]
Jul 16 00:24:22.210178 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:24:22.210147    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14113433_17be_4477_acbc_92dc82d5d820.slice/crio-aa69347a9ddac94a8e026700494dd35cce8db2edf3875d29a077e52f820372b6 WatchSource:0}: Error finding container aa69347a9ddac94a8e026700494dd35cce8db2edf3875d29a077e52f820372b6: Status 404 returned error can't find the container with id aa69347a9ddac94a8e026700494dd35cce8db2edf3875d29a077e52f820372b6
Jul 16 00:24:22.656160 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:22.656122    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7" event={"ID":"14113433-17be-4477-acbc-92dc82d5d820","Type":"ContainerStarted","Data":"aa69347a9ddac94a8e026700494dd35cce8db2edf3875d29a077e52f820372b6"}
Jul 16 00:24:22.656567 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:22.656292    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"
Jul 16 00:24:24.318319 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.318283    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"]
Jul 16 00:24:24.321869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.321845    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:24.324854 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.324805    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bh9f8\""
Jul 16 00:24:24.352496 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.352467    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"]
Jul 16 00:24:24.482857 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.482812    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-526qc\" (UniqueName: \"kubernetes.io/projected/f4dc9c19-6f73-49da-aebc-a22beb1d2315-kube-api-access-526qc\") pod \"limitador-operator-controller-manager-859d7b78bd-d4zns\" (UID: \"f4dc9c19-6f73-49da-aebc-a22beb1d2315\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:24.584187 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.584084    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-526qc\" (UniqueName: \"kubernetes.io/projected/f4dc9c19-6f73-49da-aebc-a22beb1d2315-kube-api-access-526qc\") pod \"limitador-operator-controller-manager-859d7b78bd-d4zns\" (UID: \"f4dc9c19-6f73-49da-aebc-a22beb1d2315\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:24.593785 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.593757    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-526qc\" (UniqueName: \"kubernetes.io/projected/f4dc9c19-6f73-49da-aebc-a22beb1d2315-kube-api-access-526qc\") pod \"limitador-operator-controller-manager-859d7b78bd-d4zns\" (UID: \"f4dc9c19-6f73-49da-aebc-a22beb1d2315\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:24.631792 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.631753    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:24.669087 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.669043    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7" event={"ID":"14113433-17be-4477-acbc-92dc82d5d820","Type":"ContainerStarted","Data":"4b22b2750f354a599902df5da0ee5497424f8b9b582059bc29573802c85f34c1"}
Jul 16 00:24:24.669278 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.669125    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"
Jul 16 00:24:24.697825 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.697777    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7" podStartSLOduration=1.833863083 podStartE2EDuration="3.697755401s" totalImagesPullingTime="1.863892318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:24:24.697382387 +0000 UTC m=+670.268978689" watchObservedRunningTime="2026-07-16 00:24:24.697755401 +0000 UTC m=+670.269351705"
Jul 16 00:24:24.775454 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:24.775427    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"]
Jul 16 00:24:24.778286 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:24:24.778250    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dc9c19_6f73_49da_aebc_a22beb1d2315.slice/crio-eec8aa7838d73a835a6b53f7ba486e4c92c29ce60cc8694f6eb92c0960cd399a WatchSource:0}: Error finding container eec8aa7838d73a835a6b53f7ba486e4c92c29ce60cc8694f6eb92c0960cd399a: Status 404 returned error can't find the container with id eec8aa7838d73a835a6b53f7ba486e4c92c29ce60cc8694f6eb92c0960cd399a
Jul 16 00:24:25.674326 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:25.674296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns" event={"ID":"f4dc9c19-6f73-49da-aebc-a22beb1d2315","Type":"ContainerStarted","Data":"eec8aa7838d73a835a6b53f7ba486e4c92c29ce60cc8694f6eb92c0960cd399a"}
Jul 16 00:24:27.684991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:27.684963    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns" event={"ID":"f4dc9c19-6f73-49da-aebc-a22beb1d2315","Type":"ContainerStarted","Data":"cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1"}
Jul 16 00:24:27.685343 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:27.685076    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:27.709466 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:27.709421    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns" podStartSLOduration=1.74334944 podStartE2EDuration="3.709406373s" totalImagesPullingTime="1.966056933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:24:27.708373327 +0000 UTC m=+673.279969621" watchObservedRunningTime="2026-07-16 00:24:27.709406373 +0000 UTC m=+673.281002734"
Jul 16 00:24:28.971488 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:28.971459    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"]
Jul 16 00:24:28.974816 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:28.974801    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:28.977539 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:28.977515    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h558g\""
Jul 16 00:24:28.995779 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:28.995756    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"]
Jul 16 00:24:29.124997 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.124959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfdcs\" (UniqueName: \"kubernetes.io/projected/d036df00-d305-4fde-845d-843bada391e8-kube-api-access-xfdcs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:29.125191 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.125058    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d036df00-d305-4fde-845d-843bada391e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:29.226102 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.226028    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d036df00-d305-4fde-845d-843bada391e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:29.226102 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.226091    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfdcs\" (UniqueName: \"kubernetes.io/projected/d036df00-d305-4fde-845d-843bada391e8-kube-api-access-xfdcs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:29.226428 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.226409    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d036df00-d305-4fde-845d-843bada391e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:29.242748 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.242724    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfdcs\" (UniqueName: \"kubernetes.io/projected/d036df00-d305-4fde-845d-843bada391e8-kube-api-access-xfdcs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:29.284695 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.284673    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:29.430788 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.430761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"]
Jul 16 00:24:29.433449 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:24:29.433420    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd036df00_d305_4fde_845d_843bada391e8.slice/crio-4ef8487b7eb40b9b8d37632906c54a83a5dfe02ea3c9752284796c74a91138e3 WatchSource:0}: Error finding container 4ef8487b7eb40b9b8d37632906c54a83a5dfe02ea3c9752284796c74a91138e3: Status 404 returned error can't find the container with id 4ef8487b7eb40b9b8d37632906c54a83a5dfe02ea3c9752284796c74a91138e3
Jul 16 00:24:29.694691 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.694655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w" event={"ID":"d036df00-d305-4fde-845d-843bada391e8","Type":"ContainerStarted","Data":"4ef8487b7eb40b9b8d37632906c54a83a5dfe02ea3c9752284796c74a91138e3"}
Jul 16 00:24:29.919971 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.919936    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:29.920158 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.920028    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:29.925740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:29.925715    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:30.703212 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:30.703171    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7876967cb5-tqxkm"
Jul 16 00:24:30.781898 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:30.781868    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8dfb4cb-7p5t6"]
Jul 16 00:24:33.666584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:33.666550    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svtqs"
Jul 16 00:24:35.677656 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:35.677597    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kcpx7"
Jul 16 00:24:35.727536 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:35.727498    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w" event={"ID":"d036df00-d305-4fde-845d-843bada391e8","Type":"ContainerStarted","Data":"19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2"}
Jul 16 00:24:35.727769 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:35.727595    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:35.754560 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:35.754496    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w" podStartSLOduration=2.45892767 podStartE2EDuration="7.754473371s" totalImagesPullingTime="5.295545701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:24:35.751394693 +0000 UTC m=+681.322990994" watchObservedRunningTime="2026-07-16 00:24:35.754473371 +0000 UTC m=+681.326069674"
Jul 16 00:24:37.706517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.706478    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"]
Jul 16 00:24:37.709752 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.709730    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.713115 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.713093    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 00:24:37.713648 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.713625    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 00:24:37.713816 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.713801    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-95lhl\""
Jul 16 00:24:37.725399 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.725367    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"]
Jul 16 00:24:37.810904 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.810867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fb06c50-394f-49ce-beed-bb6db809ed58-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.811081 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.810929    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fb06c50-394f-49ce-beed-bb6db809ed58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.811081 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.810996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fc8f\" (UniqueName: \"kubernetes.io/projected/5fb06c50-394f-49ce-beed-bb6db809ed58-kube-api-access-6fc8f\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.912234 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.912184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fc8f\" (UniqueName: \"kubernetes.io/projected/5fb06c50-394f-49ce-beed-bb6db809ed58-kube-api-access-6fc8f\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.912412 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.912262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fb06c50-394f-49ce-beed-bb6db809ed58-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.912412 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.912330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fb06c50-394f-49ce-beed-bb6db809ed58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.912485 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:37.912459    2556 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 16 00:24:37.912551 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:37.912540    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb06c50-394f-49ce-beed-bb6db809ed58-plugin-serving-cert podName:5fb06c50-394f-49ce-beed-bb6db809ed58 nodeName:}" failed. No retries permitted until 2026-07-16 00:24:38.412518865 +0000 UTC m=+683.984115164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5fb06c50-394f-49ce-beed-bb6db809ed58-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-fnzbf" (UID: "5fb06c50-394f-49ce-beed-bb6db809ed58") : secret "plugin-serving-cert" not found
Jul 16 00:24:37.912968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.912948    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fb06c50-394f-49ce-beed-bb6db809ed58-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:37.927049 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:37.927009    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fc8f\" (UniqueName: \"kubernetes.io/projected/5fb06c50-394f-49ce-beed-bb6db809ed58-kube-api-access-6fc8f\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:38.416162 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:38.416123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fb06c50-394f-49ce-beed-bb6db809ed58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:38.418799 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:38.418775    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fb06c50-394f-49ce-beed-bb6db809ed58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fnzbf\" (UID: \"5fb06c50-394f-49ce-beed-bb6db809ed58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:38.619298 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:38.619253    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"
Jul 16 00:24:38.691411 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:38.691386    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:38.756535 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:38.756511    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf"]
Jul 16 00:24:38.758700 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:24:38.758676    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fb06c50_394f_49ce_beed_bb6db809ed58.slice/crio-b2864576b7b047adaecfd15e54542cc51d0f4c30f08c803b948e5a62c97cdd23 WatchSource:0}: Error finding container b2864576b7b047adaecfd15e54542cc51d0f4c30f08c803b948e5a62c97cdd23: Status 404 returned error can't find the container with id b2864576b7b047adaecfd15e54542cc51d0f4c30f08c803b948e5a62c97cdd23
Jul 16 00:24:39.755371 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:39.755333    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf" event={"ID":"5fb06c50-394f-49ce-beed-bb6db809ed58","Type":"ContainerStarted","Data":"b2864576b7b047adaecfd15e54542cc51d0f4c30f08c803b948e5a62c97cdd23"}
Jul 16 00:24:46.735762 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:46.735726    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:49.272587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.272550    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"]
Jul 16 00:24:49.273043 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.272804    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w" podUID="d036df00-d305-4fde-845d-843bada391e8" containerName="manager" containerID="cri-o://19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2" gracePeriod=2
Jul 16 00:24:49.290744 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.290716    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"]
Jul 16 00:24:49.304881 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:49.304847    2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d036df00-d305-4fde-845d-843bada391e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\": pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:49.320567 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.320534    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"]
Jul 16 00:24:49.320922 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.320837    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" containerName="manager" containerID="cri-o://cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1" gracePeriod=2
Jul 16 00:24:49.338803 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:49.338742    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:49.339379 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.339349    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"]
Jul 16 00:24:49.364649 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.364437    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"]
Jul 16 00:24:49.364980 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.364948    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" containerName="manager"
Jul 16 00:24:49.365122 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.365015    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" containerName="manager"
Jul 16 00:24:49.365122 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.365031    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d036df00-d305-4fde-845d-843bada391e8" containerName="manager"
Jul 16 00:24:49.365122 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.365041    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d036df00-d305-4fde-845d-843bada391e8" containerName="manager"
Jul 16 00:24:49.365294 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.365171    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" containerName="manager"
Jul 16 00:24:49.365294 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.365186    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d036df00-d305-4fde-845d-843bada391e8" containerName="manager"
Jul 16 00:24:49.368452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.368425    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"]
Jul 16 00:24:49.368596 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.368543    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"
Jul 16 00:24:49.372094 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.371973    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:49.372234 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:49.372118    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d4zns\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:49.388690 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.388651    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"]
Jul 16 00:24:49.400883 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.400836    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"]
Jul 16 00:24:49.422930 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:49.422880    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:49.423663 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.423620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf4d625d-3426-483a-ba6b-50d01f71a2c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78lxz\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:49.423817 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.423735    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg4x9\" (UniqueName: \"kubernetes.io/projected/809c2a6f-a7e0-47d1-95d4-e884298bf2dd-kube-api-access-hg4x9\") pod \"limitador-operator-controller-manager-859d7b78bd-7dx9r\" (UID: \"809c2a6f-a7e0-47d1-95d4-e884298bf2dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"
Jul 16 00:24:49.423874 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.423845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w78h7\" (UniqueName: \"kubernetes.io/projected/bf4d625d-3426-483a-ba6b-50d01f71a2c2-kube-api-access-w78h7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78lxz\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:49.426871 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:49.426820    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d4zns\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:24:49.430995 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:24:49.430958    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:24:49.524394 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.524305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf4d625d-3426-483a-ba6b-50d01f71a2c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78lxz\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:49.524394 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.524375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg4x9\" (UniqueName: \"kubernetes.io/projected/809c2a6f-a7e0-47d1-95d4-e884298bf2dd-kube-api-access-hg4x9\") pod \"limitador-operator-controller-manager-859d7b78bd-7dx9r\" (UID: \"809c2a6f-a7e0-47d1-95d4-e884298bf2dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"
Jul 16 00:24:49.524628 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.524459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w78h7\" (UniqueName: \"kubernetes.io/projected/bf4d625d-3426-483a-ba6b-50d01f71a2c2-kube-api-access-w78h7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78lxz\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:49.524747 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.524726    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf4d625d-3426-483a-ba6b-50d01f71a2c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78lxz\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:49.537120 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.537075    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg4x9\" (UniqueName: \"kubernetes.io/projected/809c2a6f-a7e0-47d1-95d4-e884298bf2dd-kube-api-access-hg4x9\") pod \"limitador-operator-controller-manager-859d7b78bd-7dx9r\" (UID: \"809c2a6f-a7e0-47d1-95d4-e884298bf2dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"
Jul 16 00:24:49.537825 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.537799    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w78h7\" (UniqueName: \"kubernetes.io/projected/bf4d625d-3426-483a-ba6b-50d01f71a2c2-kube-api-access-w78h7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-78lxz\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:49.710043 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.710000    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"
Jul 16 00:24:49.719224 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:49.719188    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:24:51.447505 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.447466    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"]
Jul 16 00:24:51.512186 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.512145    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"]
Jul 16 00:24:51.512372 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.512252    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:51.643197 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.643156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksx48\" (UniqueName: \"kubernetes.io/projected/df51ed1d-9236-404a-8310-a439fc4ab99d-kube-api-access-ksx48\") pod \"kuadrant-operator-controller-manager-86878c769f-vv8s8\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:51.643400 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.643304    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df51ed1d-9236-404a-8310-a439fc4ab99d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vv8s8\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:51.743887 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.743803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksx48\" (UniqueName: \"kubernetes.io/projected/df51ed1d-9236-404a-8310-a439fc4ab99d-kube-api-access-ksx48\") pod \"kuadrant-operator-controller-manager-86878c769f-vv8s8\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:51.744051 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.743895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df51ed1d-9236-404a-8310-a439fc4ab99d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vv8s8\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:51.744269 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.744250    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df51ed1d-9236-404a-8310-a439fc4ab99d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vv8s8\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:51.761482 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.761451    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksx48\" (UniqueName: \"kubernetes.io/projected/df51ed1d-9236-404a-8310-a439fc4ab99d-kube-api-access-ksx48\") pod \"kuadrant-operator-controller-manager-86878c769f-vv8s8\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:51.827547 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:51.826924    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:24:55.811244 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:55.811198    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b8dfb4cb-7p5t6" podUID="b92c2790-8da4-4e4f-9f2a-c0057689d9b0" containerName="console" containerID="cri-o://e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7" gracePeriod=15
Jul 16 00:24:56.661718 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:56.661678    2556 patch_prober.go:28] interesting pod/console-6b8dfb4cb-7p5t6 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body=
Jul 16 00:24:56.661905 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:24:56.661759    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6b8dfb4cb-7p5t6" podUID="b92c2790-8da4-4e4f-9f2a-c0057689d9b0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused"
Jul 16 00:25:00.851587 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.851556    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:25:00.878145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.877822    2556 generic.go:356] "Generic (PLEG): container finished" podID="b92c2790-8da4-4e4f-9f2a-c0057689d9b0" containerID="e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7" exitCode=0
Jul 16 00:25:00.878145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.877869    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dfb4cb-7p5t6"
Jul 16 00:25:00.878145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.877939    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dfb4cb-7p5t6" event={"ID":"b92c2790-8da4-4e4f-9f2a-c0057689d9b0","Type":"ContainerDied","Data":"e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7"}
Jul 16 00:25:00.878145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.877986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dfb4cb-7p5t6" event={"ID":"b92c2790-8da4-4e4f-9f2a-c0057689d9b0","Type":"ContainerDied","Data":"efd671bff320a9195044d9e58c9a2ed747abf1c810fa550cb199535cee8f685f"}
Jul 16 00:25:00.878145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.878013    2556 scope.go:117] "RemoveContainer" containerID="e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7"
Jul 16 00:25:00.883185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.882787    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:25:00.890692 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.888807    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:00.893641 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.893581    2556 generic.go:356] "Generic (PLEG): container finished" podID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" containerID="cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1" exitCode=0
Jul 16 00:25:00.896840 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.896801    2556 generic.go:356] "Generic (PLEG): container finished" podID="d036df00-d305-4fde-845d-843bada391e8" containerID="19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2" exitCode=0
Jul 16 00:25:00.896974 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.896867    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:00.899647 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.899206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf" event={"ID":"5fb06c50-394f-49ce-beed-bb6db809ed58","Type":"ContainerStarted","Data":"9fdb773b9afebf90d84dbc0ce76a9c3e22d5a9b5ce3af413aa64165f08c704e8"}
Jul 16 00:25:00.903722 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.903442    2556 scope.go:117] "RemoveContainer" containerID="e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7"
Jul 16 00:25:00.903942 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:00.903909    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7\": container with ID starting with e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7 not found: ID does not exist" containerID="e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7"
Jul 16 00:25:00.903995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.903970    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7"} err="failed to get container status \"e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7\": rpc error: code = NotFound desc = could not find container \"e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7\": container with ID starting with e2ba18da608aa85e7ffc8c972b220d460b3675c4810b113ca1f20e0723fad0f7 not found: ID does not exist"
Jul 16 00:25:00.904049 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.903995    2556 scope.go:117] "RemoveContainer" containerID="cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1"
Jul 16 00:25:00.910517 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:00.910424    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:00.911169 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.911126    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"]
Jul 16 00:25:00.913927 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:00.913890    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d4zns\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:25:00.915042 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:25:00.914999    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4d625d_3426_483a_ba6b_50d01f71a2c2.slice/crio-002b1784f7d8e44b291842e4d766813863d4852903e360ed2bc8d694e060b460 WatchSource:0}: Error finding container 002b1784f7d8e44b291842e4d766813863d4852903e360ed2bc8d694e060b460: Status 404 returned error can't find the container with id 002b1784f7d8e44b291842e4d766813863d4852903e360ed2bc8d694e060b460
Jul 16 00:25:00.917668 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.917646    2556 scope.go:117] "RemoveContainer" containerID="cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1"
Jul 16 00:25:00.918012 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:00.917982    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1\": container with ID starting with cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1 not found: ID does not exist" containerID="cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1"
Jul 16 00:25:00.918118 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.918025    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1"} err="failed to get container status \"cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1\": rpc error: code = NotFound desc = could not find container \"cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1\": container with ID starting with cf1f5ecc588ef29f964c2ca8a448ade3e07e480c3890376d94fc41e2975197d1 not found: ID does not exist"
Jul 16 00:25:00.918118 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.918052    2556 scope.go:117] "RemoveContainer" containerID="19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2"
Jul 16 00:25:00.928042 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.928010    2556 scope.go:117] "RemoveContainer" containerID="19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2"
Jul 16 00:25:00.928200 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:00.927995    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d4zns\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:25:00.928421 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:00.928398    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2\": container with ID starting with 19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2 not found: ID does not exist" containerID="19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2"
Jul 16 00:25:00.928487 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.928430    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2"} err="failed to get container status \"19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2\": rpc error: code = NotFound desc = could not find container \"19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2\": container with ID starting with 19f6010452995f73110628ae4d215d6cbcfe31fabd83264bbe02f8de8c7547d2 not found: ID does not exist"
Jul 16 00:25:00.930589 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:00.930559    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:00.935688 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.935659    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7229\" (UniqueName: \"kubernetes.io/projected/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-kube-api-access-m7229\") pod \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") "
Jul 16 00:25:00.935791 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.935747    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-oauth-serving-cert\") pod \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") "
Jul 16 00:25:00.935925 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.935900    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-oauth-config\") pod \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") "
Jul 16 00:25:00.936020 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.935956    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-serving-cert\") pod \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") "
Jul 16 00:25:00.936020 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.935992    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-service-ca\") pod \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") "
Jul 16 00:25:00.936132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.936074    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-config\") pod \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") "
Jul 16 00:25:00.936132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.936104    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-trusted-ca-bundle\") pod \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\" (UID: \"b92c2790-8da4-4e4f-9f2a-c0057689d9b0\") "
Jul 16 00:25:00.936237 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.936144    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b92c2790-8da4-4e4f-9f2a-c0057689d9b0" (UID: "b92c2790-8da4-4e4f-9f2a-c0057689d9b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:25:00.936437 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.936414    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-oauth-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:00.936590 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.936546    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "b92c2790-8da4-4e4f-9f2a-c0057689d9b0" (UID: "b92c2790-8da4-4e4f-9f2a-c0057689d9b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:25:00.936590 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.936676    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-config" (OuterVolumeSpecName: "console-config") pod "b92c2790-8da4-4e4f-9f2a-c0057689d9b0" (UID: "b92c2790-8da4-4e4f-9f2a-c0057689d9b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:25:00.936911 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.936797    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b92c2790-8da4-4e4f-9f2a-c0057689d9b0" (UID: "b92c2790-8da4-4e4f-9f2a-c0057689d9b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:25:00.939033 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.938994    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-kube-api-access-m7229" (OuterVolumeSpecName: "kube-api-access-m7229") pod "b92c2790-8da4-4e4f-9f2a-c0057689d9b0" (UID: "b92c2790-8da4-4e4f-9f2a-c0057689d9b0"). InnerVolumeSpecName "kube-api-access-m7229". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:25:00.939221 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.939182    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b92c2790-8da4-4e4f-9f2a-c0057689d9b0" (UID: "b92c2790-8da4-4e4f-9f2a-c0057689d9b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:25:00.939560 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.939534    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b92c2790-8da4-4e4f-9f2a-c0057689d9b0" (UID: "b92c2790-8da4-4e4f-9f2a-c0057689d9b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:25:00.942515 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.942436    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"]
Jul 16 00:25:00.943684 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:25:00.943660    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf51ed1d_9236_404a_8310_a439fc4ab99d.slice/crio-dd405bc7a867199a424fcdea5c9134f3d8d307ca52c7b57bf01fa73d62c1e62c WatchSource:0}: Error finding container dd405bc7a867199a424fcdea5c9134f3d8d307ca52c7b57bf01fa73d62c1e62c: Status 404 returned error can't find the container with id dd405bc7a867199a424fcdea5c9134f3d8d307ca52c7b57bf01fa73d62c1e62c
Jul 16 00:25:00.957392 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.957366    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"]
Jul 16 00:25:00.960334 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:25:00.960307    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809c2a6f_a7e0_47d1_95d4_e884298bf2dd.slice/crio-92bf22f90cec609cf9328c8446724048bdabd199aff1a6a75bb58613bd5cbc19 WatchSource:0}: Error finding container 92bf22f90cec609cf9328c8446724048bdabd199aff1a6a75bb58613bd5cbc19: Status 404 returned error can't find the container with id 92bf22f90cec609cf9328c8446724048bdabd199aff1a6a75bb58613bd5cbc19
Jul 16 00:25:00.975417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:00.975346    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fnzbf" podStartSLOduration=1.992313915 podStartE2EDuration="23.975314931s" totalImagesPullingTime="21.983001016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:00.974881815 +0000 UTC m=+706.546478116" watchObservedRunningTime="2026-07-16 00:25:00.975314931 +0000 UTC m=+706.546911233"
Jul 16 00:25:01.037008 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.036970    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-526qc\" (UniqueName: \"kubernetes.io/projected/f4dc9c19-6f73-49da-aebc-a22beb1d2315-kube-api-access-526qc\") pod \"f4dc9c19-6f73-49da-aebc-a22beb1d2315\" (UID: \"f4dc9c19-6f73-49da-aebc-a22beb1d2315\") "
Jul 16 00:25:01.037192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037032    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfdcs\" (UniqueName: \"kubernetes.io/projected/d036df00-d305-4fde-845d-843bada391e8-kube-api-access-xfdcs\") pod \"d036df00-d305-4fde-845d-843bada391e8\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") "
Jul 16 00:25:01.037192 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037057    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d036df00-d305-4fde-845d-843bada391e8-extensions-socket-volume\") pod \"d036df00-d305-4fde-845d-843bada391e8\" (UID: \"d036df00-d305-4fde-845d-843bada391e8\") "
Jul 16 00:25:01.037452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037307    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.037452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037358    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-trusted-ca-bundle\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.037452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037378    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7229\" (UniqueName: \"kubernetes.io/projected/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-kube-api-access-m7229\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.037452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037394    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-oauth-config\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.037452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037409    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-console-serving-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.037452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037445    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b92c2790-8da4-4e4f-9f2a-c0057689d9b0-service-ca\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.037828 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.037745    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d036df00-d305-4fde-845d-843bada391e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d036df00-d305-4fde-845d-843bada391e8" (UID: "d036df00-d305-4fde-845d-843bada391e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:25:01.040097 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.040069    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d036df00-d305-4fde-845d-843bada391e8-kube-api-access-xfdcs" (OuterVolumeSpecName: "kube-api-access-xfdcs") pod "d036df00-d305-4fde-845d-843bada391e8" (UID: "d036df00-d305-4fde-845d-843bada391e8"). InnerVolumeSpecName "kube-api-access-xfdcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:25:01.040207 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.040076    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4dc9c19-6f73-49da-aebc-a22beb1d2315-kube-api-access-526qc" (OuterVolumeSpecName: "kube-api-access-526qc") pod "f4dc9c19-6f73-49da-aebc-a22beb1d2315" (UID: "f4dc9c19-6f73-49da-aebc-a22beb1d2315"). InnerVolumeSpecName "kube-api-access-526qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:25:01.138920 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.138828    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfdcs\" (UniqueName: \"kubernetes.io/projected/d036df00-d305-4fde-845d-843bada391e8-kube-api-access-xfdcs\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.138920 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.138865    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d036df00-d305-4fde-845d-843bada391e8-extensions-socket-volume\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.138920 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.138875    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-526qc\" (UniqueName: \"kubernetes.io/projected/f4dc9c19-6f73-49da-aebc-a22beb1d2315-kube-api-access-526qc\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:01.208727 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.208695    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8dfb4cb-7p5t6"]
Jul 16 00:25:01.213847 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.213825    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b8dfb4cb-7p5t6"]
Jul 16 00:25:01.214944 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:01.214913    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:01.904789 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.904703    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:25:01.906540 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.906506    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8" event={"ID":"df51ed1d-9236-404a-8310-a439fc4ab99d","Type":"ContainerStarted","Data":"cdc492bcaed725b54e3abe840a018eb3230429bcaaa9d2ca68da15726941f1a2"}
Jul 16 00:25:01.906691 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.906573    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:25:01.906691 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.906596    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8" event={"ID":"df51ed1d-9236-404a-8310-a439fc4ab99d","Type":"ContainerStarted","Data":"dd405bc7a867199a424fcdea5c9134f3d8d307ca52c7b57bf01fa73d62c1e62c"}
Jul 16 00:25:01.908198 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.908167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r" event={"ID":"809c2a6f-a7e0-47d1-95d4-e884298bf2dd","Type":"ContainerStarted","Data":"44bab2ed84a9e15893f980d3b38792d14dc4a7a437d31a8cbe19ff4f025ad509"}
Jul 16 00:25:01.908353 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.908214    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r" event={"ID":"809c2a6f-a7e0-47d1-95d4-e884298bf2dd","Type":"ContainerStarted","Data":"92bf22f90cec609cf9328c8446724048bdabd199aff1a6a75bb58613bd5cbc19"}
Jul 16 00:25:01.908353 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.908277    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"
Jul 16 00:25:01.908836 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:01.908806    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:01.910723 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.910697    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz" event={"ID":"bf4d625d-3426-483a-ba6b-50d01f71a2c2","Type":"ContainerStarted","Data":"b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501"}
Jul 16 00:25:01.910831 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.910744    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz" event={"ID":"bf4d625d-3426-483a-ba6b-50d01f71a2c2","Type":"ContainerStarted","Data":"002b1784f7d8e44b291842e4d766813863d4852903e360ed2bc8d694e060b460"}
Jul 16 00:25:01.910831 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:01.910790    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:25:01.911055 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:01.911020    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d4zns\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:25:01.913456 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:01.913433    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:02.017232 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:02.017189    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d4zns\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:25:02.017755 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:02.017713    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8" podStartSLOduration=11.017698592 podStartE2EDuration="11.017698592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:02.009951695 +0000 UTC m=+707.581547996" watchObservedRunningTime="2026-07-16 00:25:02.017698592 +0000 UTC m=+707.589294892"
Jul 16 00:25:02.018834 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:02.018808    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz" podStartSLOduration=13.018799361 podStartE2EDuration="13.018799361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:01.960554928 +0000 UTC m=+707.532151228" watchObservedRunningTime="2026-07-16 00:25:02.018799361 +0000 UTC m=+707.590395662"
Jul 16 00:25:02.047174 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:02.047131    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r" podStartSLOduration=13.047120368 podStartE2EDuration="13.047120368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:02.046926182 +0000 UTC m=+707.618522484" watchObservedRunningTime="2026-07-16 00:25:02.047120368 +0000 UTC m=+707.618716666"
Jul 16 00:25:02.053143 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:02.053115    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vxp6w\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="d036df00-d305-4fde-845d-843bada391e8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vxp6w"
Jul 16 00:25:02.055674 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:02.055654    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d4zns\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d4zns"
Jul 16 00:25:02.971240 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:02.971204    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92c2790-8da4-4e4f-9f2a-c0057689d9b0" path="/var/lib/kubelet/pods/b92c2790-8da4-4e4f-9f2a-c0057689d9b0/volumes"
Jul 16 00:25:02.971632 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:02.971540    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d036df00-d305-4fde-845d-843bada391e8" path="/var/lib/kubelet/pods/d036df00-d305-4fde-845d-843bada391e8/volumes"
Jul 16 00:25:02.971888 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:02.971873    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4dc9c19-6f73-49da-aebc-a22beb1d2315" path="/var/lib/kubelet/pods/f4dc9c19-6f73-49da-aebc-a22beb1d2315/volumes"
Jul 16 00:25:12.919059 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:12.918979    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:25:12.919622 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:12.919061    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:25:12.919622 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:12.919112    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7dx9r"
Jul 16 00:25:13.052627 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.052583    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"]
Jul 16 00:25:13.052834 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.052808    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz" podUID="bf4d625d-3426-483a-ba6b-50d01f71a2c2" containerName="manager" containerID="cri-o://b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501" gracePeriod=10
Jul 16 00:25:13.302705 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.302671    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:25:13.448315 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.448288    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w78h7\" (UniqueName: \"kubernetes.io/projected/bf4d625d-3426-483a-ba6b-50d01f71a2c2-kube-api-access-w78h7\") pod \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") "
Jul 16 00:25:13.448500 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.448346    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf4d625d-3426-483a-ba6b-50d01f71a2c2-extensions-socket-volume\") pod \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\" (UID: \"bf4d625d-3426-483a-ba6b-50d01f71a2c2\") "
Jul 16 00:25:13.448831 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.448801    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf4d625d-3426-483a-ba6b-50d01f71a2c2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bf4d625d-3426-483a-ba6b-50d01f71a2c2" (UID: "bf4d625d-3426-483a-ba6b-50d01f71a2c2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:25:13.450494 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.450468    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf4d625d-3426-483a-ba6b-50d01f71a2c2-kube-api-access-w78h7" (OuterVolumeSpecName: "kube-api-access-w78h7") pod "bf4d625d-3426-483a-ba6b-50d01f71a2c2" (UID: "bf4d625d-3426-483a-ba6b-50d01f71a2c2"). InnerVolumeSpecName "kube-api-access-w78h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:25:13.549517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.549494    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf4d625d-3426-483a-ba6b-50d01f71a2c2-extensions-socket-volume\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:13.549517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.549515    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w78h7\" (UniqueName: \"kubernetes.io/projected/bf4d625d-3426-483a-ba6b-50d01f71a2c2-kube-api-access-w78h7\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:13.984244 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.984147    2556 generic.go:356] "Generic (PLEG): container finished" podID="bf4d625d-3426-483a-ba6b-50d01f71a2c2" containerID="b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501" exitCode=0
Jul 16 00:25:13.984244 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.984194    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"
Jul 16 00:25:13.984791 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.984244    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz" event={"ID":"bf4d625d-3426-483a-ba6b-50d01f71a2c2","Type":"ContainerDied","Data":"b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501"}
Jul 16 00:25:13.984791 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.984307    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz" event={"ID":"bf4d625d-3426-483a-ba6b-50d01f71a2c2","Type":"ContainerDied","Data":"002b1784f7d8e44b291842e4d766813863d4852903e360ed2bc8d694e060b460"}
Jul 16 00:25:13.984791 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.984340    2556 scope.go:117] "RemoveContainer" containerID="b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501"
Jul 16 00:25:13.993417 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.993396    2556 scope.go:117] "RemoveContainer" containerID="b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501"
Jul 16 00:25:13.993771 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:25:13.993753    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501\": container with ID starting with b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501 not found: ID does not exist" containerID="b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501"
Jul 16 00:25:13.993826 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:13.993787    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501"} err="failed to get container status \"b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501\": rpc error: code = NotFound desc = could not find container \"b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501\": container with ID starting with b14d9015a77d547f26d7dc41bd036554d68b0a79ca1b1a8ab0f390887afd3501 not found: ID does not exist"
Jul 16 00:25:14.026135 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:14.026101    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"]
Jul 16 00:25:14.042904 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:14.042871    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-78lxz"]
Jul 16 00:25:14.970502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:14.970468    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf4d625d-3426-483a-ba6b-50d01f71a2c2" path="/var/lib/kubelet/pods/bf4d625d-3426-483a-ba6b-50d01f71a2c2/volumes"
Jul 16 00:25:31.940711 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.940671    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"]
Jul 16 00:25:31.941149 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.941056    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92c2790-8da4-4e4f-9f2a-c0057689d9b0" containerName="console"
Jul 16 00:25:31.941149 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.941071    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92c2790-8da4-4e4f-9f2a-c0057689d9b0" containerName="console"
Jul 16 00:25:31.941149 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.941093    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf4d625d-3426-483a-ba6b-50d01f71a2c2" containerName="manager"
Jul 16 00:25:31.941149 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.941099    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4d625d-3426-483a-ba6b-50d01f71a2c2" containerName="manager"
Jul 16 00:25:31.941338 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.941158    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf4d625d-3426-483a-ba6b-50d01f71a2c2" containerName="manager"
Jul 16 00:25:31.941338 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.941174    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92c2790-8da4-4e4f-9f2a-c0057689d9b0" containerName="console"
Jul 16 00:25:31.959965 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.959933    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:31.969738 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.969714    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 00:25:31.974456 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:31.974432    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"]
Jul 16 00:25:32.012919 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.012875    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppdqx\" (UniqueName: \"kubernetes.io/projected/943e8e30-67b9-4958-936c-5d2229095767-kube-api-access-ppdqx\") pod \"limitador-limitador-64c94fd64f-nh5j8\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:32.013066 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.012985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/943e8e30-67b9-4958-936c-5d2229095767-config-file\") pod \"limitador-limitador-64c94fd64f-nh5j8\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:32.053591 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.053560    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"]
Jul 16 00:25:32.114165 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.114124    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppdqx\" (UniqueName: \"kubernetes.io/projected/943e8e30-67b9-4958-936c-5d2229095767-kube-api-access-ppdqx\") pod \"limitador-limitador-64c94fd64f-nh5j8\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:32.114165 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.114174    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/943e8e30-67b9-4958-936c-5d2229095767-config-file\") pod \"limitador-limitador-64c94fd64f-nh5j8\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:32.114886 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.114867    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/943e8e30-67b9-4958-936c-5d2229095767-config-file\") pod \"limitador-limitador-64c94fd64f-nh5j8\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:32.125323 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.125294    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppdqx\" (UniqueName: \"kubernetes.io/projected/943e8e30-67b9-4958-936c-5d2229095767-kube-api-access-ppdqx\") pod \"limitador-limitador-64c94fd64f-nh5j8\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:32.272508 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.272470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:32.426383 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:32.426192    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"]
Jul 16 00:25:32.429378 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:25:32.429341    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943e8e30_67b9_4958_936c_5d2229095767.slice/crio-48bfb8f3bb2f32afde12d73b3e1614b973a0c90f90ef822a89c4b7e80f9f9f80 WatchSource:0}: Error finding container 48bfb8f3bb2f32afde12d73b3e1614b973a0c90f90ef822a89c4b7e80f9f9f80: Status 404 returned error can't find the container with id 48bfb8f3bb2f32afde12d73b3e1614b973a0c90f90ef822a89c4b7e80f9f9f80
Jul 16 00:25:33.078235 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.078198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8" event={"ID":"943e8e30-67b9-4958-936c-5d2229095767","Type":"ContainerStarted","Data":"48bfb8f3bb2f32afde12d73b3e1614b973a0c90f90ef822a89c4b7e80f9f9f80"}
Jul 16 00:25:33.213423 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.213389    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-57vgd"]
Jul 16 00:25:33.217909 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.217876    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-57vgd"
Jul 16 00:25:33.221111 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.221090    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mdmzd\""
Jul 16 00:25:33.252502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.252472    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-57vgd"]
Jul 16 00:25:33.326131 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.326086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2x2z\" (UniqueName: \"kubernetes.io/projected/c57b9f54-d323-4f16-a957-cc391b56d555-kube-api-access-d2x2z\") pod \"authorino-75d556bd77-57vgd\" (UID: \"c57b9f54-d323-4f16-a957-cc391b56d555\") " pod="kuadrant-system/authorino-75d556bd77-57vgd"
Jul 16 00:25:33.427802 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.427720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2x2z\" (UniqueName: \"kubernetes.io/projected/c57b9f54-d323-4f16-a957-cc391b56d555-kube-api-access-d2x2z\") pod \"authorino-75d556bd77-57vgd\" (UID: \"c57b9f54-d323-4f16-a957-cc391b56d555\") " pod="kuadrant-system/authorino-75d556bd77-57vgd"
Jul 16 00:25:33.460680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.460646    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2x2z\" (UniqueName: \"kubernetes.io/projected/c57b9f54-d323-4f16-a957-cc391b56d555-kube-api-access-d2x2z\") pod \"authorino-75d556bd77-57vgd\" (UID: \"c57b9f54-d323-4f16-a957-cc391b56d555\") " pod="kuadrant-system/authorino-75d556bd77-57vgd"
Jul 16 00:25:33.526968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.526929    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-57vgd"
Jul 16 00:25:33.723595 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:33.723473    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-57vgd"]
Jul 16 00:25:33.727265 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:25:33.727226    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc57b9f54_d323_4f16_a957_cc391b56d555.slice/crio-84f8418e6ac507345f27c2da18a2d9118de8e4224f1ec95b83214677cae60c9a WatchSource:0}: Error finding container 84f8418e6ac507345f27c2da18a2d9118de8e4224f1ec95b83214677cae60c9a: Status 404 returned error can't find the container with id 84f8418e6ac507345f27c2da18a2d9118de8e4224f1ec95b83214677cae60c9a
Jul 16 00:25:34.085051 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:34.085013    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-57vgd" event={"ID":"c57b9f54-d323-4f16-a957-cc391b56d555","Type":"ContainerStarted","Data":"84f8418e6ac507345f27c2da18a2d9118de8e4224f1ec95b83214677cae60c9a"}
Jul 16 00:25:36.099111 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:36.099068    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8" event={"ID":"943e8e30-67b9-4958-936c-5d2229095767","Type":"ContainerStarted","Data":"fd4bff3ca534b39cf9c04270c8e39458348bd9773dd3cd0b849c87000fb26ca1"}
Jul 16 00:25:36.099543 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:36.099226    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:36.130568 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:36.130510    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8" podStartSLOduration=2.006224361 podStartE2EDuration="5.130489055s" totalImagesPullingTime="3.124264694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:36.128663842 +0000 UTC m=+741.700260145" watchObservedRunningTime="2026-07-16 00:25:36.130489055 +0000 UTC m=+741.702085357"
Jul 16 00:25:38.111167 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:38.111079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-57vgd" event={"ID":"c57b9f54-d323-4f16-a957-cc391b56d555","Type":"ContainerStarted","Data":"8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432"}
Jul 16 00:25:38.141681 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:38.141631    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-57vgd" podStartSLOduration=1.011691741 podStartE2EDuration="5.141600284s" totalImagesPullingTime="4.129908543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:38.139089584 +0000 UTC m=+743.710685885" watchObservedRunningTime="2026-07-16 00:25:38.141600284 +0000 UTC m=+743.713196585"
Jul 16 00:25:47.106739 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:47.106705    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:47.522309 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:47.522281    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"]
Jul 16 00:25:47.522503 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:47.522460    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8" podUID="943e8e30-67b9-4958-936c-5d2229095767" containerName="limitador" containerID="cri-o://fd4bff3ca534b39cf9c04270c8e39458348bd9773dd3cd0b849c87000fb26ca1" gracePeriod=30
Jul 16 00:25:48.158084 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.157991    2556 generic.go:356] "Generic (PLEG): container finished" podID="943e8e30-67b9-4958-936c-5d2229095767" containerID="fd4bff3ca534b39cf9c04270c8e39458348bd9773dd3cd0b849c87000fb26ca1" exitCode=0
Jul 16 00:25:48.158084 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.158068    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8" event={"ID":"943e8e30-67b9-4958-936c-5d2229095767","Type":"ContainerDied","Data":"fd4bff3ca534b39cf9c04270c8e39458348bd9773dd3cd0b849c87000fb26ca1"}
Jul 16 00:25:48.480036 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.480000    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:48.566557 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.566523    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/943e8e30-67b9-4958-936c-5d2229095767-config-file\") pod \"943e8e30-67b9-4958-936c-5d2229095767\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") "
Jul 16 00:25:48.566771 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.566652    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppdqx\" (UniqueName: \"kubernetes.io/projected/943e8e30-67b9-4958-936c-5d2229095767-kube-api-access-ppdqx\") pod \"943e8e30-67b9-4958-936c-5d2229095767\" (UID: \"943e8e30-67b9-4958-936c-5d2229095767\") "
Jul 16 00:25:48.566961 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.566942    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943e8e30-67b9-4958-936c-5d2229095767-config-file" (OuterVolumeSpecName: "config-file") pod "943e8e30-67b9-4958-936c-5d2229095767" (UID: "943e8e30-67b9-4958-936c-5d2229095767"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:25:48.568870 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.568847    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943e8e30-67b9-4958-936c-5d2229095767-kube-api-access-ppdqx" (OuterVolumeSpecName: "kube-api-access-ppdqx") pod "943e8e30-67b9-4958-936c-5d2229095767" (UID: "943e8e30-67b9-4958-936c-5d2229095767"). InnerVolumeSpecName "kube-api-access-ppdqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:25:48.667849 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.667815    2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/943e8e30-67b9-4958-936c-5d2229095767-config-file\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:48.667849 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:48.667843    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppdqx\" (UniqueName: \"kubernetes.io/projected/943e8e30-67b9-4958-936c-5d2229095767-kube-api-access-ppdqx\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:25:49.163935 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:49.163893    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8" event={"ID":"943e8e30-67b9-4958-936c-5d2229095767","Type":"ContainerDied","Data":"48bfb8f3bb2f32afde12d73b3e1614b973a0c90f90ef822a89c4b7e80f9f9f80"}
Jul 16 00:25:49.164391 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:49.163907    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"
Jul 16 00:25:49.164391 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:49.164003    2556 scope.go:117] "RemoveContainer" containerID="fd4bff3ca534b39cf9c04270c8e39458348bd9773dd3cd0b849c87000fb26ca1"
Jul 16 00:25:49.184282 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:49.184250    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"]
Jul 16 00:25:49.187678 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:49.187649    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nh5j8"]
Jul 16 00:25:50.970932 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:50.970897    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="943e8e30-67b9-4958-936c-5d2229095767" path="/var/lib/kubelet/pods/943e8e30-67b9-4958-936c-5d2229095767/volumes"
Jul 16 00:25:53.709374 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.709343    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"]
Jul 16 00:25:53.709738 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.709695    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943e8e30-67b9-4958-936c-5d2229095767" containerName="limitador"
Jul 16 00:25:53.709738 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.709707    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="943e8e30-67b9-4958-936c-5d2229095767" containerName="limitador"
Jul 16 00:25:53.709820 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.709763    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="943e8e30-67b9-4958-936c-5d2229095767" containerName="limitador"
Jul 16 00:25:53.714056 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.714041    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:53.718329 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.718310    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 00:25:53.718804 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.718627    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 00:25:53.722626 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.722596    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 00:25:53.725362 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.725346    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-f67cz\""
Jul 16 00:25:53.763807 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.763783    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"]
Jul 16 00:25:53.816056 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.816019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpqn\" (UniqueName: \"kubernetes.io/projected/fc63ae0c-ad65-4515-8652-82fd4b5181cb-kube-api-access-6tpqn\") pod \"postgres-69fb4594cf-95zhj\" (UID: \"fc63ae0c-ad65-4515-8652-82fd4b5181cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:53.816247 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.816080    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc63ae0c-ad65-4515-8652-82fd4b5181cb-data\") pod \"postgres-69fb4594cf-95zhj\" (UID: \"fc63ae0c-ad65-4515-8652-82fd4b5181cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:53.917302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.917270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpqn\" (UniqueName: \"kubernetes.io/projected/fc63ae0c-ad65-4515-8652-82fd4b5181cb-kube-api-access-6tpqn\") pod \"postgres-69fb4594cf-95zhj\" (UID: \"fc63ae0c-ad65-4515-8652-82fd4b5181cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:53.917434 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.917325    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc63ae0c-ad65-4515-8652-82fd4b5181cb-data\") pod \"postgres-69fb4594cf-95zhj\" (UID: \"fc63ae0c-ad65-4515-8652-82fd4b5181cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:53.917705 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.917689    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc63ae0c-ad65-4515-8652-82fd4b5181cb-data\") pod \"postgres-69fb4594cf-95zhj\" (UID: \"fc63ae0c-ad65-4515-8652-82fd4b5181cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:53.953162 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:53.953132    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpqn\" (UniqueName: \"kubernetes.io/projected/fc63ae0c-ad65-4515-8652-82fd4b5181cb-kube-api-access-6tpqn\") pod \"postgres-69fb4594cf-95zhj\" (UID: \"fc63ae0c-ad65-4515-8652-82fd4b5181cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:54.024342 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:54.024316    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:54.198990 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:54.198915    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"]
Jul 16 00:25:54.201481 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:25:54.201454    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc63ae0c_ad65_4515_8652_82fd4b5181cb.slice/crio-421b524a6c86844c92cc938f5629eaf5cb76f7529375468026d2734ff2bb0c99 WatchSource:0}: Error finding container 421b524a6c86844c92cc938f5629eaf5cb76f7529375468026d2734ff2bb0c99: Status 404 returned error can't find the container with id 421b524a6c86844c92cc938f5629eaf5cb76f7529375468026d2734ff2bb0c99
Jul 16 00:25:55.197164 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:55.197126    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj" event={"ID":"fc63ae0c-ad65-4515-8652-82fd4b5181cb","Type":"ContainerStarted","Data":"421b524a6c86844c92cc938f5629eaf5cb76f7529375468026d2734ff2bb0c99"}
Jul 16 00:25:59.219897 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:59.219858    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj" event={"ID":"fc63ae0c-ad65-4515-8652-82fd4b5181cb","Type":"ContainerStarted","Data":"b138a45934d3533ed26478d2630f588d7f8e9582acca4348ae330a9f3e74ee61"}
Jul 16 00:25:59.220274 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:59.219966    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:25:59.252184 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:25:59.252129    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj" podStartSLOduration=1.3280918449999999 podStartE2EDuration="6.25211214s" totalImagesPullingTime="4.924020295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:59.248596169 +0000 UTC m=+764.820192469" watchObservedRunningTime="2026-07-16 00:25:59.25211214 +0000 UTC m=+764.823708441"
Jul 16 00:26:05.256859 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:05.256826    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-95zhj"
Jul 16 00:26:06.179315 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.179280    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c896b7647-zsflh"]
Jul 16 00:26:06.185757 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.185730    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c896b7647-zsflh"
Jul 16 00:26:06.192111 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.192063    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c896b7647-zsflh"]
Jul 16 00:26:06.225931 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.225908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgrbv\" (UniqueName: \"kubernetes.io/projected/e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda-kube-api-access-bgrbv\") pod \"authorino-7c896b7647-zsflh\" (UID: \"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda\") " pod="kuadrant-system/authorino-7c896b7647-zsflh"
Jul 16 00:26:06.326655 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.326627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgrbv\" (UniqueName: \"kubernetes.io/projected/e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda-kube-api-access-bgrbv\") pod \"authorino-7c896b7647-zsflh\" (UID: \"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda\") " pod="kuadrant-system/authorino-7c896b7647-zsflh"
Jul 16 00:26:06.339106 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.339081    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgrbv\" (UniqueName: \"kubernetes.io/projected/e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda-kube-api-access-bgrbv\") pod \"authorino-7c896b7647-zsflh\" (UID: \"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda\") " pod="kuadrant-system/authorino-7c896b7647-zsflh"
Jul 16 00:26:06.496124 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.496049    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c896b7647-zsflh"
Jul 16 00:26:06.648665 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.648626    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c896b7647-zsflh"]
Jul 16 00:26:06.652134 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:26:06.652108    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3fa0e1e_b84b_48f9_87ba_fca9c3b7bfda.slice/crio-d59ad13f8fe8a8e465c1adc38f2124f20c99059a2fe7135b1e6aa57cde76c4f4 WatchSource:0}: Error finding container d59ad13f8fe8a8e465c1adc38f2124f20c99059a2fe7135b1e6aa57cde76c4f4: Status 404 returned error can't find the container with id d59ad13f8fe8a8e465c1adc38f2124f20c99059a2fe7135b1e6aa57cde76c4f4
Jul 16 00:26:06.818356 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:06.818318    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c896b7647-zsflh"]
Jul 16 00:26:07.258964 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:07.258883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c896b7647-zsflh" event={"ID":"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda","Type":"ContainerStarted","Data":"d59ad13f8fe8a8e465c1adc38f2124f20c99059a2fe7135b1e6aa57cde76c4f4"}
Jul 16 00:26:07.836683 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:07.836643    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-57vgd"]
Jul 16 00:26:07.837130 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:07.836880    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-57vgd" podUID="c57b9f54-d323-4f16-a957-cc391b56d555" containerName="authorino" containerID="cri-o://8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432" gracePeriod=30
Jul 16 00:26:08.142423 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.142395    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-57vgd"
Jul 16 00:26:08.241370 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.241332    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2x2z\" (UniqueName: \"kubernetes.io/projected/c57b9f54-d323-4f16-a957-cc391b56d555-kube-api-access-d2x2z\") pod \"c57b9f54-d323-4f16-a957-cc391b56d555\" (UID: \"c57b9f54-d323-4f16-a957-cc391b56d555\") "
Jul 16 00:26:08.243735 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.243695    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57b9f54-d323-4f16-a957-cc391b56d555-kube-api-access-d2x2z" (OuterVolumeSpecName: "kube-api-access-d2x2z") pod "c57b9f54-d323-4f16-a957-cc391b56d555" (UID: "c57b9f54-d323-4f16-a957-cc391b56d555"). InnerVolumeSpecName "kube-api-access-d2x2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:08.265137 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.265101    2556 generic.go:356] "Generic (PLEG): container finished" podID="c57b9f54-d323-4f16-a957-cc391b56d555" containerID="8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432" exitCode=0
Jul 16 00:26:08.265306 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.265144    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-57vgd"
Jul 16 00:26:08.265306 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.265192    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-57vgd" event={"ID":"c57b9f54-d323-4f16-a957-cc391b56d555","Type":"ContainerDied","Data":"8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432"}
Jul 16 00:26:08.265306 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.265240    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-57vgd" event={"ID":"c57b9f54-d323-4f16-a957-cc391b56d555","Type":"ContainerDied","Data":"84f8418e6ac507345f27c2da18a2d9118de8e4224f1ec95b83214677cae60c9a"}
Jul 16 00:26:08.265306 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.265262    2556 scope.go:117] "RemoveContainer" containerID="8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432"
Jul 16 00:26:08.266897 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.266872    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c896b7647-zsflh" event={"ID":"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda","Type":"ContainerStarted","Data":"b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f"}
Jul 16 00:26:08.267016 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.266903    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7c896b7647-zsflh" podUID="e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda" containerName="authorino" containerID="cri-o://b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f" gracePeriod=30
Jul 16 00:26:08.275323 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.275303    2556 scope.go:117] "RemoveContainer" containerID="8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432"
Jul 16 00:26:08.275698 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:08.275671    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432\": container with ID starting with 8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432 not found: ID does not exist" containerID="8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432"
Jul 16 00:26:08.275764 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.275709    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432"} err="failed to get container status \"8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432\": rpc error: code = NotFound desc = could not find container \"8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432\": container with ID starting with 8af520821826cf2df791671f345b6e2a59e4f75bac8680a6985a23b563fd8432 not found: ID does not exist"
Jul 16 00:26:08.298841 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.298737    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c896b7647-zsflh" podStartSLOduration=1.571163723 podStartE2EDuration="2.298711324s" totalImagesPullingTime="727.547601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:08.29847805 +0000 UTC m=+773.870074350" watchObservedRunningTime="2026-07-16 00:26:08.298711324 +0000 UTC m=+773.870307619"
Jul 16 00:26:08.320681 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.320646    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-57vgd"]
Jul 16 00:26:08.324374 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.324345    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-57vgd"]
Jul 16 00:26:08.341993 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.341924    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2x2z\" (UniqueName: \"kubernetes.io/projected/c57b9f54-d323-4f16-a957-cc391b56d555-kube-api-access-d2x2z\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:26:08.566632 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.566581    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c896b7647-zsflh"
Jul 16 00:26:08.644037 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.643960    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgrbv\" (UniqueName: \"kubernetes.io/projected/e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda-kube-api-access-bgrbv\") pod \"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda\" (UID: \"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda\") "
Jul 16 00:26:08.646145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.646113    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda-kube-api-access-bgrbv" (OuterVolumeSpecName: "kube-api-access-bgrbv") pod "e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda" (UID: "e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda"). InnerVolumeSpecName "kube-api-access-bgrbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:08.744778 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.744744    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgrbv\" (UniqueName: \"kubernetes.io/projected/e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda-kube-api-access-bgrbv\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:26:08.971705 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:08.971635    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57b9f54-d323-4f16-a957-cc391b56d555" path="/var/lib/kubelet/pods/c57b9f54-d323-4f16-a957-cc391b56d555/volumes"
Jul 16 00:26:09.278850 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.278816    2556 generic.go:356] "Generic (PLEG): container finished" podID="e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda" containerID="b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f" exitCode=0
Jul 16 00:26:09.279013 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.278872    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c896b7647-zsflh"
Jul 16 00:26:09.279013 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.278873    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c896b7647-zsflh" event={"ID":"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda","Type":"ContainerDied","Data":"b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f"}
Jul 16 00:26:09.279125 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.279012    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c896b7647-zsflh" event={"ID":"e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda","Type":"ContainerDied","Data":"d59ad13f8fe8a8e465c1adc38f2124f20c99059a2fe7135b1e6aa57cde76c4f4"}
Jul 16 00:26:09.279125 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.279054    2556 scope.go:117] "RemoveContainer" containerID="b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f"
Jul 16 00:26:09.287516 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.287497    2556 scope.go:117] "RemoveContainer" containerID="b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f"
Jul 16 00:26:09.287833 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:09.287812    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f\": container with ID starting with b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f not found: ID does not exist" containerID="b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f"
Jul 16 00:26:09.287925 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.287841    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f"} err="failed to get container status \"b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f\": rpc error: code = NotFound desc = could not find container \"b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f\": container with ID starting with b32558060210a49fef77ec04acb193eb52e0bfffe9933ee81e125a4cc034a76f not found: ID does not exist"
Jul 16 00:26:09.298037 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.298002    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c896b7647-zsflh"]
Jul 16 00:26:09.299569 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:09.299548    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c896b7647-zsflh"]
Jul 16 00:26:10.970494 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:10.970461    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda" path="/var/lib/kubelet/pods/e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda/volumes"
Jul 16 00:26:12.845171 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.845143    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5944b858c8-84lxs"]
Jul 16 00:26:12.845643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.845467    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda" containerName="authorino"
Jul 16 00:26:12.845643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.845477    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda" containerName="authorino"
Jul 16 00:26:12.845643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.845506    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57b9f54-d323-4f16-a957-cc391b56d555" containerName="authorino"
Jul 16 00:26:12.845643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.845515    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57b9f54-d323-4f16-a957-cc391b56d555" containerName="authorino"
Jul 16 00:26:12.845643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.845583    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3fa0e1e-b84b-48f9-87ba-fca9c3b7bfda" containerName="authorino"
Jul 16 00:26:12.845643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.845594    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57b9f54-d323-4f16-a957-cc391b56d555" containerName="authorino"
Jul 16 00:26:12.859804 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.859779    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:12.867441 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.867423    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 00:26:12.867575 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.867548    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j28lc\""
Jul 16 00:26:12.867682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.867655    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 00:26:12.870644 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.870622    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5944b858c8-84lxs"]
Jul 16 00:26:12.875106 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.875086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert\") pod \"maas-controller-5944b858c8-84lxs\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") " pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:12.875209 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.875147    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6znbp\" (UniqueName: \"kubernetes.io/projected/17e06845-aa16-4ac8-bb3d-73c348429ec1-kube-api-access-6znbp\") pod \"maas-controller-5944b858c8-84lxs\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") " pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:12.975710 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.975671    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6znbp\" (UniqueName: \"kubernetes.io/projected/17e06845-aa16-4ac8-bb3d-73c348429ec1-kube-api-access-6znbp\") pod \"maas-controller-5944b858c8-84lxs\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") " pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:12.975923 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.975826    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert\") pod \"maas-controller-5944b858c8-84lxs\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") " pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:12.975995 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:12.975974    2556 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 16 00:26:12.976058 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:12.976042    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert podName:17e06845-aa16-4ac8-bb3d-73c348429ec1 nodeName:}" failed. No retries permitted until 2026-07-16 00:26:13.476025086 +0000 UTC m=+779.047621368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert") pod "maas-controller-5944b858c8-84lxs" (UID: "17e06845-aa16-4ac8-bb3d-73c348429ec1") : secret "maas-controller-webhook-cert" not found
Jul 16 00:26:12.989239 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:12.989204    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6znbp\" (UniqueName: \"kubernetes.io/projected/17e06845-aa16-4ac8-bb3d-73c348429ec1-kube-api-access-6znbp\") pod \"maas-controller-5944b858c8-84lxs\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") " pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:13.125079 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.124999    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c45676cbf-8q4mk"]
Jul 16 00:26:13.127531 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.127512    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.151478 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.151431    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c45676cbf-8q4mk"]
Jul 16 00:26:13.177467 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.177431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8kn9\" (UniqueName: \"kubernetes.io/projected/c2628183-9056-42a8-b6e3-e9dc02dee68d-kube-api-access-z8kn9\") pod \"maas-controller-7c45676cbf-8q4mk\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") " pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.177676 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.177502    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2628183-9056-42a8-b6e3-e9dc02dee68d-webhook-cert\") pod \"maas-controller-7c45676cbf-8q4mk\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") " pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.278293 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.278245    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8kn9\" (UniqueName: \"kubernetes.io/projected/c2628183-9056-42a8-b6e3-e9dc02dee68d-kube-api-access-z8kn9\") pod \"maas-controller-7c45676cbf-8q4mk\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") " pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.278455 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.278365    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2628183-9056-42a8-b6e3-e9dc02dee68d-webhook-cert\") pod \"maas-controller-7c45676cbf-8q4mk\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") " pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.281490 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.281459    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2628183-9056-42a8-b6e3-e9dc02dee68d-webhook-cert\") pod \"maas-controller-7c45676cbf-8q4mk\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") " pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.290474 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.290431    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8kn9\" (UniqueName: \"kubernetes.io/projected/c2628183-9056-42a8-b6e3-e9dc02dee68d-kube-api-access-z8kn9\") pod \"maas-controller-7c45676cbf-8q4mk\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") " pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.438869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.438781    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:13.479678 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.479639    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert\") pod \"maas-controller-5944b858c8-84lxs\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") " pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:13.482342 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.482311    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert\") pod \"maas-controller-5944b858c8-84lxs\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") " pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:13.585284 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.585216    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c45676cbf-8q4mk"]
Jul 16 00:26:13.587806 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:26:13.587777    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2628183_9056_42a8_b6e3_e9dc02dee68d.slice/crio-4b3c14970b06d7fa2b7276631c5e272b5427805252011501a7ab0795955e4543 WatchSource:0}: Error finding container 4b3c14970b06d7fa2b7276631c5e272b5427805252011501a7ab0795955e4543: Status 404 returned error can't find the container with id 4b3c14970b06d7fa2b7276631c5e272b5427805252011501a7ab0795955e4543
Jul 16 00:26:13.769723 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.769691    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:13.928388 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:13.928360    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5944b858c8-84lxs"]
Jul 16 00:26:13.930973 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:26:13.930943    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e06845_aa16_4ac8_bb3d_73c348429ec1.slice/crio-3f47f5561d3bf2e3a86372e27795b1f4883480db9fca025555089dbea3a1f9ec WatchSource:0}: Error finding container 3f47f5561d3bf2e3a86372e27795b1f4883480db9fca025555089dbea3a1f9ec: Status 404 returned error can't find the container with id 3f47f5561d3bf2e3a86372e27795b1f4883480db9fca025555089dbea3a1f9ec
Jul 16 00:26:14.307130 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:14.307089    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45676cbf-8q4mk" event={"ID":"c2628183-9056-42a8-b6e3-e9dc02dee68d","Type":"ContainerStarted","Data":"4b3c14970b06d7fa2b7276631c5e272b5427805252011501a7ab0795955e4543"}
Jul 16 00:26:14.308451 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:14.308425    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5944b858c8-84lxs" event={"ID":"17e06845-aa16-4ac8-bb3d-73c348429ec1","Type":"ContainerStarted","Data":"3f47f5561d3bf2e3a86372e27795b1f4883480db9fca025555089dbea3a1f9ec"}
Jul 16 00:26:16.166015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:16.165992    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 00:26:16.319347 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:16.319312    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5944b858c8-84lxs" event={"ID":"17e06845-aa16-4ac8-bb3d-73c348429ec1","Type":"ContainerStarted","Data":"9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77"}
Jul 16 00:26:16.319550 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:16.319525    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:16.321023 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:16.320996    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45676cbf-8q4mk" event={"ID":"c2628183-9056-42a8-b6e3-e9dc02dee68d","Type":"ContainerStarted","Data":"fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c"}
Jul 16 00:26:16.321167 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:16.321146    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:16.351883 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:16.351808    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5944b858c8-84lxs" podStartSLOduration=2.114967802 podStartE2EDuration="4.351790699s" totalImagesPullingTime="2.236822897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:16.349861475 +0000 UTC m=+781.921457802" watchObservedRunningTime="2026-07-16 00:26:16.351790699 +0000 UTC m=+781.923387000"
Jul 16 00:26:16.394638 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:16.394553    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c45676cbf-8q4mk" podStartSLOduration=0.820639568 podStartE2EDuration="3.394536954s" totalImagesPullingTime="2.573897386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:16.393477593 +0000 UTC m=+781.965073894" watchObservedRunningTime="2026-07-16 00:26:16.394536954 +0000 UTC m=+781.966133254"
Jul 16 00:26:27.327437 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.327400    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:27.328001 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.327859    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:26:27.457791 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.457757    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5944b858c8-84lxs"]
Jul 16 00:26:27.458015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.457985    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5944b858c8-84lxs" podUID="17e06845-aa16-4ac8-bb3d-73c348429ec1" containerName="manager" containerID="cri-o://9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77" gracePeriod=30
Jul 16 00:26:27.700372 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.700346    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:27.814475 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.814435    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6znbp\" (UniqueName: \"kubernetes.io/projected/17e06845-aa16-4ac8-bb3d-73c348429ec1-kube-api-access-6znbp\") pod \"17e06845-aa16-4ac8-bb3d-73c348429ec1\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") "
Jul 16 00:26:27.814475 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.814483    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert\") pod \"17e06845-aa16-4ac8-bb3d-73c348429ec1\" (UID: \"17e06845-aa16-4ac8-bb3d-73c348429ec1\") "
Jul 16 00:26:27.816878 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.816838    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "17e06845-aa16-4ac8-bb3d-73c348429ec1" (UID: "17e06845-aa16-4ac8-bb3d-73c348429ec1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:26:27.817002 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.816888    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e06845-aa16-4ac8-bb3d-73c348429ec1-kube-api-access-6znbp" (OuterVolumeSpecName: "kube-api-access-6znbp") pod "17e06845-aa16-4ac8-bb3d-73c348429ec1" (UID: "17e06845-aa16-4ac8-bb3d-73c348429ec1"). InnerVolumeSpecName "kube-api-access-6znbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:26:27.915869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.915780    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6znbp\" (UniqueName: \"kubernetes.io/projected/17e06845-aa16-4ac8-bb3d-73c348429ec1-kube-api-access-6znbp\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:26:27.915869 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:27.915817    2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17e06845-aa16-4ac8-bb3d-73c348429ec1-webhook-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:26:28.377877 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.377843    2556 generic.go:356] "Generic (PLEG): container finished" podID="17e06845-aa16-4ac8-bb3d-73c348429ec1" containerID="9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77" exitCode=0
Jul 16 00:26:28.377877 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.377886    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5944b858c8-84lxs"
Jul 16 00:26:28.378337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.377914    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5944b858c8-84lxs" event={"ID":"17e06845-aa16-4ac8-bb3d-73c348429ec1","Type":"ContainerDied","Data":"9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77"}
Jul 16 00:26:28.378337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.377954    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5944b858c8-84lxs" event={"ID":"17e06845-aa16-4ac8-bb3d-73c348429ec1","Type":"ContainerDied","Data":"3f47f5561d3bf2e3a86372e27795b1f4883480db9fca025555089dbea3a1f9ec"}
Jul 16 00:26:28.378337 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.377977    2556 scope.go:117] "RemoveContainer" containerID="9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77"
Jul 16 00:26:28.387139 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.387116    2556 scope.go:117] "RemoveContainer" containerID="9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77"
Jul 16 00:26:28.387453 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:28.387428    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77\": container with ID starting with 9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77 not found: ID does not exist" containerID="9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77"
Jul 16 00:26:28.387711 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.387467    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77"} err="failed to get container status \"9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77\": rpc error: code = NotFound desc = could not find container \"9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77\": container with ID starting with 9b22ba45e5f3046144500c3d69fe69a7f4f6250080a7e7210e45cbed283ecc77 not found: ID does not exist"
Jul 16 00:26:28.407686 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.407660    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5944b858c8-84lxs"]
Jul 16 00:26:28.437502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.437471    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5944b858c8-84lxs"]
Jul 16 00:26:28.971693 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:28.971660    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e06845-aa16-4ac8-bb3d-73c348429ec1" path="/var/lib/kubelet/pods/17e06845-aa16-4ac8-bb3d-73c348429ec1/volumes"
Jul 16 00:26:48.358275 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.358236    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"]
Jul 16 00:26:48.358724 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.358597    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e06845-aa16-4ac8-bb3d-73c348429ec1" containerName="manager"
Jul 16 00:26:48.358724 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.358625    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e06845-aa16-4ac8-bb3d-73c348429ec1" containerName="manager"
Jul 16 00:26:48.358724 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.358681    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e06845-aa16-4ac8-bb3d-73c348429ec1" containerName="manager"
Jul 16 00:26:48.367348 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.367320    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.376380 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:48.376337    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-59649fbb6d-slth6\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" podUID="473b5a97-e5cf-4db3-ae39-3054c80cd1ac" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.376508 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:48.376375    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-serving-cert\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" type="*v1.Secret"
Jul 16 00:26:48.376508 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:26:48.376442    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-dockercfg-n869x\" is forbidden: User \"system:node:ip-10-0-140-233.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-233.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n869x\"" type="*v1.Secret"
Jul 16 00:26:48.390543 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.390511    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"]
Jul 16 00:26:48.498329 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.498294    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-openshift-service-ca\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.498532 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.498371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-maas-api-tls\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.498532 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.498395    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9rmx\" (UniqueName: \"kubernetes.io/projected/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-kube-api-access-h9rmx\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.599737 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.599678    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-maas-api-tls\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.599737 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.599745    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9rmx\" (UniqueName: \"kubernetes.io/projected/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-kube-api-access-h9rmx\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.600021 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.599803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-openshift-service-ca\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.600464 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.600444    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-openshift-service-ca\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:48.627993 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:48.627920    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9rmx\" (UniqueName: \"kubernetes.io/projected/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-kube-api-access-h9rmx\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:49.462730 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.462705    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n869x\""
Jul 16 00:26:49.532354 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.532323    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"]
Jul 16 00:26:49.535094 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.535077    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.540894 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.540872    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-55tvl\""
Jul 16 00:26:49.543236 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.543216    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 00:26:49.569799 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.569772    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"]
Jul 16 00:26:49.594849 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.594816    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 00:26:49.603259 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.603233    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/473b5a97-e5cf-4db3-ae39-3054c80cd1ac-maas-api-tls\") pod \"maas-api-59649fbb6d-slth6\" (UID: \"473b5a97-e5cf-4db3-ae39-3054c80cd1ac\") " pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:49.629794 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.629766    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"]
Jul 16 00:26:49.632591 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.632573    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:49.662307 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.662276    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"]
Jul 16 00:26:49.707903 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.707873    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659481d0-bfb1-4d5c-b613-17d07bc31934-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-g74vt\" (UID: \"659481d0-bfb1-4d5c-b613-17d07bc31934\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.708063 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.707955    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8jkb\" (UniqueName: \"kubernetes.io/projected/659481d0-bfb1-4d5c-b613-17d07bc31934-kube-api-access-q8jkb\") pod \"payload-pre-processing-74584bb9f8-g74vt\" (UID: \"659481d0-bfb1-4d5c-b613-17d07bc31934\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.808965 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.808936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8jkb\" (UniqueName: \"kubernetes.io/projected/659481d0-bfb1-4d5c-b613-17d07bc31934-kube-api-access-q8jkb\") pod \"payload-pre-processing-74584bb9f8-g74vt\" (UID: \"659481d0-bfb1-4d5c-b613-17d07bc31934\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.809119 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.809001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw92t\" (UniqueName: \"kubernetes.io/projected/e9f83428-5342-4907-9660-e57f2e0acccc-kube-api-access-sw92t\") pod \"payload-processing-f9b8d9b9b-8w6kl\" (UID: \"e9f83428-5342-4907-9660-e57f2e0acccc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:49.809119 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.809032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659481d0-bfb1-4d5c-b613-17d07bc31934-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-g74vt\" (UID: \"659481d0-bfb1-4d5c-b613-17d07bc31934\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.809119 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.809056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f83428-5342-4907-9660-e57f2e0acccc-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8w6kl\" (UID: \"e9f83428-5342-4907-9660-e57f2e0acccc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:49.809794 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.809772    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659481d0-bfb1-4d5c-b613-17d07bc31934-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-g74vt\" (UID: \"659481d0-bfb1-4d5c-b613-17d07bc31934\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.820297 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.820270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8jkb\" (UniqueName: \"kubernetes.io/projected/659481d0-bfb1-4d5c-b613-17d07bc31934-kube-api-access-q8jkb\") pod \"payload-pre-processing-74584bb9f8-g74vt\" (UID: \"659481d0-bfb1-4d5c-b613-17d07bc31934\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.845265 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.845236    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:49.878050 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.878015    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:49.909889 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.909838    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw92t\" (UniqueName: \"kubernetes.io/projected/e9f83428-5342-4907-9660-e57f2e0acccc-kube-api-access-sw92t\") pod \"payload-processing-f9b8d9b9b-8w6kl\" (UID: \"e9f83428-5342-4907-9660-e57f2e0acccc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:49.910070 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.909895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f83428-5342-4907-9660-e57f2e0acccc-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8w6kl\" (UID: \"e9f83428-5342-4907-9660-e57f2e0acccc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:49.911293 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.911256    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f83428-5342-4907-9660-e57f2e0acccc-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8w6kl\" (UID: \"e9f83428-5342-4907-9660-e57f2e0acccc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:49.929843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.928636    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw92t\" (UniqueName: \"kubernetes.io/projected/e9f83428-5342-4907-9660-e57f2e0acccc-kube-api-access-sw92t\") pod \"payload-processing-f9b8d9b9b-8w6kl\" (UID: \"e9f83428-5342-4907-9660-e57f2e0acccc\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:49.945886 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:49.944153    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:50.029990 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:26:50.029860    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659481d0_bfb1_4d5c_b613_17d07bc31934.slice/crio-03c3f3b941f5610d4e25d99f99512ce14e5bdf0792b856280b7fbfdfe0008cf4 WatchSource:0}: Error finding container 03c3f3b941f5610d4e25d99f99512ce14e5bdf0792b856280b7fbfdfe0008cf4: Status 404 returned error can't find the container with id 03c3f3b941f5610d4e25d99f99512ce14e5bdf0792b856280b7fbfdfe0008cf4
Jul 16 00:26:50.036128 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:50.036102    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"]
Jul 16 00:26:50.091386 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:50.086329    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"]
Jul 16 00:26:50.144970 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:26:50.144940    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f83428_5342_4907_9660_e57f2e0acccc.slice/crio-ec643b97136de25771da0757a7831cfe294d75b70366568635dae1a436b54a15 WatchSource:0}: Error finding container ec643b97136de25771da0757a7831cfe294d75b70366568635dae1a436b54a15: Status 404 returned error can't find the container with id ec643b97136de25771da0757a7831cfe294d75b70366568635dae1a436b54a15
Jul 16 00:26:50.146912 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:50.146884    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"]
Jul 16 00:26:50.479734 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:50.479633    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt" event={"ID":"659481d0-bfb1-4d5c-b613-17d07bc31934","Type":"ContainerStarted","Data":"03c3f3b941f5610d4e25d99f99512ce14e5bdf0792b856280b7fbfdfe0008cf4"}
Jul 16 00:26:50.480770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:50.480743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6" event={"ID":"473b5a97-e5cf-4db3-ae39-3054c80cd1ac","Type":"ContainerStarted","Data":"5e0276543056f67978710a20e0972dac5273849ced37adf6f69aa626b179f637"}
Jul 16 00:26:50.481808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:50.481775    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl" event={"ID":"e9f83428-5342-4907-9660-e57f2e0acccc","Type":"ContainerStarted","Data":"ec643b97136de25771da0757a7831cfe294d75b70366568635dae1a436b54a15"}
Jul 16 00:26:52.493508 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.493469    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6" event={"ID":"473b5a97-e5cf-4db3-ae39-3054c80cd1ac","Type":"ContainerStarted","Data":"d2baf9d23e8acd5dafebcd2cca5d29dcb56f25cd59ae001c90894a05ceac603c"}
Jul 16 00:26:52.493980 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.493539    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:26:52.495198 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.495163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl" event={"ID":"e9f83428-5342-4907-9660-e57f2e0acccc","Type":"ContainerStarted","Data":"78a8d725d1c2584e7f44a2ca5edc30ca0677daed2e72cd3c648421630a6d5781"}
Jul 16 00:26:52.495328 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.495256    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:26:52.496707 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.496684    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt" event={"ID":"659481d0-bfb1-4d5c-b613-17d07bc31934","Type":"ContainerStarted","Data":"b91366348487853eafb0243d6dd01209415ad6d47ef640d2f276892ddfb5720b"}
Jul 16 00:26:52.496822 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.496790    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:26:52.513584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.513531    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6" podStartSLOduration=2.628141398 podStartE2EDuration="4.513515033s" totalImagesPullingTime="1.885373635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:52.511815994 +0000 UTC m=+818.083412307" watchObservedRunningTime="2026-07-16 00:26:52.513515033 +0000 UTC m=+818.085111334"
Jul 16 00:26:52.531589 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.531546    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt" podStartSLOduration=1.591726949 podStartE2EDuration="3.531529957s" totalImagesPullingTime="1.939803008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:52.530056931 +0000 UTC m=+818.101653238" watchObservedRunningTime="2026-07-16 00:26:52.531529957 +0000 UTC m=+818.103126284"
Jul 16 00:26:52.548699 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:52.548658    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl" podStartSLOduration=1.721220274 podStartE2EDuration="3.548644438s" totalImagesPullingTime="1.827424164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:52.546352374 +0000 UTC m=+818.117948676" watchObservedRunningTime="2026-07-16 00:26:52.548644438 +0000 UTC m=+818.120240738"
Jul 16 00:26:58.507843 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:26:58.507814    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59649fbb6d-slth6"
Jul 16 00:27:03.504317 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:03.504285    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-8w6kl"
Jul 16 00:27:03.504758 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:03.504454    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-g74vt"
Jul 16 00:27:06.453734 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.453703    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"]
Jul 16 00:27:06.460584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.460555    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.464784 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.464755    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 00:27:06.464928 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.464806    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p88nw\""
Jul 16 00:27:06.465571 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.465556    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 00:27:06.469557 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.469530    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 00:27:06.484084 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.484043    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"]
Jul 16 00:27:06.548753 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.548721    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.548936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.548782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995b8\" (UniqueName: \"kubernetes.io/projected/64afe769-4070-45dd-b0fb-9e62c5be958d-kube-api-access-995b8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.548936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.548822    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.548936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.548838    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64afe769-4070-45dd-b0fb-9e62c5be958d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.548936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.548855    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.548936 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.548904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649304 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649267    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649462 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995b8\" (UniqueName: \"kubernetes.io/projected/64afe769-4070-45dd-b0fb-9e62c5be958d-kube-api-access-995b8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649462 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649462 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649370    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64afe769-4070-45dd-b0fb-9e62c5be958d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649462 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649387    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649462 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649403    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649760    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.649885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.649855    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.651581 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.651556    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64afe769-4070-45dd-b0fb-9e62c5be958d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.652029 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.652009    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64afe769-4070-45dd-b0fb-9e62c5be958d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.659968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.659947    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-995b8\" (UniqueName: \"kubernetes.io/projected/64afe769-4070-45dd-b0fb-9e62c5be958d-kube-api-access-995b8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq\" (UID: \"64afe769-4070-45dd-b0fb-9e62c5be958d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.771712 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.771686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:06.933714 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:06.933685    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"]
Jul 16 00:27:06.936083 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:27:06.936051    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64afe769_4070_45dd_b0fb_9e62c5be958d.slice/crio-dfa75db5c7c2e9c6dae647ea8acfd805bb22b5b6de2d6ad1dfe75f9b397b77de WatchSource:0}: Error finding container dfa75db5c7c2e9c6dae647ea8acfd805bb22b5b6de2d6ad1dfe75f9b397b77de: Status 404 returned error can't find the container with id dfa75db5c7c2e9c6dae647ea8acfd805bb22b5b6de2d6ad1dfe75f9b397b77de
Jul 16 00:27:07.574747 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:07.574711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq" event={"ID":"64afe769-4070-45dd-b0fb-9e62c5be958d","Type":"ContainerStarted","Data":"dfa75db5c7c2e9c6dae647ea8acfd805bb22b5b6de2d6ad1dfe75f9b397b77de"}
Jul 16 00:27:08.581242 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:08.581209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq" event={"ID":"64afe769-4070-45dd-b0fb-9e62c5be958d","Type":"ContainerStarted","Data":"e8a3bbfda97e590f7734f8673fe6c102915ea4fe92cf41759ceb23cc4614c357"}
Jul 16 00:27:08.658557 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:08.658508    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq" podStartSLOduration=1.473639153 podStartE2EDuration="2.658490009s" totalImagesPullingTime="1.184850856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:27:08.657788379 +0000 UTC m=+834.229384680" watchObservedRunningTime="2026-07-16 00:27:08.658490009 +0000 UTC m=+834.230086310"
Jul 16 00:27:16.772542 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:16.772510    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:16.772962 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:16.772593    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:16.785142 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:16.785116    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:17.636895 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:17.636862    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq"
Jul 16 00:27:49.444410 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.444371    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"]
Jul 16 00:27:49.448115 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.448096    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.450729 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.450711    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 16 00:27:49.459739 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.459711    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"]
Jul 16 00:27:49.541534 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.541481    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmbm\" (UniqueName: \"kubernetes.io/projected/3c59caf3-5812-41f0-84b0-dbbf9912e00f-kube-api-access-czmbm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.541740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.541541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c59caf3-5812-41f0-84b0-dbbf9912e00f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.541740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.541584    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.541740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.541640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.541740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.541664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.541740 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.541685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.642898 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.642862    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbm\" (UniqueName: \"kubernetes.io/projected/3c59caf3-5812-41f0-84b0-dbbf9912e00f-kube-api-access-czmbm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643072 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.642912    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c59caf3-5812-41f0-84b0-dbbf9912e00f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643072 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.642936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643151 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.643057    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643151 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.643109    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643225 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.643147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643365 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.643346    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643430 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.643407    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.643553 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.643537    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.645494 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.645471    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c59caf3-5812-41f0-84b0-dbbf9912e00f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.646061 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.646042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c59caf3-5812-41f0-84b0-dbbf9912e00f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.651086 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.651046    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmbm\" (UniqueName: \"kubernetes.io/projected/3c59caf3-5812-41f0-84b0-dbbf9912e00f-kube-api-access-czmbm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6\" (UID: \"3c59caf3-5812-41f0-84b0-dbbf9912e00f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.758854 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.758768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:49.910023 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:49.909997    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"]
Jul 16 00:27:49.912311 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:27:49.912277    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c59caf3_5812_41f0_84b0_dbbf9912e00f.slice/crio-3467f14302acebf08be4df1d4d3d579dca14dfb7b954f23242c24c48c5d5b38a WatchSource:0}: Error finding container 3467f14302acebf08be4df1d4d3d579dca14dfb7b954f23242c24c48c5d5b38a: Status 404 returned error can't find the container with id 3467f14302acebf08be4df1d4d3d579dca14dfb7b954f23242c24c48c5d5b38a
Jul 16 00:27:50.787545 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:50.787505    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6" event={"ID":"3c59caf3-5812-41f0-84b0-dbbf9912e00f","Type":"ContainerStarted","Data":"cec261403d68faff580c2d2b6c9ec0af2b3bbc0cbc4f9f19574107e23bb3ee2a"}
Jul 16 00:27:50.787951 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:50.787573    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6" event={"ID":"3c59caf3-5812-41f0-84b0-dbbf9912e00f","Type":"ContainerStarted","Data":"3467f14302acebf08be4df1d4d3d579dca14dfb7b954f23242c24c48c5d5b38a"}
Jul 16 00:27:50.805504 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:50.805448    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6" podStartSLOduration=1.6385194360000002 podStartE2EDuration="1.805431101s" totalImagesPullingTime="166.911665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:27:50.803760698 +0000 UTC m=+876.375356981" watchObservedRunningTime="2026-07-16 00:27:50.805431101 +0000 UTC m=+876.377027405"
Jul 16 00:27:59.759360 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:59.759313    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:59.759881 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:59.759401    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:59.772099 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:59.772061    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:27:59.841394 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:27:59.841367    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6"
Jul 16 00:28:02.540651 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.540596    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"]
Jul 16 00:28:02.545129 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.545104    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.547636 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.547593    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 16 00:28:02.553021 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.552988    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"]
Jul 16 00:28:02.663348 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.663307    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.663517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.663377    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.663517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.663434    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.663517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.663458    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4132083-aad4-4c40-9565-12f171c22179-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.663517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.663477    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.663517 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.663504    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85cq\" (UniqueName: \"kubernetes.io/projected/c4132083-aad4-4c40-9565-12f171c22179-kube-api-access-s85cq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.764721 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.764684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.764885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.764758    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.764885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.764791    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.764885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.764807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4132083-aad4-4c40-9565-12f171c22179-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.764885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.764824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.765078 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.764918    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85cq\" (UniqueName: \"kubernetes.io/projected/c4132083-aad4-4c40-9565-12f171c22179-kube-api-access-s85cq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.765235 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.765205    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.765360 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.765241    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.765360 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.765264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.767143 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.767124    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4132083-aad4-4c40-9565-12f171c22179-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.767295 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.767277    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4132083-aad4-4c40-9565-12f171c22179-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.773381 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.773358    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85cq\" (UniqueName: \"kubernetes.io/projected/c4132083-aad4-4c40-9565-12f171c22179-kube-api-access-s85cq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7\" (UID: \"c4132083-aad4-4c40-9565-12f171c22179\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:02.876160 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:02.876046    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:03.030123 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:03.030096    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"]
Jul 16 00:28:03.032211 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:28:03.032174    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4132083_aad4_4c40_9565_12f171c22179.slice/crio-4ee704f90dba768f7634f693a4ae618d63cd9f4ee252f148c4fc4fb250e9286d WatchSource:0}: Error finding container 4ee704f90dba768f7634f693a4ae618d63cd9f4ee252f148c4fc4fb250e9286d: Status 404 returned error can't find the container with id 4ee704f90dba768f7634f693a4ae618d63cd9f4ee252f148c4fc4fb250e9286d
Jul 16 00:28:03.850967 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:03.850928    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7" event={"ID":"c4132083-aad4-4c40-9565-12f171c22179","Type":"ContainerStarted","Data":"eecbcb193d43f865364138b7a73cd93cd673a7bdd5bba8926cb8516a41d06b80"}
Jul 16 00:28:03.850967 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:03.850970    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7" event={"ID":"c4132083-aad4-4c40-9565-12f171c22179","Type":"ContainerStarted","Data":"4ee704f90dba768f7634f693a4ae618d63cd9f4ee252f148c4fc4fb250e9286d"}
Jul 16 00:28:03.871089 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:03.871025    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7" podStartSLOduration=1.674505264 podStartE2EDuration="1.871007158s" totalImagesPullingTime="196.501894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:28:03.868841157 +0000 UTC m=+889.440437481" watchObservedRunningTime="2026-07-16 00:28:03.871007158 +0000 UTC m=+889.442603459"
Jul 16 00:28:12.877316 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:12.877220    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:12.877316 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:12.877271    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:12.890506 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:12.890476    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:12.907208 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:12.907180    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7"
Jul 16 00:28:14.861237 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:14.861207    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:28:14.865031 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:28:14.865011    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:30:13.434310 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.434271    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c45676cbf-8q4mk"]
Jul 16 00:30:13.434958 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.434566    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c45676cbf-8q4mk" podUID="c2628183-9056-42a8-b6e3-e9dc02dee68d" containerName="manager" containerID="cri-o://fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c" gracePeriod=30
Jul 16 00:30:13.692274 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.692196    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:30:13.794069 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.794029    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2628183-9056-42a8-b6e3-e9dc02dee68d-webhook-cert\") pod \"c2628183-9056-42a8-b6e3-e9dc02dee68d\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") "
Jul 16 00:30:13.794271 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.794147    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8kn9\" (UniqueName: \"kubernetes.io/projected/c2628183-9056-42a8-b6e3-e9dc02dee68d-kube-api-access-z8kn9\") pod \"c2628183-9056-42a8-b6e3-e9dc02dee68d\" (UID: \"c2628183-9056-42a8-b6e3-e9dc02dee68d\") "
Jul 16 00:30:13.796398 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.796360    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2628183-9056-42a8-b6e3-e9dc02dee68d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c2628183-9056-42a8-b6e3-e9dc02dee68d" (UID: "c2628183-9056-42a8-b6e3-e9dc02dee68d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:30:13.796527 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.796462    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2628183-9056-42a8-b6e3-e9dc02dee68d-kube-api-access-z8kn9" (OuterVolumeSpecName: "kube-api-access-z8kn9") pod "c2628183-9056-42a8-b6e3-e9dc02dee68d" (UID: "c2628183-9056-42a8-b6e3-e9dc02dee68d"). InnerVolumeSpecName "kube-api-access-z8kn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:30:13.895007 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.894963    2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2628183-9056-42a8-b6e3-e9dc02dee68d-webhook-cert\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:30:13.895007 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:13.894998    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8kn9\" (UniqueName: \"kubernetes.io/projected/c2628183-9056-42a8-b6e3-e9dc02dee68d-kube-api-access-z8kn9\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:30:14.496038 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.495951    2556 generic.go:356] "Generic (PLEG): container finished" podID="c2628183-9056-42a8-b6e3-e9dc02dee68d" containerID="fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c" exitCode=0
Jul 16 00:30:14.496038 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.495992    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45676cbf-8q4mk"
Jul 16 00:30:14.496513 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.496033    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45676cbf-8q4mk" event={"ID":"c2628183-9056-42a8-b6e3-e9dc02dee68d","Type":"ContainerDied","Data":"fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c"}
Jul 16 00:30:14.496513 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.496084    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45676cbf-8q4mk" event={"ID":"c2628183-9056-42a8-b6e3-e9dc02dee68d","Type":"ContainerDied","Data":"4b3c14970b06d7fa2b7276631c5e272b5427805252011501a7ab0795955e4543"}
Jul 16 00:30:14.496513 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.496109    2556 scope.go:117] "RemoveContainer" containerID="fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c"
Jul 16 00:30:14.505501 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.505477    2556 scope.go:117] "RemoveContainer" containerID="fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c"
Jul 16 00:30:14.505844 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:30:14.505824    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c\": container with ID starting with fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c not found: ID does not exist" containerID="fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c"
Jul 16 00:30:14.505913 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.505854    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c"} err="failed to get container status \"fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c\": rpc error: code = NotFound desc = could not find container \"fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c\": container with ID starting with fe112c59c559491910465187ce116223fa21f68865679d204cb13f2f6724915c not found: ID does not exist"
Jul 16 00:30:14.518393 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.518352    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c45676cbf-8q4mk"]
Jul 16 00:30:14.523222 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.523190    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c45676cbf-8q4mk"]
Jul 16 00:30:14.972064 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:14.972029    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2628183-9056-42a8-b6e3-e9dc02dee68d" path="/var/lib/kubelet/pods/c2628183-9056-42a8-b6e3-e9dc02dee68d/volumes"
Jul 16 00:30:15.312691 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.312662    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c45676cbf-42wd6"]
Jul 16 00:30:15.313049 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.313037    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2628183-9056-42a8-b6e3-e9dc02dee68d" containerName="manager"
Jul 16 00:30:15.313099 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.313051    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2628183-9056-42a8-b6e3-e9dc02dee68d" containerName="manager"
Jul 16 00:30:15.313130 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.313116    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2628183-9056-42a8-b6e3-e9dc02dee68d" containerName="manager"
Jul 16 00:30:15.322599 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.322568    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.325904 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.325874    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 00:30:15.326055 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.325903    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j28lc\""
Jul 16 00:30:15.326055 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.325918    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 00:30:15.327507 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.327487    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c45676cbf-42wd6"]
Jul 16 00:30:15.410034 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.409989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/487ecbf3-4b7a-4bd4-beca-f96b7570157f-webhook-cert\") pod \"maas-controller-7c45676cbf-42wd6\" (UID: \"487ecbf3-4b7a-4bd4-beca-f96b7570157f\") " pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.410210 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.410113    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7shb\" (UniqueName: \"kubernetes.io/projected/487ecbf3-4b7a-4bd4-beca-f96b7570157f-kube-api-access-g7shb\") pod \"maas-controller-7c45676cbf-42wd6\" (UID: \"487ecbf3-4b7a-4bd4-beca-f96b7570157f\") " pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.511097 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.511060    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/487ecbf3-4b7a-4bd4-beca-f96b7570157f-webhook-cert\") pod \"maas-controller-7c45676cbf-42wd6\" (UID: \"487ecbf3-4b7a-4bd4-beca-f96b7570157f\") " pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.511507 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.511149    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7shb\" (UniqueName: \"kubernetes.io/projected/487ecbf3-4b7a-4bd4-beca-f96b7570157f-kube-api-access-g7shb\") pod \"maas-controller-7c45676cbf-42wd6\" (UID: \"487ecbf3-4b7a-4bd4-beca-f96b7570157f\") " pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.513621 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.513584    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/487ecbf3-4b7a-4bd4-beca-f96b7570157f-webhook-cert\") pod \"maas-controller-7c45676cbf-42wd6\" (UID: \"487ecbf3-4b7a-4bd4-beca-f96b7570157f\") " pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.520395 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.520371    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7shb\" (UniqueName: \"kubernetes.io/projected/487ecbf3-4b7a-4bd4-beca-f96b7570157f-kube-api-access-g7shb\") pod \"maas-controller-7c45676cbf-42wd6\" (UID: \"487ecbf3-4b7a-4bd4-beca-f96b7570157f\") " pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.634535 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.634431    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:15.776250 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.776220    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c45676cbf-42wd6"]
Jul 16 00:30:15.778837 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:30:15.778808    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487ecbf3_4b7a_4bd4_beca_f96b7570157f.slice/crio-61a83c14fdab2c33673b0709b057cbfd337342e000b81d0aaece48fb4fa1aa78 WatchSource:0}: Error finding container 61a83c14fdab2c33673b0709b057cbfd337342e000b81d0aaece48fb4fa1aa78: Status 404 returned error can't find the container with id 61a83c14fdab2c33673b0709b057cbfd337342e000b81d0aaece48fb4fa1aa78
Jul 16 00:30:15.780555 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:15.780536    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:30:16.507708 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:16.507575    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45676cbf-42wd6" event={"ID":"487ecbf3-4b7a-4bd4-beca-f96b7570157f","Type":"ContainerStarted","Data":"f4e6a60e0c8eafa5f56e42e83f0a907e8f2ac7b930c925b89dc48e17a67e57d1"}
Jul 16 00:30:16.507708 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:16.507656    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c45676cbf-42wd6" event={"ID":"487ecbf3-4b7a-4bd4-beca-f96b7570157f","Type":"ContainerStarted","Data":"61a83c14fdab2c33673b0709b057cbfd337342e000b81d0aaece48fb4fa1aa78"}
Jul 16 00:30:16.507931 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:16.507726    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:30:16.528971 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:16.528918    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c45676cbf-42wd6" podStartSLOduration=1.085138611 podStartE2EDuration="1.528903441s" totalImagesPullingTime="443.76483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:30:16.527622682 +0000 UTC m=+1022.099218980" watchObservedRunningTime="2026-07-16 00:30:16.528903441 +0000 UTC m=+1022.100499791"
Jul 16 00:30:27.515160 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:30:27.515130    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c45676cbf-42wd6"
Jul 16 00:33:14.892638 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:33:14.892588    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:33:14.895386 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:33:14.895364    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:35:10.480756 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:10.480720    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"]
Jul 16 00:35:10.483242 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:10.480939    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8" podUID="df51ed1d-9236-404a-8310-a439fc4ab99d" containerName="manager" containerID="cri-o://cdc492bcaed725b54e3abe840a018eb3230429bcaaa9d2ca68da15726941f1a2" gracePeriod=10
Jul 16 00:35:14.991713 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:14.991599    2556 generic.go:356] "Generic (PLEG): container finished" podID="df51ed1d-9236-404a-8310-a439fc4ab99d" containerID="cdc492bcaed725b54e3abe840a018eb3230429bcaaa9d2ca68da15726941f1a2" exitCode=0
Jul 16 00:35:14.991713 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:14.991676    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8" event={"ID":"df51ed1d-9236-404a-8310-a439fc4ab99d","Type":"ContainerDied","Data":"cdc492bcaed725b54e3abe840a018eb3230429bcaaa9d2ca68da15726941f1a2"}
Jul 16 00:35:15.334979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:15.334953    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:35:15.420079 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:15.420050    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksx48\" (UniqueName: \"kubernetes.io/projected/df51ed1d-9236-404a-8310-a439fc4ab99d-kube-api-access-ksx48\") pod \"df51ed1d-9236-404a-8310-a439fc4ab99d\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") "
Jul 16 00:35:15.420235 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:15.420103    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df51ed1d-9236-404a-8310-a439fc4ab99d-extensions-socket-volume\") pod \"df51ed1d-9236-404a-8310-a439fc4ab99d\" (UID: \"df51ed1d-9236-404a-8310-a439fc4ab99d\") "
Jul 16 00:35:15.420460 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:15.420436    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df51ed1d-9236-404a-8310-a439fc4ab99d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "df51ed1d-9236-404a-8310-a439fc4ab99d" (UID: "df51ed1d-9236-404a-8310-a439fc4ab99d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:35:15.422257 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:15.422233    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df51ed1d-9236-404a-8310-a439fc4ab99d-kube-api-access-ksx48" (OuterVolumeSpecName: "kube-api-access-ksx48") pod "df51ed1d-9236-404a-8310-a439fc4ab99d" (UID: "df51ed1d-9236-404a-8310-a439fc4ab99d"). InnerVolumeSpecName "kube-api-access-ksx48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:35:15.520940 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:15.520906    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksx48\" (UniqueName: \"kubernetes.io/projected/df51ed1d-9236-404a-8310-a439fc4ab99d-kube-api-access-ksx48\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:35:15.520940 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:15.520940    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df51ed1d-9236-404a-8310-a439fc4ab99d-extensions-socket-volume\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:35:16.001133 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:16.001040    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"
Jul 16 00:35:16.001133 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:16.001078    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8" event={"ID":"df51ed1d-9236-404a-8310-a439fc4ab99d","Type":"ContainerDied","Data":"dd405bc7a867199a424fcdea5c9134f3d8d307ca52c7b57bf01fa73d62c1e62c"}
Jul 16 00:35:16.001682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:16.001142    2556 scope.go:117] "RemoveContainer" containerID="cdc492bcaed725b54e3abe840a018eb3230429bcaaa9d2ca68da15726941f1a2"
Jul 16 00:35:16.041259 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:16.041226    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"]
Jul 16 00:35:16.054814 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:16.054781    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vv8s8"]
Jul 16 00:35:16.971544 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:35:16.971509    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df51ed1d-9236-404a-8310-a439fc4ab99d" path="/var/lib/kubelet/pods/df51ed1d-9236-404a-8310-a439fc4ab99d/volumes"
Jul 16 00:36:11.574398 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.574360    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"]
Jul 16 00:36:11.575127 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.574819    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df51ed1d-9236-404a-8310-a439fc4ab99d" containerName="manager"
Jul 16 00:36:11.575127 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.574833    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="df51ed1d-9236-404a-8310-a439fc4ab99d" containerName="manager"
Jul 16 00:36:11.575127 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.574893    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="df51ed1d-9236-404a-8310-a439fc4ab99d" containerName="manager"
Jul 16 00:36:11.577912 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.577891    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:11.580766 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.580742    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h558g\""
Jul 16 00:36:11.593844 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.593811    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"]
Jul 16 00:36:11.738793 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.738749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f74cfe-2064-4f42-b6c5-b8d92322b79f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9rrd6\" (UID: \"54f74cfe-2064-4f42-b6c5-b8d92322b79f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:11.738793 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.738793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhgm7\" (UniqueName: \"kubernetes.io/projected/54f74cfe-2064-4f42-b6c5-b8d92322b79f-kube-api-access-nhgm7\") pod \"kuadrant-operator-controller-manager-86878c769f-9rrd6\" (UID: \"54f74cfe-2064-4f42-b6c5-b8d92322b79f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:11.839905 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.839778    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f74cfe-2064-4f42-b6c5-b8d92322b79f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9rrd6\" (UID: \"54f74cfe-2064-4f42-b6c5-b8d92322b79f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:11.839905 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.839871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgm7\" (UniqueName: \"kubernetes.io/projected/54f74cfe-2064-4f42-b6c5-b8d92322b79f-kube-api-access-nhgm7\") pod \"kuadrant-operator-controller-manager-86878c769f-9rrd6\" (UID: \"54f74cfe-2064-4f42-b6c5-b8d92322b79f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:11.840298 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.840276    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f74cfe-2064-4f42-b6c5-b8d92322b79f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9rrd6\" (UID: \"54f74cfe-2064-4f42-b6c5-b8d92322b79f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:11.849572 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.849532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhgm7\" (UniqueName: \"kubernetes.io/projected/54f74cfe-2064-4f42-b6c5-b8d92322b79f-kube-api-access-nhgm7\") pod \"kuadrant-operator-controller-manager-86878c769f-9rrd6\" (UID: \"54f74cfe-2064-4f42-b6c5-b8d92322b79f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:11.888651 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:11.888582    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:12.053280 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:12.053254    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"]
Jul 16 00:36:12.055249 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:36:12.055216    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f74cfe_2064_4f42_b6c5_b8d92322b79f.slice/crio-ab723a61af797211eebc7b78a96948c9fb50b74fe3c2bfb2400bbc89a2a4411d WatchSource:0}: Error finding container ab723a61af797211eebc7b78a96948c9fb50b74fe3c2bfb2400bbc89a2a4411d: Status 404 returned error can't find the container with id ab723a61af797211eebc7b78a96948c9fb50b74fe3c2bfb2400bbc89a2a4411d
Jul 16 00:36:12.276377 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:12.276331    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6" event={"ID":"54f74cfe-2064-4f42-b6c5-b8d92322b79f","Type":"ContainerStarted","Data":"5e89b0eb309168da1c89127e0c29f139fa0a6862b62830d7bab40a67567a69c6"}
Jul 16 00:36:12.276584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:12.276390    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6" event={"ID":"54f74cfe-2064-4f42-b6c5-b8d92322b79f","Type":"ContainerStarted","Data":"ab723a61af797211eebc7b78a96948c9fb50b74fe3c2bfb2400bbc89a2a4411d"}
Jul 16 00:36:12.276584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:12.276460    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:36:12.317991 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:12.317940    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6" podStartSLOduration=1.317920556 podStartE2EDuration="1.317920556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:36:12.315719198 +0000 UTC m=+1377.887315499" watchObservedRunningTime="2026-07-16 00:36:12.317920556 +0000 UTC m=+1377.889516857"
Jul 16 00:36:23.284478 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:36:23.284440    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9rrd6"
Jul 16 00:38:14.921525 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:38:14.921497    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:38:14.924808 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:38:14.924785    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:42:40.791680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:40.791641    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"]
Jul 16 00:42:40.795156 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:40.795138    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:40.799037 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:40.799003    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b9cb77e6-serving-cert\""
Jul 16 00:42:40.826073 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:40.826044    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"]
Jul 16 00:42:40.933538 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:40.933498    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5f69\" (UniqueName: \"kubernetes.io/projected/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-kube-api-access-h5f69\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:40.933715 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:40.933588    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-maas-api-tls\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:40.933715 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:40.933653    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-openshift-service-ca\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.034764 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.034735    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5f69\" (UniqueName: \"kubernetes.io/projected/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-kube-api-access-h5f69\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.034978 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.034840    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-maas-api-tls\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.034978 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.034896    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-openshift-service-ca\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.035750 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.035721    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-openshift-service-ca\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.038061 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.038039    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-maas-api-tls\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.052931 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.052851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5f69\" (UniqueName: \"kubernetes.io/projected/e4ac4ff6-1ef9-4051-8f06-c2cacd666aff-kube-api-access-h5f69\") pod \"maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx\" (UID: \"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.105759 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.105724    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:41.261172 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.261141    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"]
Jul 16 00:42:41.265416 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:42:41.265383    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ac4ff6_1ef9_4051_8f06_c2cacd666aff.slice/crio-fea8fa44e0e45a15483633e84d6b5765312907bf7b86c9d2d6e1ee247abd0e5d WatchSource:0}: Error finding container fea8fa44e0e45a15483633e84d6b5765312907bf7b86c9d2d6e1ee247abd0e5d: Status 404 returned error can't find the container with id fea8fa44e0e45a15483633e84d6b5765312907bf7b86c9d2d6e1ee247abd0e5d
Jul 16 00:42:41.267227 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:41.267210    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:42:42.239301 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:42.239263    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx" event={"ID":"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff","Type":"ContainerStarted","Data":"dfadc92fb729bef4b05ee5e46f544e6fae091a1f71416bcfda28421861a12c14"}
Jul 16 00:42:42.239768 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:42.239314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx" event={"ID":"e4ac4ff6-1ef9-4051-8f06-c2cacd666aff","Type":"ContainerStarted","Data":"fea8fa44e0e45a15483633e84d6b5765312907bf7b86c9d2d6e1ee247abd0e5d"}
Jul 16 00:42:42.239768 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:42.239422    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:42.286145 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:42.286078    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx" podStartSLOduration=1.8109207139999999 podStartE2EDuration="2.286052776s" totalImagesPullingTime="475.132062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:42:42.283201145 +0000 UTC m=+1767.854797447" watchObservedRunningTime="2026-07-16 00:42:42.286052776 +0000 UTC m=+1767.857649078"
Jul 16 00:42:48.250790 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:48.250760    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx"
Jul 16 00:42:54.061458 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.061419    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"]
Jul 16 00:42:54.065181 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.065156    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.068130 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.068095    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-4b7f7df8-serving-cert\""
Jul 16 00:42:54.083365 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.083331    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"]
Jul 16 00:42:54.168130 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.168096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-openshift-service-ca\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.168130 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.168133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-maas-api-tls\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.168348 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.168224    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqmbs\" (UniqueName: \"kubernetes.io/projected/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-kube-api-access-fqmbs\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.269070 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.269034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-openshift-service-ca\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.269070 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.269075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-maas-api-tls\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.269281 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.269141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqmbs\" (UniqueName: \"kubernetes.io/projected/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-kube-api-access-fqmbs\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.269281 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:42:54.269266    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-serving-cert: secret "maas-api-e2e-migrate-4b7f7df8-serving-cert" not found
Jul 16 00:42:54.269355 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:42:54.269328    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-maas-api-tls podName:b2d24201-a63a-45c0-8bc7-d9ec1a506ab4 nodeName:}" failed. No retries permitted until 2026-07-16 00:42:54.769312437 +0000 UTC m=+1780.340908715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-maas-api-tls") pod "maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278" (UID: "b2d24201-a63a-45c0-8bc7-d9ec1a506ab4") : secret "maas-api-e2e-migrate-4b7f7df8-serving-cert" not found
Jul 16 00:42:54.269835 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.269818    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-openshift-service-ca\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.284940 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.284909    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqmbs\" (UniqueName: \"kubernetes.io/projected/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-kube-api-access-fqmbs\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.772681 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.772643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-maas-api-tls\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.775355 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.775320    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2d24201-a63a-45c0-8bc7-d9ec1a506ab4-maas-api-tls\") pod \"maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278\" (UID: \"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:54.977837 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:54.977794    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:55.129749 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:55.129725    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"]
Jul 16 00:42:55.131813 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:42:55.131784    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d24201_a63a_45c0_8bc7_d9ec1a506ab4.slice/crio-be68d538e0ba4ee11c8a51ccb61cfd6ef4386f04d5cf071dde93272ba55310f8 WatchSource:0}: Error finding container be68d538e0ba4ee11c8a51ccb61cfd6ef4386f04d5cf071dde93272ba55310f8: Status 404 returned error can't find the container with id be68d538e0ba4ee11c8a51ccb61cfd6ef4386f04d5cf071dde93272ba55310f8
Jul 16 00:42:55.312981 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:55.312880    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278" event={"ID":"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4","Type":"ContainerStarted","Data":"be68d538e0ba4ee11c8a51ccb61cfd6ef4386f04d5cf071dde93272ba55310f8"}
Jul 16 00:42:56.319960 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:56.319923    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278" event={"ID":"b2d24201-a63a-45c0-8bc7-d9ec1a506ab4","Type":"ContainerStarted","Data":"94c49665dabaa847c87135c7632843bc767abcdb919529eef5ff51184615bf70"}
Jul 16 00:42:56.320322 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:56.320002    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:42:56.345056 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:42:56.345014    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278" podStartSLOduration=2.024523617 podStartE2EDuration="2.34499919s" totalImagesPullingTime="320.475573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:42:56.343855779 +0000 UTC m=+1781.915452080" watchObservedRunningTime="2026-07-16 00:42:56.34499919 +0000 UTC m=+1781.916595492"
Jul 16 00:43:02.330461 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:02.330430    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278"
Jul 16 00:43:06.460371 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.460284    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"]
Jul 16 00:43:06.464395 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.464369    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.466967 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.466939    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0aafd8c9-serving-cert\""
Jul 16 00:43:06.478219 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.478189    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717a32d5-13e2-4996-adff-f118a614b987-openshift-service-ca\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.478377 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.478254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82fdr\" (UniqueName: \"kubernetes.io/projected/717a32d5-13e2-4996-adff-f118a614b987-kube-api-access-82fdr\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.478377 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.478297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717a32d5-13e2-4996-adff-f118a614b987-maas-api-tls\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.483750 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.483716    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"]
Jul 16 00:43:06.579266 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.579237    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82fdr\" (UniqueName: \"kubernetes.io/projected/717a32d5-13e2-4996-adff-f118a614b987-kube-api-access-82fdr\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.579452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.579276    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717a32d5-13e2-4996-adff-f118a614b987-maas-api-tls\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.579452 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.579340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717a32d5-13e2-4996-adff-f118a614b987-openshift-service-ca\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.579583 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:43:06.579475    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-serving-cert: secret "maas-api-e2e-derive-0aafd8c9-serving-cert" not found
Jul 16 00:43:06.579583 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:43:06.579553    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/717a32d5-13e2-4996-adff-f118a614b987-maas-api-tls podName:717a32d5-13e2-4996-adff-f118a614b987 nodeName:}" failed. No retries permitted until 2026-07-16 00:43:07.079534427 +0000 UTC m=+1792.651130709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/717a32d5-13e2-4996-adff-f118a614b987-maas-api-tls") pod "maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg" (UID: "717a32d5-13e2-4996-adff-f118a614b987") : secret "maas-api-e2e-derive-0aafd8c9-serving-cert" not found
Jul 16 00:43:06.580002 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.579985    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/717a32d5-13e2-4996-adff-f118a614b987-openshift-service-ca\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:06.591944 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:06.591919    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82fdr\" (UniqueName: \"kubernetes.io/projected/717a32d5-13e2-4996-adff-f118a614b987-kube-api-access-82fdr\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:07.085116 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:07.085076    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717a32d5-13e2-4996-adff-f118a614b987-maas-api-tls\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:07.087951 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:07.087919    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/717a32d5-13e2-4996-adff-f118a614b987-maas-api-tls\") pod \"maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg\" (UID: \"717a32d5-13e2-4996-adff-f118a614b987\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:07.375483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:07.375382    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:07.533158 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:07.533119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"]
Jul 16 00:43:07.535701 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:43:07.535668    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717a32d5_13e2_4996_adff_f118a614b987.slice/crio-060bf1820e01401a3828e5412e12e49b8c4f715e0eea81213c5307f9ebf06fe2 WatchSource:0}: Error finding container 060bf1820e01401a3828e5412e12e49b8c4f715e0eea81213c5307f9ebf06fe2: Status 404 returned error can't find the container with id 060bf1820e01401a3828e5412e12e49b8c4f715e0eea81213c5307f9ebf06fe2
Jul 16 00:43:08.381375 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:08.381331    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg" event={"ID":"717a32d5-13e2-4996-adff-f118a614b987","Type":"ContainerStarted","Data":"d6fdd19060015c7cbbd119153ddf5ff5668ddf27369678eed2d50a4ac79120ec"}
Jul 16 00:43:08.381569 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:08.381401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg" event={"ID":"717a32d5-13e2-4996-adff-f118a614b987","Type":"ContainerStarted","Data":"060bf1820e01401a3828e5412e12e49b8c4f715e0eea81213c5307f9ebf06fe2"}
Jul 16 00:43:08.381569 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:08.381463    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:08.404309 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:08.404256    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg" podStartSLOduration=2.061771296 podStartE2EDuration="2.40423865s" totalImagesPullingTime="342.467354ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:43:08.401814327 +0000 UTC m=+1793.973410642" watchObservedRunningTime="2026-07-16 00:43:08.40423865 +0000 UTC m=+1793.975834952"
Jul 16 00:43:14.391996 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:14.391960    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg"
Jul 16 00:43:14.954261 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:14.954232    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:43:14.958049 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:43:14.958014    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:44:58.900890 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:58.900853    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"]
Jul 16 00:44:58.904636 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:58.904583    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:58.908497 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:58.908469    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-19434bf7-serving-cert\""
Jul 16 00:44:58.927582 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:58.927541    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"]
Jul 16 00:44:59.063896 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.063852    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef900290-637c-4b8f-92bb-abc5047aada0-maas-api-tls\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.064087 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.063908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klzjw\" (UniqueName: \"kubernetes.io/projected/ef900290-637c-4b8f-92bb-abc5047aada0-kube-api-access-klzjw\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.064087 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.064030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef900290-637c-4b8f-92bb-abc5047aada0-openshift-service-ca\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.165209 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.165127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef900290-637c-4b8f-92bb-abc5047aada0-maas-api-tls\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.165209 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.165167    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klzjw\" (UniqueName: \"kubernetes.io/projected/ef900290-637c-4b8f-92bb-abc5047aada0-kube-api-access-klzjw\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.165209 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.165206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef900290-637c-4b8f-92bb-abc5047aada0-openshift-service-ca\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.165468 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:44:59.165284    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-serving-cert: secret "maas-api-e2e-mt-19434bf7-serving-cert" not found
Jul 16 00:44:59.165468 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:44:59.165357    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef900290-637c-4b8f-92bb-abc5047aada0-maas-api-tls podName:ef900290-637c-4b8f-92bb-abc5047aada0 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:59.665340742 +0000 UTC m=+1905.236937025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef900290-637c-4b8f-92bb-abc5047aada0-maas-api-tls") pod "maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh" (UID: "ef900290-637c-4b8f-92bb-abc5047aada0") : secret "maas-api-e2e-mt-19434bf7-serving-cert" not found
Jul 16 00:44:59.165784 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.165768    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef900290-637c-4b8f-92bb-abc5047aada0-openshift-service-ca\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.178923 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.178898    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klzjw\" (UniqueName: \"kubernetes.io/projected/ef900290-637c-4b8f-92bb-abc5047aada0-kube-api-access-klzjw\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.669503 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.669466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef900290-637c-4b8f-92bb-abc5047aada0-maas-api-tls\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.672117 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.672093    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef900290-637c-4b8f-92bb-abc5047aada0-maas-api-tls\") pod \"maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh\" (UID: \"ef900290-637c-4b8f-92bb-abc5047aada0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.816905 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.816879    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:44:59.969769 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:44:59.969742    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"]
Jul 16 00:44:59.970106 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:44:59.969758    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef900290_637c_4b8f_92bb_abc5047aada0.slice/crio-8af0f9aed3758ffa7a90c4cc0a17936d56c460faad1987c531bbfda8a192cc01 WatchSource:0}: Error finding container 8af0f9aed3758ffa7a90c4cc0a17936d56c460faad1987c531bbfda8a192cc01: Status 404 returned error can't find the container with id 8af0f9aed3758ffa7a90c4cc0a17936d56c460faad1987c531bbfda8a192cc01
Jul 16 00:45:00.935728 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:45:00.935684    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh" event={"ID":"ef900290-637c-4b8f-92bb-abc5047aada0","Type":"ContainerStarted","Data":"2e5d48f46b8c79a299ca601e778c7dd70a7ee5fdf07a4d9e4378967fc54631b2"}
Jul 16 00:45:00.935939 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:45:00.935745    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh" event={"ID":"ef900290-637c-4b8f-92bb-abc5047aada0","Type":"ContainerStarted","Data":"8af0f9aed3758ffa7a90c4cc0a17936d56c460faad1987c531bbfda8a192cc01"}
Jul 16 00:45:00.935939 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:45:00.935772    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:45:06.945882 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:45:06.945856    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh"
Jul 16 00:45:06.977569 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:45:06.977525    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh" podStartSLOduration=8.638078992 podStartE2EDuration="8.977509085s" totalImagesPullingTime="339.430093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:00.959104783 +0000 UTC m=+1906.530701084" watchObservedRunningTime="2026-07-16 00:45:06.977509085 +0000 UTC m=+1912.549105385"
Jul 16 00:46:45.430875 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.430837    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"]
Jul 16 00:46:45.434404 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.434381    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.437363 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.437339    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-eeb61d-serving-cert\""
Jul 16 00:46:45.446770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.446743    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"]
Jul 16 00:46:45.480163 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.480135    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd722b2-3e77-4c86-bc62-2e916f9b758c-maas-api-tls\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.480325 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.480174    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd722b2-3e77-4c86-bc62-2e916f9b758c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.480325 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.480199    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtzpq\" (UniqueName: \"kubernetes.io/projected/edd722b2-3e77-4c86-bc62-2e916f9b758c-kube-api-access-rtzpq\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.581416 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.581381    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd722b2-3e77-4c86-bc62-2e916f9b758c-maas-api-tls\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.581592 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.581437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd722b2-3e77-4c86-bc62-2e916f9b758c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.581592 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.581472    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtzpq\" (UniqueName: \"kubernetes.io/projected/edd722b2-3e77-4c86-bc62-2e916f9b758c-kube-api-access-rtzpq\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.581592 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:46:45.581554    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-serving-cert: secret "maas-api-e2e-inf-b-eeb61d-serving-cert" not found
Jul 16 00:46:45.581748 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:46:45.581657    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd722b2-3e77-4c86-bc62-2e916f9b758c-maas-api-tls podName:edd722b2-3e77-4c86-bc62-2e916f9b758c nodeName:}" failed. No retries permitted until 2026-07-16 00:46:46.081634803 +0000 UTC m=+2011.653231099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edd722b2-3e77-4c86-bc62-2e916f9b758c-maas-api-tls") pod "maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5" (UID: "edd722b2-3e77-4c86-bc62-2e916f9b758c") : secret "maas-api-e2e-inf-b-eeb61d-serving-cert" not found
Jul 16 00:46:45.582136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.582117    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd722b2-3e77-4c86-bc62-2e916f9b758c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:45.598099 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:45.598069    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtzpq\" (UniqueName: \"kubernetes.io/projected/edd722b2-3e77-4c86-bc62-2e916f9b758c-kube-api-access-rtzpq\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:46.092968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:46.092916    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd722b2-3e77-4c86-bc62-2e916f9b758c-maas-api-tls\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:46.096209 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:46.096175    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd722b2-3e77-4c86-bc62-2e916f9b758c-maas-api-tls\") pod \"maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5\" (UID: \"edd722b2-3e77-4c86-bc62-2e916f9b758c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:46.345494 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:46.345401    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:46.504316 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:46.504286    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"]
Jul 16 00:46:46.507082 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:46:46.507051    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd722b2_3e77_4c86_bc62_2e916f9b758c.slice/crio-7840a4ac699532209b7030d62a9ac4c8d30cf89c7de3b4489919d53ea27e4dc3 WatchSource:0}: Error finding container 7840a4ac699532209b7030d62a9ac4c8d30cf89c7de3b4489919d53ea27e4dc3: Status 404 returned error can't find the container with id 7840a4ac699532209b7030d62a9ac4c8d30cf89c7de3b4489919d53ea27e4dc3
Jul 16 00:46:47.478684 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:47.478642    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5" event={"ID":"edd722b2-3e77-4c86-bc62-2e916f9b758c","Type":"ContainerStarted","Data":"63bb8f52158ad5de78e9e24f38c35456bbe12e674158a944de011e0f6d5d8bc1"}
Jul 16 00:46:47.478909 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:47.478709    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5" event={"ID":"edd722b2-3e77-4c86-bc62-2e916f9b758c","Type":"ContainerStarted","Data":"7840a4ac699532209b7030d62a9ac4c8d30cf89c7de3b4489919d53ea27e4dc3"}
Jul 16 00:46:47.478909 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:47.478878    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:46:47.509139 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:47.509072    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5" podStartSLOduration=2.129376648 podStartE2EDuration="2.509050923s" totalImagesPullingTime="379.674275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:46:47.508420288 +0000 UTC m=+2013.080016588" watchObservedRunningTime="2026-07-16 00:46:47.509050923 +0000 UTC m=+2013.080647227"
Jul 16 00:46:53.489118 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:46:53.489088    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5"
Jul 16 00:47:03.746232 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.746190    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"]
Jul 16 00:47:03.750134 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.750110    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.752810 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.752793    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a70600\"/\"kube-root-ca.crt\""
Jul 16 00:47:03.754674 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.754658    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a70600\"/\"default-dockercfg-hb2gm\""
Jul 16 00:47:03.754674 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.754669    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a70600\"/\"openshift-service-ca.crt\""
Jul 16 00:47:03.754794 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.754742    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a70600\"/\"test-model-a70600-kserve-self-signed-certs\""
Jul 16 00:47:03.775108 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.775079    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"]
Jul 16 00:47:03.866010 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.865966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-home\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.866010 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.866010    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tmp-dir\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.866227 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.866048    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-dshm\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.866227 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.866128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-model-cache\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.866227 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.866190    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxflw\" (UniqueName: \"kubernetes.io/projected/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-kube-api-access-qxflw\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.866324 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.866277    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tls-certs\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967185 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967146    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tmp-dir\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967387 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-dshm\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967387 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-model-cache\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967387 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967256    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxflw\" (UniqueName: \"kubernetes.io/projected/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-kube-api-access-qxflw\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967387 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tls-certs\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967387 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967325    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-home\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967715 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tmp-dir\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967756 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967725    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-model-cache\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.967756 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.967747    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-home\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.969693 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.969669    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-dshm\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.969948 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.969930    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tls-certs\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:03.996305 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:03.996228    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxflw\" (UniqueName: \"kubernetes.io/projected/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-kube-api-access-qxflw\") pod \"test-model-a70600-kserve-67d5545d45-lrsjw\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") " pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:04.060396 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:04.060348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:04.214231 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:04.214204    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"]
Jul 16 00:47:04.215817 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:47:04.215792    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7da118b3_9f4b_4b53_9c38_ca40cf07ee74.slice/crio-a41dd14ba12cc2095dbc0c34b103bac67e4edc4c4b435359fb0a24d2a1f887f6 WatchSource:0}: Error finding container a41dd14ba12cc2095dbc0c34b103bac67e4edc4c4b435359fb0a24d2a1f887f6: Status 404 returned error can't find the container with id a41dd14ba12cc2095dbc0c34b103bac67e4edc4c4b435359fb0a24d2a1f887f6
Jul 16 00:47:04.567355 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:04.567314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw" event={"ID":"7da118b3-9f4b-4b53-9c38-ca40cf07ee74","Type":"ContainerStarted","Data":"8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190"}
Jul 16 00:47:04.567544 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:04.567362    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw" event={"ID":"7da118b3-9f4b-4b53-9c38-ca40cf07ee74","Type":"ContainerStarted","Data":"a41dd14ba12cc2095dbc0c34b103bac67e4edc4c4b435359fb0a24d2a1f887f6"}
Jul 16 00:47:04.594018 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:04.593970    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw" podStartSLOduration=1.5939563749999999 podStartE2EDuration="1.593956375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:47:04.589372274 +0000 UTC m=+2030.160968574" watchObservedRunningTime="2026-07-16 00:47:04.593956375 +0000 UTC m=+2030.165552675"
Jul 16 00:47:14.060920 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:14.060874    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:14.061516 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:14.060939    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:14.073972 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:14.073941    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:14.634897 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:14.634872    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:44.221830 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:44.221792    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"]
Jul 16 00:47:59.243111 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.243073    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw" podUID="7da118b3-9f4b-4b53-9c38-ca40cf07ee74" containerName="main" containerID="cri-o://8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190" gracePeriod=45
Jul 16 00:47:59.513231 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.513201    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:59.613395 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613364    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-home\") pod \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") "
Jul 16 00:47:59.613558 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613412    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-model-cache\") pod \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") "
Jul 16 00:47:59.613558 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613437    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tls-certs\") pod \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") "
Jul 16 00:47:59.613558 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613457    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-dshm\") pod \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") "
Jul 16 00:47:59.613752 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613575    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxflw\" (UniqueName: \"kubernetes.io/projected/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-kube-api-access-qxflw\") pod \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") "
Jul 16 00:47:59.613752 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613642    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tmp-dir\") pod \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\" (UID: \"7da118b3-9f4b-4b53-9c38-ca40cf07ee74\") "
Jul 16 00:47:59.613752 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613682    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-home" (OuterVolumeSpecName: "home") pod "7da118b3-9f4b-4b53-9c38-ca40cf07ee74" (UID: "7da118b3-9f4b-4b53-9c38-ca40cf07ee74"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:47:59.613752 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613697    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-model-cache" (OuterVolumeSpecName: "model-cache") pod "7da118b3-9f4b-4b53-9c38-ca40cf07ee74" (UID: "7da118b3-9f4b-4b53-9c38-ca40cf07ee74"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:47:59.613960 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613874    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7da118b3-9f4b-4b53-9c38-ca40cf07ee74" (UID: "7da118b3-9f4b-4b53-9c38-ca40cf07ee74"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:47:59.614006 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.613988    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-home\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:47:59.614042 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.614005    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-model-cache\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:47:59.614042 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.614020    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tmp-dir\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:47:59.615837 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.615808    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-dshm" (OuterVolumeSpecName: "dshm") pod "7da118b3-9f4b-4b53-9c38-ca40cf07ee74" (UID: "7da118b3-9f4b-4b53-9c38-ca40cf07ee74"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:47:59.615934 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.615882    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-kube-api-access-qxflw" (OuterVolumeSpecName: "kube-api-access-qxflw") pod "7da118b3-9f4b-4b53-9c38-ca40cf07ee74" (UID: "7da118b3-9f4b-4b53-9c38-ca40cf07ee74"). InnerVolumeSpecName "kube-api-access-qxflw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:47:59.615995 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.615973    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7da118b3-9f4b-4b53-9c38-ca40cf07ee74" (UID: "7da118b3-9f4b-4b53-9c38-ca40cf07ee74"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:47:59.714848 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.714809    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-tls-certs\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:47:59.714848 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.714843    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-dshm\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:47:59.714848 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.714852    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxflw\" (UniqueName: \"kubernetes.io/projected/7da118b3-9f4b-4b53-9c38-ca40cf07ee74-kube-api-access-qxflw\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:47:59.856522 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.856487    2556 generic.go:356] "Generic (PLEG): container finished" podID="7da118b3-9f4b-4b53-9c38-ca40cf07ee74" containerID="8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190" exitCode=0
Jul 16 00:47:59.856758 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.856537    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"
Jul 16 00:47:59.856758 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.856526    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw" event={"ID":"7da118b3-9f4b-4b53-9c38-ca40cf07ee74","Type":"ContainerDied","Data":"8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190"}
Jul 16 00:47:59.856758 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.856653    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw" event={"ID":"7da118b3-9f4b-4b53-9c38-ca40cf07ee74","Type":"ContainerDied","Data":"a41dd14ba12cc2095dbc0c34b103bac67e4edc4c4b435359fb0a24d2a1f887f6"}
Jul 16 00:47:59.856758 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.856678    2556 scope.go:117] "RemoveContainer" containerID="8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190"
Jul 16 00:47:59.866798 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.866779    2556 scope.go:117] "RemoveContainer" containerID="8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190"
Jul 16 00:47:59.867125 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:47:59.867105    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190\": container with ID starting with 8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190 not found: ID does not exist" containerID="8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190"
Jul 16 00:47:59.867180 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.867136    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190"} err="failed to get container status \"8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190\": rpc error: code = NotFound desc = could not find container \"8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190\": container with ID starting with 8d5e8819cf33b9aea6ebaca77680bec138f2227324b0e08c910fc2435b172190 not found: ID does not exist"
Jul 16 00:47:59.880130 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.880096    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"]
Jul 16 00:47:59.884625 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:47:59.884576    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a70600/test-model-a70600-kserve-67d5545d45-lrsjw"]
Jul 16 00:48:00.972734 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:48:00.972694    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7da118b3-9f4b-4b53-9c38-ca40cf07ee74" path="/var/lib/kubelet/pods/7da118b3-9f4b-4b53-9c38-ca40cf07ee74/volumes"
Jul 16 00:48:14.993923 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:48:14.993896    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:48:14.997450 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:48:14.997427    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:49:56.451768 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.451738    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"]
Jul 16 00:49:56.452213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.452149    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da118b3-9f4b-4b53-9c38-ca40cf07ee74" containerName="main"
Jul 16 00:49:56.452213 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.452161    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da118b3-9f4b-4b53-9c38-ca40cf07ee74" containerName="main"
Jul 16 00:49:56.452289 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.452227    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da118b3-9f4b-4b53-9c38-ca40cf07ee74" containerName="main"
Jul 16 00:49:56.455313 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.455297    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.459687 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.459655    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"auth-test-model-7ee350-kserve-self-signed-certs\""
Jul 16 00:49:56.459687 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.459672    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"default-dockercfg-dzxw7\""
Jul 16 00:49:56.459885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.459690    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"kube-root-ca.crt\""
Jul 16 00:49:56.459885 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.459696    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"openshift-service-ca.crt\""
Jul 16 00:49:56.476589 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.476566    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"]
Jul 16 00:49:56.545500 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.545466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-tmp-dir\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.545692 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.545506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-home\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.545692 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.545577    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1917913a-104f-46f8-9ca4-37592fa2f98d-tls-certs\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.545692 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.545622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mncpj\" (UniqueName: \"kubernetes.io/projected/1917913a-104f-46f8-9ca4-37592fa2f98d-kube-api-access-mncpj\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.545692 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.545668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-dshm\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.545849 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.545693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-model-cache\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.646557 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.646516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1917913a-104f-46f8-9ca4-37592fa2f98d-tls-certs\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.646780 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.646573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mncpj\" (UniqueName: \"kubernetes.io/projected/1917913a-104f-46f8-9ca4-37592fa2f98d-kube-api-access-mncpj\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.646780 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.646644    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-dshm\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.646780 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.646674    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-model-cache\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.646780 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.646744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-tmp-dir\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.646780 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.646776    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-home\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.647151 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.647125    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-model-cache\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.647151 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.647146    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-home\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.647292 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.647178    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-tmp-dir\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.649065 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.649033    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-dshm\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.649308 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.649290    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1917913a-104f-46f8-9ca4-37592fa2f98d-tls-certs\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.693545 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.693509    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mncpj\" (UniqueName: \"kubernetes.io/projected/1917913a-104f-46f8-9ca4-37592fa2f98d-kube-api-access-mncpj\") pod \"auth-test-model-7ee350-kserve-758df875-kvqql\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") " pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.765158 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.765066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:49:56.919896 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:56.919868    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"]
Jul 16 00:49:56.921158 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:49:56.921130    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1917913a_104f_46f8_9ca4_37592fa2f98d.slice/crio-d942119999cead7a5883b295ee4e9102c11c4bda5ef263b19a84fdecc1a5aad7 WatchSource:0}: Error finding container d942119999cead7a5883b295ee4e9102c11c4bda5ef263b19a84fdecc1a5aad7: Status 404 returned error can't find the container with id d942119999cead7a5883b295ee4e9102c11c4bda5ef263b19a84fdecc1a5aad7
Jul 16 00:49:57.469203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:57.469163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql" event={"ID":"1917913a-104f-46f8-9ca4-37592fa2f98d","Type":"ContainerStarted","Data":"dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c"}
Jul 16 00:49:57.469203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:49:57.469211    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql" event={"ID":"1917913a-104f-46f8-9ca4-37592fa2f98d","Type":"ContainerStarted","Data":"d942119999cead7a5883b295ee4e9102c11c4bda5ef263b19a84fdecc1a5aad7"}
Jul 16 00:50:06.765477 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:06.765430    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:50:06.765997 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:06.765493    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:50:06.778842 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:06.778817    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:50:06.805894 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:06.805848    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql" podStartSLOduration=10.805834641 podStartE2EDuration="10.805834641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:57.497072787 +0000 UTC m=+2203.068669089" watchObservedRunningTime="2026-07-16 00:50:06.805834641 +0000 UTC m=+2212.377430939"
Jul 16 00:50:07.531245 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:07.531213    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:50:29.423938 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.423897    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"]
Jul 16 00:50:29.427797 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.427776    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.432637 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.432577    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"kube-root-ca.crt\""
Jul 16 00:50:29.433921 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.433898    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"default-dockercfg-ckt2l\""
Jul 16 00:50:29.433921 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.433911    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"openshift-service-ca.crt\""
Jul 16 00:50:29.453159 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.452904    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"auth-test-model-07a8dc-kserve-self-signed-certs\""
Jul 16 00:50:29.454975 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.454947    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"]
Jul 16 00:50:29.568284 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.568248    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4b6282f-2758-48fd-90cf-317a67cec789-tls-certs\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.568284 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.568285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp57p\" (UniqueName: \"kubernetes.io/projected/f4b6282f-2758-48fd-90cf-317a67cec789-kube-api-access-sp57p\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.568502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.568326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-home\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.568502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.568347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-dshm\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.568502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.568363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-model-cache\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.568502 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.568377    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-tmp-dir\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669071 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-home\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669071 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-dshm\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669340 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-model-cache\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669340 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669124    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-tmp-dir\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669340 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4b6282f-2758-48fd-90cf-317a67cec789-tls-certs\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669340 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669322    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp57p\" (UniqueName: \"kubernetes.io/projected/f4b6282f-2758-48fd-90cf-317a67cec789-kube-api-access-sp57p\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669556 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669489    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-model-cache\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669556 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669541    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-tmp-dir\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.669709 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.669590    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-home\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.671553 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.671519    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-dshm\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.671851 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.671833    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4b6282f-2758-48fd-90cf-317a67cec789-tls-certs\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.680221 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.680164    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp57p\" (UniqueName: \"kubernetes.io/projected/f4b6282f-2758-48fd-90cf-317a67cec789-kube-api-access-sp57p\") pod \"auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") " pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.737322 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.737299    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:29.908100 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:29.908070    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"]
Jul 16 00:50:29.910239 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:50:29.910189    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4b6282f_2758_48fd_90cf_317a67cec789.slice/crio-d014a03898601cbca8a2613d9506c8b8a8ce3019011d26a4744a2055aef0d2e5 WatchSource:0}: Error finding container d014a03898601cbca8a2613d9506c8b8a8ce3019011d26a4744a2055aef0d2e5: Status 404 returned error can't find the container with id d014a03898601cbca8a2613d9506c8b8a8ce3019011d26a4744a2055aef0d2e5
Jul 16 00:50:30.638209 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:30.638172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp" event={"ID":"f4b6282f-2758-48fd-90cf-317a67cec789","Type":"ContainerStarted","Data":"633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b"}
Jul 16 00:50:30.638599 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:30.638217    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp" event={"ID":"f4b6282f-2758-48fd-90cf-317a67cec789","Type":"ContainerStarted","Data":"d014a03898601cbca8a2613d9506c8b8a8ce3019011d26a4744a2055aef0d2e5"}
Jul 16 00:50:30.660842 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:30.660786    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp" podStartSLOduration=1.660766682 podStartE2EDuration="1.660766682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:50:30.659069932 +0000 UTC m=+2236.230666234" watchObservedRunningTime="2026-07-16 00:50:30.660766682 +0000 UTC m=+2236.232362983"
Jul 16 00:50:39.737598 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:39.737497    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:39.737598 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:39.737558    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:39.750571 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:39.750538    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:50:40.705435 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:50:40.705405    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:52:47.728229 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:52:47.728190    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"]
Jul 16 00:52:48.647100 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:52:48.647060    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"]
Jul 16 00:53:02.749043 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:02.748978    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql" podUID="1917913a-104f-46f8-9ca4-37592fa2f98d" containerName="main" containerID="cri-o://dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c" gracePeriod=45
Jul 16 00:53:03.020284 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.020250    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:53:03.184286 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184259    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-tmp-dir\") pod \"1917913a-104f-46f8-9ca4-37592fa2f98d\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") "
Jul 16 00:53:03.184475 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184345    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-model-cache\") pod \"1917913a-104f-46f8-9ca4-37592fa2f98d\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") "
Jul 16 00:53:03.184475 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184414    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1917913a-104f-46f8-9ca4-37592fa2f98d-tls-certs\") pod \"1917913a-104f-46f8-9ca4-37592fa2f98d\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") "
Jul 16 00:53:03.184475 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184443    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-dshm\") pod \"1917913a-104f-46f8-9ca4-37592fa2f98d\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") "
Jul 16 00:53:03.184680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184477    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mncpj\" (UniqueName: \"kubernetes.io/projected/1917913a-104f-46f8-9ca4-37592fa2f98d-kube-api-access-mncpj\") pod \"1917913a-104f-46f8-9ca4-37592fa2f98d\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") "
Jul 16 00:53:03.184680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184511    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-home\") pod \"1917913a-104f-46f8-9ca4-37592fa2f98d\" (UID: \"1917913a-104f-46f8-9ca4-37592fa2f98d\") "
Jul 16 00:53:03.184680 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184570    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1917913a-104f-46f8-9ca4-37592fa2f98d" (UID: "1917913a-104f-46f8-9ca4-37592fa2f98d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:03.184846 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184682    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1917913a-104f-46f8-9ca4-37592fa2f98d" (UID: "1917913a-104f-46f8-9ca4-37592fa2f98d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:03.184846 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184832    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-home" (OuterVolumeSpecName: "home") pod "1917913a-104f-46f8-9ca4-37592fa2f98d" (UID: "1917913a-104f-46f8-9ca4-37592fa2f98d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:03.184946 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184914    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-model-cache\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:03.184946 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184933    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-home\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:03.185054 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.184946    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-tmp-dir\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:03.186996 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.186972    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1917913a-104f-46f8-9ca4-37592fa2f98d-kube-api-access-mncpj" (OuterVolumeSpecName: "kube-api-access-mncpj") pod "1917913a-104f-46f8-9ca4-37592fa2f98d" (UID: "1917913a-104f-46f8-9ca4-37592fa2f98d"). InnerVolumeSpecName "kube-api-access-mncpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:53:03.187205 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.187183    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-dshm" (OuterVolumeSpecName: "dshm") pod "1917913a-104f-46f8-9ca4-37592fa2f98d" (UID: "1917913a-104f-46f8-9ca4-37592fa2f98d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:03.187205 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.187198    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1917913a-104f-46f8-9ca4-37592fa2f98d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1917913a-104f-46f8-9ca4-37592fa2f98d" (UID: "1917913a-104f-46f8-9ca4-37592fa2f98d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:53:03.286312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.286283    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1917913a-104f-46f8-9ca4-37592fa2f98d-tls-certs\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:03.286312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.286310    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1917913a-104f-46f8-9ca4-37592fa2f98d-dshm\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:03.286312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.286319    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mncpj\" (UniqueName: \"kubernetes.io/projected/1917913a-104f-46f8-9ca4-37592fa2f98d-kube-api-access-mncpj\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:03.440392 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.440355    2556 generic.go:356] "Generic (PLEG): container finished" podID="1917913a-104f-46f8-9ca4-37592fa2f98d" containerID="dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c" exitCode=0
Jul 16 00:53:03.440585 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.440392    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql" event={"ID":"1917913a-104f-46f8-9ca4-37592fa2f98d","Type":"ContainerDied","Data":"dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c"}
Jul 16 00:53:03.440585 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.440414    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"
Jul 16 00:53:03.440585 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.440439    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql" event={"ID":"1917913a-104f-46f8-9ca4-37592fa2f98d","Type":"ContainerDied","Data":"d942119999cead7a5883b295ee4e9102c11c4bda5ef263b19a84fdecc1a5aad7"}
Jul 16 00:53:03.440585 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.440457    2556 scope.go:117] "RemoveContainer" containerID="dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c"
Jul 16 00:53:03.450087 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.450069    2556 scope.go:117] "RemoveContainer" containerID="dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c"
Jul 16 00:53:03.450328 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:53:03.450308    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c\": container with ID starting with dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c not found: ID does not exist" containerID="dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c"
Jul 16 00:53:03.450377 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.450337    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c"} err="failed to get container status \"dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c\": rpc error: code = NotFound desc = could not find container \"dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c\": container with ID starting with dc95ee37173853eaff448616795dff508cb5df532c6701e52117be5428ecf54c not found: ID does not exist"
Jul 16 00:53:03.463579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.463540    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"]
Jul 16 00:53:03.469656 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.469623    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/auth-test-model-7ee350-kserve-758df875-kvqql"]
Jul 16 00:53:03.668424 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.668325    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp" podUID="f4b6282f-2758-48fd-90cf-317a67cec789" containerName="main" containerID="cri-o://633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b" gracePeriod=45
Jul 16 00:53:03.935483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:03.935407    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:53:04.094374 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094333    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-tmp-dir\") pod \"f4b6282f-2758-48fd-90cf-317a67cec789\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") "
Jul 16 00:53:04.094374 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094383    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-dshm\") pod \"f4b6282f-2758-48fd-90cf-317a67cec789\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") "
Jul 16 00:53:04.094682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094437    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-model-cache\") pod \"f4b6282f-2758-48fd-90cf-317a67cec789\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") "
Jul 16 00:53:04.094682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094507    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-home\") pod \"f4b6282f-2758-48fd-90cf-317a67cec789\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") "
Jul 16 00:53:04.094682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094540    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4b6282f-2758-48fd-90cf-317a67cec789-tls-certs\") pod \"f4b6282f-2758-48fd-90cf-317a67cec789\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") "
Jul 16 00:53:04.094682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094575    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp57p\" (UniqueName: \"kubernetes.io/projected/f4b6282f-2758-48fd-90cf-317a67cec789-kube-api-access-sp57p\") pod \"f4b6282f-2758-48fd-90cf-317a67cec789\" (UID: \"f4b6282f-2758-48fd-90cf-317a67cec789\") "
Jul 16 00:53:04.094682 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094642    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4b6282f-2758-48fd-90cf-317a67cec789" (UID: "f4b6282f-2758-48fd-90cf-317a67cec789"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:04.094924 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094793    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4b6282f-2758-48fd-90cf-317a67cec789" (UID: "f4b6282f-2758-48fd-90cf-317a67cec789"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:04.094924 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094849    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-home" (OuterVolumeSpecName: "home") pod "f4b6282f-2758-48fd-90cf-317a67cec789" (UID: "f4b6282f-2758-48fd-90cf-317a67cec789"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:04.095014 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094974    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-tmp-dir\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:04.095014 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.094994    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-model-cache\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:04.095014 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.095007    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-home\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:04.096979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.096947    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4b6282f-2758-48fd-90cf-317a67cec789-kube-api-access-sp57p" (OuterVolumeSpecName: "kube-api-access-sp57p") pod "f4b6282f-2758-48fd-90cf-317a67cec789" (UID: "f4b6282f-2758-48fd-90cf-317a67cec789"). InnerVolumeSpecName "kube-api-access-sp57p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:53:04.096979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.096955    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-dshm" (OuterVolumeSpecName: "dshm") pod "f4b6282f-2758-48fd-90cf-317a67cec789" (UID: "f4b6282f-2758-48fd-90cf-317a67cec789"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:53:04.097131 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.097034    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4b6282f-2758-48fd-90cf-317a67cec789-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4b6282f-2758-48fd-90cf-317a67cec789" (UID: "f4b6282f-2758-48fd-90cf-317a67cec789"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:53:04.195633 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.195512    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4b6282f-2758-48fd-90cf-317a67cec789-tls-certs\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:04.195633 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.195545    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp57p\" (UniqueName: \"kubernetes.io/projected/f4b6282f-2758-48fd-90cf-317a67cec789-kube-api-access-sp57p\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:04.195633 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.195554    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4b6282f-2758-48fd-90cf-317a67cec789-dshm\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:53:04.446548 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.446461    2556 generic.go:356] "Generic (PLEG): container finished" podID="f4b6282f-2758-48fd-90cf-317a67cec789" containerID="633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b" exitCode=0
Jul 16 00:53:04.446548 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.446509    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"
Jul 16 00:53:04.446794 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.446549    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp" event={"ID":"f4b6282f-2758-48fd-90cf-317a67cec789","Type":"ContainerDied","Data":"633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b"}
Jul 16 00:53:04.446794 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.446587    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp" event={"ID":"f4b6282f-2758-48fd-90cf-317a67cec789","Type":"ContainerDied","Data":"d014a03898601cbca8a2613d9506c8b8a8ce3019011d26a4744a2055aef0d2e5"}
Jul 16 00:53:04.446794 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.446624    2556 scope.go:117] "RemoveContainer" containerID="633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b"
Jul 16 00:53:04.455799 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.455785    2556 scope.go:117] "RemoveContainer" containerID="633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b"
Jul 16 00:53:04.456039 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:53:04.456019    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b\": container with ID starting with 633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b not found: ID does not exist" containerID="633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b"
Jul 16 00:53:04.456108 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.456051    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b"} err="failed to get container status \"633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b\": rpc error: code = NotFound desc = could not find container \"633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b\": container with ID starting with 633c52f09b65ab85ad0393868b261133ce0f30d979772d4c52dafdc7d2cecf2b not found: ID does not exist"
Jul 16 00:53:04.472646 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.472600    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"]
Jul 16 00:53:04.481085 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.481060    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/auth-test-model-07a8dc-kserve-6c7f5f6cb7-7hwtp"]
Jul 16 00:53:04.971979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.971950    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1917913a-104f-46f8-9ca4-37592fa2f98d" path="/var/lib/kubelet/pods/1917913a-104f-46f8-9ca4-37592fa2f98d/volumes"
Jul 16 00:53:04.972351 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:04.972338    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4b6282f-2758-48fd-90cf-317a67cec789" path="/var/lib/kubelet/pods/f4b6282f-2758-48fd-90cf-317a67cec789/volumes"
Jul 16 00:53:14.155752 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.155714    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"]
Jul 16 00:53:14.156181 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.156168    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4b6282f-2758-48fd-90cf-317a67cec789" containerName="main"
Jul 16 00:53:14.156181 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.156181    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4b6282f-2758-48fd-90cf-317a67cec789" containerName="main"
Jul 16 00:53:14.156253 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.156197    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1917913a-104f-46f8-9ca4-37592fa2f98d" containerName="main"
Jul 16 00:53:14.156253 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.156203    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1917913a-104f-46f8-9ca4-37592fa2f98d" containerName="main"
Jul 16 00:53:14.156312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.156267    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4b6282f-2758-48fd-90cf-317a67cec789" containerName="main"
Jul 16 00:53:14.156312 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.156279    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1917913a-104f-46f8-9ca4-37592fa2f98d" containerName="main"
Jul 16 00:53:14.160681 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.160662    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.164486 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.164457    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"openshift-service-ca.crt\""
Jul 16 00:53:14.164486 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.164480    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"kube-root-ca.crt\""
Jul 16 00:53:14.164704 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.164457    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"sub-test-model-07a8dc-kserve-self-signed-certs\""
Jul 16 00:53:14.164704 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.164568    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-07a8dc\"/\"default-dockercfg-ckt2l\""
Jul 16 00:53:14.171775 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.171740    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"]
Jul 16 00:53:14.192114 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.192077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkvf7\" (UniqueName: \"kubernetes.io/projected/03d002ea-322f-4a38-9083-96233b0fd6cf-kube-api-access-rkvf7\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.192275 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.192137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-tmp-dir\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.192275 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.192219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-dshm\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.192396 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.192277    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d002ea-322f-4a38-9083-96233b0fd6cf-tls-certs\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.192396 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.192298    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-home\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.192396 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.192331    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-model-cache\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.293483 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.293439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkvf7\" (UniqueName: \"kubernetes.io/projected/03d002ea-322f-4a38-9083-96233b0fd6cf-kube-api-access-rkvf7\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.293697 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.293494    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-tmp-dir\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.293697 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.293526    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-dshm\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.293697 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.293569    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d002ea-322f-4a38-9083-96233b0fd6cf-tls-certs\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.293697 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.293592    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-home\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.293697 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.293651    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-model-cache\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.294021 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.293996    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-tmp-dir\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.294087 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.294006    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-home\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.294140 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.294080    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-model-cache\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.296138 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.296119    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-dshm\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.296425 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.296402    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d002ea-322f-4a38-9083-96233b0fd6cf-tls-certs\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.303341 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.303311    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkvf7\" (UniqueName: \"kubernetes.io/projected/03d002ea-322f-4a38-9083-96233b0fd6cf-kube-api-access-rkvf7\") pod \"sub-test-model-07a8dc-kserve-6f575954b9-4dp75\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") " pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.471047 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.470934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:14.632341 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:14.632305    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"]
Jul 16 00:53:14.633939 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:53:14.633907    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03d002ea_322f_4a38_9083_96233b0fd6cf.slice/crio-b07d55eacc8db36955ba074714d261234f8d0eaf58e82ecb5bb7b7c881a97499 WatchSource:0}: Error finding container b07d55eacc8db36955ba074714d261234f8d0eaf58e82ecb5bb7b7c881a97499: Status 404 returned error can't find the container with id b07d55eacc8db36955ba074714d261234f8d0eaf58e82ecb5bb7b7c881a97499
Jul 16 00:53:15.025468 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:15.025436    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:53:15.029336 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:15.029313    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:53:15.508947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:15.508848    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75" event={"ID":"03d002ea-322f-4a38-9083-96233b0fd6cf","Type":"ContainerStarted","Data":"2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e"}
Jul 16 00:53:15.508947 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:15.508900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75" event={"ID":"03d002ea-322f-4a38-9083-96233b0fd6cf","Type":"ContainerStarted","Data":"b07d55eacc8db36955ba074714d261234f8d0eaf58e82ecb5bb7b7c881a97499"}
Jul 16 00:53:15.527705 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:15.527643    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75" podStartSLOduration=1.527628584 podStartE2EDuration="1.527628584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:53:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:15.525835172 +0000 UTC m=+2401.097431474" watchObservedRunningTime="2026-07-16 00:53:15.527628584 +0000 UTC m=+2401.099224886"
Jul 16 00:53:24.472054 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:24.472009    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:24.472478 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:24.472073    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:24.487236 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:24.487207    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:24.573657 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:24.573596    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:53:55.333114 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:53:55.333075    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"]
Jul 16 00:54:02.745391 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.745353    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"]
Jul 16 00:54:02.749006 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.748986    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.751864 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.751833    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"rate-test-model-7ee350-kserve-self-signed-certs\""
Jul 16 00:54:02.752919 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.752897    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"openshift-service-ca.crt\""
Jul 16 00:54:02.753050 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.752932    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"default-dockercfg-dzxw7\""
Jul 16 00:54:02.753050 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.752966    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7ee350\"/\"kube-root-ca.crt\""
Jul 16 00:54:02.760059 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.760030    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"]
Jul 16 00:54:02.862795 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.862761    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-dshm\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.863008 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.862820    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-model-cache\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.863008 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.862904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-home\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.863008 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.862946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tmp-dir\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.863008 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.862987    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2ksb\" (UniqueName: \"kubernetes.io/projected/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-kube-api-access-g2ksb\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.863008 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.863018    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tls-certs\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.963757 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.963715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-model-cache\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.963943 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.963773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-home\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.963943 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.963805    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tmp-dir\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.963943 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.963843    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2ksb\" (UniqueName: \"kubernetes.io/projected/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-kube-api-access-g2ksb\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.964083 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.963982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tls-certs\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.964137 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.964105    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-dshm\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.964198 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.964161    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-model-cache\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.964242 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.964192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-home\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.964427 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.964409    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tmp-dir\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.966532 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.966496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-dshm\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.966820 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.966800    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tls-certs\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:02.979191 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:02.979148    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2ksb\" (UniqueName: \"kubernetes.io/projected/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-kube-api-access-g2ksb\") pod \"rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") " pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:03.061002 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:03.060959    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:03.205893 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:03.205868    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"]
Jul 16 00:54:03.207301 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:54:03.207273    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9e5e12b_abd3_4d20_9bef_f62a606f65cd.slice/crio-9c421df00a5ace4ee66c8301421ed03c8764a1452f67648caf146a22ce9084e3 WatchSource:0}: Error finding container 9c421df00a5ace4ee66c8301421ed03c8764a1452f67648caf146a22ce9084e3: Status 404 returned error can't find the container with id 9c421df00a5ace4ee66c8301421ed03c8764a1452f67648caf146a22ce9084e3
Jul 16 00:54:03.767365 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:03.767332    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2" event={"ID":"f9e5e12b-abd3-4d20-9bef-f62a606f65cd","Type":"ContainerStarted","Data":"e33ddb65d3a435d14ca738be5d32f35e8b277a861b75aa2d20c85d22e4bbe4ff"}
Jul 16 00:54:03.767365 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:03.767372    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2" event={"ID":"f9e5e12b-abd3-4d20-9bef-f62a606f65cd","Type":"ContainerStarted","Data":"9c421df00a5ace4ee66c8301421ed03c8764a1452f67648caf146a22ce9084e3"}
Jul 16 00:54:03.788267 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:03.788204    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2" podStartSLOduration=1.788187411 podStartE2EDuration="1.788187411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:03.786599612 +0000 UTC m=+2449.358195913" watchObservedRunningTime="2026-07-16 00:54:03.788187411 +0000 UTC m=+2449.359783711"
Jul 16 00:54:10.353752 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.353708    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75" podUID="03d002ea-322f-4a38-9083-96233b0fd6cf" containerName="main" containerID="cri-o://2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e" gracePeriod=45
Jul 16 00:54:10.618212 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.618138    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:54:10.742809 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.742779    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-model-cache\") pod \"03d002ea-322f-4a38-9083-96233b0fd6cf\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") "
Jul 16 00:54:10.742989 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.742838    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-tmp-dir\") pod \"03d002ea-322f-4a38-9083-96233b0fd6cf\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") "
Jul 16 00:54:10.742989 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.742913    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-home\") pod \"03d002ea-322f-4a38-9083-96233b0fd6cf\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") "
Jul 16 00:54:10.742989 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.742944    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkvf7\" (UniqueName: \"kubernetes.io/projected/03d002ea-322f-4a38-9083-96233b0fd6cf-kube-api-access-rkvf7\") pod \"03d002ea-322f-4a38-9083-96233b0fd6cf\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") "
Jul 16 00:54:10.743101 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743023    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-dshm\") pod \"03d002ea-322f-4a38-9083-96233b0fd6cf\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") "
Jul 16 00:54:10.743101 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743047    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d002ea-322f-4a38-9083-96233b0fd6cf-tls-certs\") pod \"03d002ea-322f-4a38-9083-96233b0fd6cf\" (UID: \"03d002ea-322f-4a38-9083-96233b0fd6cf\") "
Jul 16 00:54:10.743203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743134    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "03d002ea-322f-4a38-9083-96233b0fd6cf" (UID: "03d002ea-322f-4a38-9083-96233b0fd6cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:10.743203 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743173    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03d002ea-322f-4a38-9083-96233b0fd6cf" (UID: "03d002ea-322f-4a38-9083-96233b0fd6cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:10.743302 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743240    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-home" (OuterVolumeSpecName: "home") pod "03d002ea-322f-4a38-9083-96233b0fd6cf" (UID: "03d002ea-322f-4a38-9083-96233b0fd6cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:10.743421 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743400    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-home\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:54:10.743421 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743422    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-model-cache\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:54:10.743643 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.743436    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-tmp-dir\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:54:10.745291 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.745264    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-dshm" (OuterVolumeSpecName: "dshm") pod "03d002ea-322f-4a38-9083-96233b0fd6cf" (UID: "03d002ea-322f-4a38-9083-96233b0fd6cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:54:10.745368 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.745293    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d002ea-322f-4a38-9083-96233b0fd6cf-kube-api-access-rkvf7" (OuterVolumeSpecName: "kube-api-access-rkvf7") pod "03d002ea-322f-4a38-9083-96233b0fd6cf" (UID: "03d002ea-322f-4a38-9083-96233b0fd6cf"). InnerVolumeSpecName "kube-api-access-rkvf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:54:10.745368 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.745339    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d002ea-322f-4a38-9083-96233b0fd6cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03d002ea-322f-4a38-9083-96233b0fd6cf" (UID: "03d002ea-322f-4a38-9083-96233b0fd6cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:54:10.805172 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.805145    2556 generic.go:356] "Generic (PLEG): container finished" podID="03d002ea-322f-4a38-9083-96233b0fd6cf" containerID="2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e" exitCode=0
Jul 16 00:54:10.805263 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.805191    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"
Jul 16 00:54:10.805263 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.805209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75" event={"ID":"03d002ea-322f-4a38-9083-96233b0fd6cf","Type":"ContainerDied","Data":"2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e"}
Jul 16 00:54:10.805263 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.805248    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75" event={"ID":"03d002ea-322f-4a38-9083-96233b0fd6cf","Type":"ContainerDied","Data":"b07d55eacc8db36955ba074714d261234f8d0eaf58e82ecb5bb7b7c881a97499"}
Jul 16 00:54:10.805369 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.805269    2556 scope.go:117] "RemoveContainer" containerID="2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e"
Jul 16 00:54:10.814080 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.814061    2556 scope.go:117] "RemoveContainer" containerID="2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e"
Jul 16 00:54:10.814332 ip-10-0-140-233 kubenswrapper[2556]: E0716 00:54:10.814312    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e\": container with ID starting with 2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e not found: ID does not exist" containerID="2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e"
Jul 16 00:54:10.814397 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.814340    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e"} err="failed to get container status \"2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e\": rpc error: code = NotFound desc = could not find container \"2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e\": container with ID starting with 2ad12210e6a25fc50030d8f13b1f342a8fc480db1e2a4fa8d9de3090f70cc62e not found: ID does not exist"
Jul 16 00:54:10.829047 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.829026    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"]
Jul 16 00:54:10.833929 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.833912    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-07a8dc/sub-test-model-07a8dc-kserve-6f575954b9-4dp75"]
Jul 16 00:54:10.844133 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.844113    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkvf7\" (UniqueName: \"kubernetes.io/projected/03d002ea-322f-4a38-9083-96233b0fd6cf-kube-api-access-rkvf7\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:54:10.844216 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.844134    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d002ea-322f-4a38-9083-96233b0fd6cf-dshm\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:54:10.844216 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.844144    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d002ea-322f-4a38-9083-96233b0fd6cf-tls-certs\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:54:10.972209 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:10.972124    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d002ea-322f-4a38-9083-96233b0fd6cf" path="/var/lib/kubelet/pods/03d002ea-322f-4a38-9083-96233b0fd6cf/volumes"
Jul 16 00:54:13.062034 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:13.062003    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:13.062420 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:13.062045    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:13.074494 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:13.074465    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:54:13.832520 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:54:13.832486    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:55:21.017993 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:21.017780    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"]
Jul 16 00:55:36.044236 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.044167    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2" podUID="f9e5e12b-abd3-4d20-9bef-f62a606f65cd" containerName="main" containerID="cri-o://e33ddb65d3a435d14ca738be5d32f35e8b277a861b75aa2d20c85d22e4bbe4ff" gracePeriod=45
Jul 16 00:55:36.250247 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.250207    2556 generic.go:356] "Generic (PLEG): container finished" podID="f9e5e12b-abd3-4d20-9bef-f62a606f65cd" containerID="e33ddb65d3a435d14ca738be5d32f35e8b277a861b75aa2d20c85d22e4bbe4ff" exitCode=0
Jul 16 00:55:36.250433 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.250288    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2" event={"ID":"f9e5e12b-abd3-4d20-9bef-f62a606f65cd","Type":"ContainerDied","Data":"e33ddb65d3a435d14ca738be5d32f35e8b277a861b75aa2d20c85d22e4bbe4ff"}
Jul 16 00:55:36.308857 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.308788    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:55:36.400677 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.400638    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-dshm\") pod \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") "
Jul 16 00:55:36.400870 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.400692    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tmp-dir\") pod \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") "
Jul 16 00:55:36.400870 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.400740    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2ksb\" (UniqueName: \"kubernetes.io/projected/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-kube-api-access-g2ksb\") pod \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") "
Jul 16 00:55:36.400870 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.400756    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-home\") pod \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") "
Jul 16 00:55:36.400870 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.400788    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-model-cache\") pod \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") "
Jul 16 00:55:36.400870 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.400866    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tls-certs\") pod \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\" (UID: \"f9e5e12b-abd3-4d20-9bef-f62a606f65cd\") "
Jul 16 00:55:36.401136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.401044    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9e5e12b-abd3-4d20-9bef-f62a606f65cd" (UID: "f9e5e12b-abd3-4d20-9bef-f62a606f65cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:55:36.401136 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.401059    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-home" (OuterVolumeSpecName: "home") pod "f9e5e12b-abd3-4d20-9bef-f62a606f65cd" (UID: "f9e5e12b-abd3-4d20-9bef-f62a606f65cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:55:36.401249 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.401148    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9e5e12b-abd3-4d20-9bef-f62a606f65cd" (UID: "f9e5e12b-abd3-4d20-9bef-f62a606f65cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:55:36.401249 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.401229    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tmp-dir\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:55:36.401249 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.401244    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-home\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:55:36.401398 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.401252    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-model-cache\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:55:36.403102 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.403077    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-dshm" (OuterVolumeSpecName: "dshm") pod "f9e5e12b-abd3-4d20-9bef-f62a606f65cd" (UID: "f9e5e12b-abd3-4d20-9bef-f62a606f65cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:55:36.403102 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.403095    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-kube-api-access-g2ksb" (OuterVolumeSpecName: "kube-api-access-g2ksb") pod "f9e5e12b-abd3-4d20-9bef-f62a606f65cd" (UID: "f9e5e12b-abd3-4d20-9bef-f62a606f65cd"). InnerVolumeSpecName "kube-api-access-g2ksb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:55:36.403256 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.403141    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9e5e12b-abd3-4d20-9bef-f62a606f65cd" (UID: "f9e5e12b-abd3-4d20-9bef-f62a606f65cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:55:36.502556 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.502512    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-tls-certs\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:55:36.502556 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.502546    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-dshm\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:55:36.502556 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:36.502556    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2ksb\" (UniqueName: \"kubernetes.io/projected/f9e5e12b-abd3-4d20-9bef-f62a606f65cd-kube-api-access-g2ksb\") on node \"ip-10-0-140-233.ec2.internal\" DevicePath \"\""
Jul 16 00:55:37.258221 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:37.258131    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"
Jul 16 00:55:37.258221 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:37.258172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2" event={"ID":"f9e5e12b-abd3-4d20-9bef-f62a606f65cd","Type":"ContainerDied","Data":"9c421df00a5ace4ee66c8301421ed03c8764a1452f67648caf146a22ce9084e3"}
Jul 16 00:55:37.258755 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:37.258230    2556 scope.go:117] "RemoveContainer" containerID="e33ddb65d3a435d14ca738be5d32f35e8b277a861b75aa2d20c85d22e4bbe4ff"
Jul 16 00:55:37.278083 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:37.278050    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"]
Jul 16 00:55:37.280216 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:37.280184    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7ee350/rate-test-model-7ee350-kserve-6576f7fbc5-8qvt2"]
Jul 16 00:55:38.972054 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:55:38.972014    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e5e12b-abd3-4d20-9bef-f62a606f65cd" path="/var/lib/kubelet/pods/f9e5e12b-abd3-4d20-9bef-f62a606f65cd/volumes"
Jul 16 00:56:01.571656 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:01.571600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qhsq4_02beefdb-f393-47ec-9a92-ddd489c5ecc4/manager/0.log"
Jul 16 00:56:01.712344 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:01.712308    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9q26d_bb451007-9e82-4aa4-9414-470883dc89c1/manager/0.log"
Jul 16 00:56:01.840979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:01.840905    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c45676cbf-42wd6_487ecbf3-4b7a-4bd4-beca-f96b7570157f/manager/0.log"
Jul 16 00:56:02.197048 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:02.196964    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-28l9m_1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b/copy-manifests/0.log"
Jul 16 00:56:02.204546 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:02.204523    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-28l9m_1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b/manager/0.log"
Jul 16 00:56:02.824910 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:02.824871    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59649fbb6d-slth6_473b5a97-e5cf-4db3-ae39-3054c80cd1ac/maas-api/0.log"
Jul 16 00:56:02.941369 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:02.941331    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-b9cb77e6-65d5d5586-mhgsx_e4ac4ff6-1ef9-4051-8f06-c2cacd666aff/maas-api/0.log"
Jul 16 00:56:03.296263 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:03.296237    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-0aafd8c9-68b49df6bd-qcmlg_717a32d5-13e2-4996-adff-f118a614b987/maas-api/0.log"
Jul 16 00:56:03.530942 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:03.530904    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-eeb61d-6fdf66d6db-w6nb5_edd722b2-3e77-4c86-bc62-2e916f9b758c/maas-api/0.log"
Jul 16 00:56:03.644533 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:03.644444    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-4b7f7df8-9556db65b-xf278_b2d24201-a63a-45c0-8bc7-d9ec1a506ab4/maas-api/0.log"
Jul 16 00:56:03.765310 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:03.765269    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-19434bf7-6cc446c7dd-gz9xh_ef900290-637c-4b8f-92bb-abc5047aada0/maas-api/0.log"
Jul 16 00:56:04.680676 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:04.680647    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-95zhj_fc63ae0c-ad65-4515-8652-82fd4b5181cb/postgres/0.log"
Jul 16 00:56:06.088202 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:06.088177    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-svtqs_248e2b5a-0600-4236-a71f-583fd9c8e1f5/manager/0.log"
Jul 16 00:56:06.196907 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:06.196876    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kcpx7_14113433-17be-4477-acbc-92dc82d5d820/manager/0.log"
Jul 16 00:56:06.316751 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:06.316722    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fnzbf_5fb06c50-394f-49ce-beed-bb6db809ed58/kuadrant-console-plugin/0.log"
Jul 16 00:56:06.439485 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:06.439406    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v2cx9_155c8119-324f-4249-b5ba-001b2df24fd2/registry-server/0.log"
Jul 16 00:56:06.562962 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:06.562938    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9rrd6_54f74cfe-2064-4f42-b6c5-b8d92322b79f/manager/0.log"
Jul 16 00:56:06.819246 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:06.819207    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7dx9r_809c2a6f-a7e0-47d1-95d4-e884298bf2dd/manager/0.log"
Jul 16 00:56:07.540815 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:07.540785    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-7qmdx_b898ec25-4f39-4f15-a2cb-c7e5afd44fc1/kube-auth-proxy/0.log"
Jul 16 00:56:07.771579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:07.771552    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-g74vt_659481d0-bfb1-4d5c-b613-17d07bc31934/payload-pre-processing/0.log"
Jul 16 00:56:07.888892 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:07.888813    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w6kl_e9f83428-5342-4907-9660-e57f2e0acccc/payload-processing/0.log"
Jul 16 00:56:08.351007 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:08.350969    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2r5gq_64afe769-4070-45dd-b0fb-9e62c5be958d/main/0.log"
Jul 16 00:56:08.699043 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:08.698947    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2nrl6_3c59caf3-5812-41f0-84b0-dbbf9912e00f/main/0.log"
Jul 16 00:56:08.921708 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:08.921674    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-84fl7_c4132083-aad4-4c40-9565-12f171c22179/main/0.log"
Jul 16 00:56:17.160626 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:17.160575    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9w6gf_b5a86802-8113-42ea-aa36-498e3e37a8bf/global-pull-secret-syncer/0.log"
Jul 16 00:56:17.312361 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:17.312331    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gjvn5_8bd0ee6b-40df-4489-a633-7fc7f7797b88/konnectivity-agent/0.log"
Jul 16 00:56:17.381694 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:17.381667    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-233.ec2.internal_161e034c1359394ff1bdcb207faeb1e3/haproxy/0.log"
Jul 16 00:56:22.252624 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:22.252570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-svtqs_248e2b5a-0600-4236-a71f-583fd9c8e1f5/manager/0.log"
Jul 16 00:56:22.305293 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:22.305262    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kcpx7_14113433-17be-4477-acbc-92dc82d5d820/manager/0.log"
Jul 16 00:56:22.357184 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:22.357157    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fnzbf_5fb06c50-394f-49ce-beed-bb6db809ed58/kuadrant-console-plugin/0.log"
Jul 16 00:56:22.419990 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:22.419957    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v2cx9_155c8119-324f-4249-b5ba-001b2df24fd2/registry-server/0.log"
Jul 16 00:56:22.552112 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:22.552077    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9rrd6_54f74cfe-2064-4f42-b6c5-b8d92322b79f/manager/0.log"
Jul 16 00:56:22.664069 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:22.664036    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7dx9r_809c2a6f-a7e0-47d1-95d4-e884298bf2dd/manager/0.log"
Jul 16 00:56:24.292735 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.292703    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e0eec50-61f3-4156-8fba-fd0e018b0d54/alertmanager/0.log"
Jul 16 00:56:24.315751 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.315717    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e0eec50-61f3-4156-8fba-fd0e018b0d54/config-reloader/0.log"
Jul 16 00:56:24.340235 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.340211    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e0eec50-61f3-4156-8fba-fd0e018b0d54/kube-rbac-proxy-web/0.log"
Jul 16 00:56:24.364577 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.364553    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e0eec50-61f3-4156-8fba-fd0e018b0d54/kube-rbac-proxy/0.log"
Jul 16 00:56:24.390172 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.390139    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e0eec50-61f3-4156-8fba-fd0e018b0d54/kube-rbac-proxy-metric/0.log"
Jul 16 00:56:24.417357 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.417335    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e0eec50-61f3-4156-8fba-fd0e018b0d54/prom-label-proxy/0.log"
Jul 16 00:56:24.455327 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.455280    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6e0eec50-61f3-4156-8fba-fd0e018b0d54/init-config-reloader/0.log"
Jul 16 00:56:24.628765 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.628738    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65b5bbd795-dwffs_82c38067-c631-451d-aaae-408ea5b3d5f3/metrics-server/0.log"
Jul 16 00:56:24.926919 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.926835    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdktq_194f7b7c-0adf-45ec-9420-9b97fe752524/node-exporter/0.log"
Jul 16 00:56:24.949015 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.948976    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdktq_194f7b7c-0adf-45ec-9420-9b97fe752524/kube-rbac-proxy/0.log"
Jul 16 00:56:24.970584 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:24.970560    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdktq_194f7b7c-0adf-45ec-9420-9b97fe752524/init-textfile/0.log"
Jul 16 00:56:25.338979 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:25.338948    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5898fc968-9fmbl_35cda1e9-866f-4788-80f2-aeefa7f5fb61/telemeter-client/0.log"
Jul 16 00:56:25.359054 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:25.359025    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5898fc968-9fmbl_35cda1e9-866f-4788-80f2-aeefa7f5fb61/reload/0.log"
Jul 16 00:56:25.380819 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:25.380786    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5898fc968-9fmbl_35cda1e9-866f-4788-80f2-aeefa7f5fb61/kube-rbac-proxy/0.log"
Jul 16 00:56:26.687487 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.687452    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"]
Jul 16 00:56:26.688114 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.688094    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e5e12b-abd3-4d20-9bef-f62a606f65cd" containerName="main"
Jul 16 00:56:26.688114 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.688116    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e5e12b-abd3-4d20-9bef-f62a606f65cd" containerName="main"
Jul 16 00:56:26.688194 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.688128    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d002ea-322f-4a38-9083-96233b0fd6cf" containerName="main"
Jul 16 00:56:26.688194 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.688133    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d002ea-322f-4a38-9083-96233b0fd6cf" containerName="main"
Jul 16 00:56:26.688256 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.688212    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e5e12b-abd3-4d20-9bef-f62a606f65cd" containerName="main"
Jul 16 00:56:26.688256 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.688223    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d002ea-322f-4a38-9083-96233b0fd6cf" containerName="main"
Jul 16 00:56:26.691567 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.691544    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.694275 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.694252    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lvdqh\"/\"openshift-service-ca.crt\""
Jul 16 00:56:26.695230 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.695215    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lvdqh\"/\"kube-root-ca.crt\""
Jul 16 00:56:26.695283 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.695218    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lvdqh\"/\"default-dockercfg-zvzsp\""
Jul 16 00:56:26.701418 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.701384    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"]
Jul 16 00:56:26.788768 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.788729    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-lib-modules\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.788968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.788783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9j4t\" (UniqueName: \"kubernetes.io/projected/a14dacd4-6a45-4a78-8deb-4f50efb15b97-kube-api-access-n9j4t\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.788968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.788845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-proc\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.788968 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.788918    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-podres\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.789121 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.788970    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-sys\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890163 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-lib-modules\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890163 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890165    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9j4t\" (UniqueName: \"kubernetes.io/projected/a14dacd4-6a45-4a78-8deb-4f50efb15b97-kube-api-access-n9j4t\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890189    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-proc\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890220    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-podres\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-sys\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890287    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-proc\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890309    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-lib-modules\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890348    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-sys\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.890442 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.890357    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a14dacd4-6a45-4a78-8deb-4f50efb15b97-podres\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:26.898909 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:26.898885    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9j4t\" (UniqueName: \"kubernetes.io/projected/a14dacd4-6a45-4a78-8deb-4f50efb15b97-kube-api-access-n9j4t\") pod \"perf-node-gather-daemonset-4h7mn\" (UID: \"a14dacd4-6a45-4a78-8deb-4f50efb15b97\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:27.003742 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:27.003640    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:27.135277 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:27.135252    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"]
Jul 16 00:56:27.136794 ip-10-0-140-233 kubenswrapper[2556]: W0716 00:56:27.136763    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda14dacd4_6a45_4a78_8deb_4f50efb15b97.slice/crio-d5774448aa8a57b1f1818014e80251f549f08c17ad82bf94ad8d8b7eb50e56af WatchSource:0}: Error finding container d5774448aa8a57b1f1818014e80251f549f08c17ad82bf94ad8d8b7eb50e56af: Status 404 returned error can't find the container with id d5774448aa8a57b1f1818014e80251f549f08c17ad82bf94ad8d8b7eb50e56af
Jul 16 00:56:27.514264 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:27.514224    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn" event={"ID":"a14dacd4-6a45-4a78-8deb-4f50efb15b97","Type":"ContainerStarted","Data":"57480a56bc8e1f2e15b176707fe1bfc66b32d95889f1665daf295778d1be1eb9"}
Jul 16 00:56:27.514470 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:27.514282    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn" event={"ID":"a14dacd4-6a45-4a78-8deb-4f50efb15b97","Type":"ContainerStarted","Data":"d5774448aa8a57b1f1818014e80251f549f08c17ad82bf94ad8d8b7eb50e56af"}
Jul 16 00:56:27.514470 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:27.514331    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:27.532770 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:27.532715    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn" podStartSLOduration=1.532699543 podStartE2EDuration="1.532699543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:27.530210513 +0000 UTC m=+2593.101806816" watchObservedRunningTime="2026-07-16 00:56:27.532699543 +0000 UTC m=+2593.104295843"
Jul 16 00:56:27.815901 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:27.815874    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7876967cb5-tqxkm_56a3fe03-7a59-4e4d-979e-e3ad15bd351c/console/0.log"
Jul 16 00:56:29.452777 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:29.452748    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qxlqb_ca7a43bf-ae34-40f8-b956-ca74a7d00afd/dns/0.log"
Jul 16 00:56:29.473964 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:29.473929    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qxlqb_ca7a43bf-ae34-40f8-b956-ca74a7d00afd/kube-rbac-proxy/0.log"
Jul 16 00:56:29.549464 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:29.549433    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rlk2r_4677dd29-51b6-432c-a9e4-3f68e230926b/dns-node-resolver/0.log"
Jul 16 00:56:30.046932 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:30.046900    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-755b6c84bf-k4dh9_c7f0640e-2b7d-400c-94a0-8e53a7a3762b/registry/0.log"
Jul 16 00:56:30.067368 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:30.067335    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7r8gq_74346c98-2a0c-4a75-8ae1-cfc18955b9bb/node-ca/0.log"
Jul 16 00:56:31.178949 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:31.178916    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-7qmdx_b898ec25-4f39-4f15-a2cb-c7e5afd44fc1/kube-auth-proxy/0.log"
Jul 16 00:56:31.285635 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:31.285581    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-g74vt_659481d0-bfb1-4d5c-b613-17d07bc31934/payload-pre-processing/0.log"
Jul 16 00:56:31.315579 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:31.315549    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w6kl_e9f83428-5342-4907-9660-e57f2e0acccc/payload-processing/0.log"
Jul 16 00:56:31.999125 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:31.999094    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2vj8z_e8797115-44b2-452b-a8d6-57a20d7fe31a/serve-healthcheck-canary/0.log"
Jul 16 00:56:32.685258 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:32.685230    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsk2z_65608478-eba4-4ec8-b08b-5f4e56ef0fff/kube-rbac-proxy/0.log"
Jul 16 00:56:32.707636 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:32.707584    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsk2z_65608478-eba4-4ec8-b08b-5f4e56ef0fff/exporter/0.log"
Jul 16 00:56:32.728277 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:32.728253    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsk2z_65608478-eba4-4ec8-b08b-5f4e56ef0fff/extractor/0.log"
Jul 16 00:56:33.531653 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:33.531626    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-4h7mn"
Jul 16 00:56:34.733339 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:34.733267    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qhsq4_02beefdb-f393-47ec-9a92-ddd489c5ecc4/manager/0.log"
Jul 16 00:56:34.858760 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:34.858725    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9q26d_bb451007-9e82-4aa4-9414-470883dc89c1/manager/0.log"
Jul 16 00:56:34.946430 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:34.946396    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c45676cbf-42wd6_487ecbf3-4b7a-4bd4-beca-f96b7570157f/manager/0.log"
Jul 16 00:56:35.066593 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:35.066567    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-28l9m_1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b/manager/0.log"
Jul 16 00:56:35.090331 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:35.090308    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-28l9m_1e0ea0ed-b39b-4fa0-90ee-43c6c60a477b/copy-manifests/0.log"
Jul 16 00:56:36.772878 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:36.772851    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-7qmdx_b898ec25-4f39-4f15-a2cb-c7e5afd44fc1/kube-auth-proxy/0.log"
Jul 16 00:56:36.866619 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:36.866584    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-g74vt_659481d0-bfb1-4d5c-b613-17d07bc31934/payload-pre-processing/0.log"
Jul 16 00:56:36.890778 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:36.890745    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w6kl_e9f83428-5342-4907-9660-e57f2e0acccc/payload-processing/0.log"
Jul 16 00:56:38.307824 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:38.307794    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-7qmdx_b898ec25-4f39-4f15-a2cb-c7e5afd44fc1/kube-auth-proxy/0.log"
Jul 16 00:56:38.388470 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:38.388442    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-g74vt_659481d0-bfb1-4d5c-b613-17d07bc31934/payload-pre-processing/0.log"
Jul 16 00:56:38.408293 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:38.408267    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8w6kl_e9f83428-5342-4907-9660-e57f2e0acccc/payload-processing/0.log"
Jul 16 00:56:42.735560 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:42.735530    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh55z_209e3a07-8da7-4c79-9aee-87568a5f3c9d/kube-multus-additional-cni-plugins/0.log"
Jul 16 00:56:42.756328 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:42.756291    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh55z_209e3a07-8da7-4c79-9aee-87568a5f3c9d/egress-router-binary-copy/0.log"
Jul 16 00:56:42.780164 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:42.780131    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh55z_209e3a07-8da7-4c79-9aee-87568a5f3c9d/cni-plugins/0.log"
Jul 16 00:56:42.802252 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:42.802221    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh55z_209e3a07-8da7-4c79-9aee-87568a5f3c9d/bond-cni-plugin/0.log"
Jul 16 00:56:42.821659 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:42.821626    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh55z_209e3a07-8da7-4c79-9aee-87568a5f3c9d/routeoverride-cni/0.log"
Jul 16 00:56:42.840804 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:42.840781    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh55z_209e3a07-8da7-4c79-9aee-87568a5f3c9d/whereabouts-cni-bincopy/0.log"
Jul 16 00:56:42.864013 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:42.863989    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh55z_209e3a07-8da7-4c79-9aee-87568a5f3c9d/whereabouts-cni/0.log"
Jul 16 00:56:43.198717 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:43.198688    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b2hlj_e0dcedff-c06c-430c-943d-c125f46afe03/kube-multus/0.log"
Jul 16 00:56:43.275433 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:43.275405    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dsphw_6f6ddb13-cc71-4f4e-970d-82c5568b989a/network-metrics-daemon/0.log"
Jul 16 00:56:43.296355 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:43.296331    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dsphw_6f6ddb13-cc71-4f4e-970d-82c5568b989a/kube-rbac-proxy/0.log"
Jul 16 00:56:44.356132 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.356097    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-controller/0.log"
Jul 16 00:56:44.373299 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.373261    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/0.log"
Jul 16 00:56:44.373299 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.373282    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovn-acl-logging/1.log"
Jul 16 00:56:44.396487 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.396458    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/kube-rbac-proxy-node/0.log"
Jul 16 00:56:44.417506 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.417469    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/kube-rbac-proxy-ovn-metrics/0.log"
Jul 16 00:56:44.434891 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.434863    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/northd/0.log"
Jul 16 00:56:44.455007 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.454979    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/nbdb/0.log"
Jul 16 00:56:44.476715 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.476681    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/sbdb/0.log"
Jul 16 00:56:44.525768 ip-10-0-140-233 kubenswrapper[2556]: I0716 00:56:44.525736    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgxtj_13e4fcf0-4a19-49b4-99e4-6e18280585d4/ovnkube-controller/0.log"