Jul 08 19:21:34.752349 ip-10-0-136-213 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 19:21:34.752512 ip-10-0-136-213 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 19:21:34.752527 ip-10-0-136-213 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 19:21:34.752940 ip-10-0-136-213 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 19:21:44.926843 ip-10-0-136-213 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 19:21:44.926863 ip-10-0-136-213 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 19f2e8e0df34417b822f6ea929aee090 --
Jul 08 19:23:46.779073 ip-10-0-136-213 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 19:23:47.260250 ip-10-0-136-213 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 19:23:47.260250 ip-10-0-136-213 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 19:23:47.260250 ip-10-0-136-213 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 19:23:47.260250 ip-10-0-136-213 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 19:23:47.260250 ip-10-0-136-213 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 19:23:47.262267 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.262165    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 19:23:47.268153 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268135    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:23:47.268153 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268152    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268159    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268164    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268167    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268170    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268179    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268182    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268186    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268188    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268191    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268194    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268197    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268200    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268203    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268206    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268209    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268212    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268215    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268217    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:23:47.268231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268220    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268223    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268225    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268228    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268231    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268234    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268237    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268240    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268243    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268246    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268249    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268252    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268256    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268259    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268262    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268264    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268267    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268270    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268272    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268275    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:23:47.268753 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268278    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268281    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268283    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268286    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268289    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268291    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268295    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268297    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268300    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268303    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268305    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268308    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268311    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268314    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268317    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268320    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268323    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268328    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268331    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:23:47.269268 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268335    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268338    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268341    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268344    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268347    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268351    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268354    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268357    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268359    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268363    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268365    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268368    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268371    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268374    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268378    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268381    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268384    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268388    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268392    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268396    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:23:47.269824 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268399    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268401    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268404    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268407    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268410    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268413    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268416    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268419    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268422    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268425    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268428    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268430    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268433    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268436    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268438    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268441    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268444    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268447    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268450    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:23:47.270337 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.268453    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270556    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270573    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270577    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270581    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270585    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270589    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270592    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270595    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270598    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270601    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270604    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270608    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270613    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270616    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270620    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270623    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270626    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270629    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:23:47.270873 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270632    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270635    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270638    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270641    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270644    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270646    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270649    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270652    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270654    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270657    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270663    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270668    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270671    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270675    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270678    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270681    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270684    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270687    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270690    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270705    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:23:47.271382 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270709    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270712    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270715    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270718    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270724    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270728    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270731    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270734    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270737    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270741    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270744    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270747    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270749    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270752    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270755    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270758    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270761    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270763    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270766    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:23:47.271994 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270769    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270771    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270774    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270777    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270780    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270783    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270787    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270790    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270793    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270796    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270799    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270802    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270804    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270807    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270809    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270812    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270815    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270817    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270820    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270822    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:23:47.272570 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270825    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270828    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270830    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270833    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270836    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270838    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270841    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270844    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270846    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270849    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270851    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270864    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270867    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270869    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270872    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270875    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270878    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270882    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270885    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270888    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:23:47.273364 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270892    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.270895    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271294    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271299    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271302    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271305    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271308    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271311    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271315    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271317    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271320    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271323    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271325    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271328    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271331    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271334    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271336    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271339    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271342    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271345    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:23:47.273985 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271348    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271351    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271353    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271356    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271358    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271361    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271364    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271367    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271369    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271372    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271375    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271378    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271381    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271384    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271387    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271390    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271393    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271397    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271401    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:23:47.274575 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271404    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271408    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271411    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271415    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271418    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271421    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271424    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271427    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271429    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271432    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271435    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271438    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271440    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271443    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271446    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271448    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271451    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271453    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271456    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:23:47.275174 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271459    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271461    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271464    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271467    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271472    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271475    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271479    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271483    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271485    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271488    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271491    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271493    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271496    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271499    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271501    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271505    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271508    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271510    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271513    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271516    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:23:47.275760 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271518    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271521    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271524    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271526    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271529    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271532    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271534    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271537    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271539    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271543    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271545    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271548    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271550    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271553    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271556    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271558    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271561    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271564    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271568    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271570    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:23:47.276342 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271574    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271577    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.271580    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271667    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271678    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271688    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271712    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271717    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271720    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271725    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271729    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271733    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271736    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271740    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271744    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271747    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271750    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271754    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271758    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271761    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271764    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271768    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271771    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 19:23:47.276947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271775    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271778    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271782    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271786    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271789    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271793    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271796    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271801    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271805    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271808    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271811    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271815    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271819    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271822    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271826    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271829    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271832    2554 flags.go:64] FLAG: --enable-server="true"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271835    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271840    2554 flags.go:64] FLAG: --event-burst="100"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271843    2554 flags.go:64] FLAG: --event-qps="50"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271846    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271850    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271853    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271857    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 19:23:47.277563 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271860    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271863    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271867    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271870    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271873    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271876    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271879    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271882    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271885    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271888    2554 flags.go:64] FLAG: --feature-gates=""
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271892    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271896    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271900    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271903    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271907    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271910    2554 flags.go:64] FLAG: --help="false"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271914    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271917    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271921    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271924    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271928    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271932    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271935    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 19:23:47.278189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271938    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271940    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271944    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271947    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271950    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271953    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271956    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271959    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271962    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271965    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271968    2554 flags.go:64] FLAG: --lock-file=""
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271972    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271975    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271979    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271985    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271988    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271991    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271994    2554 flags.go:64] FLAG: --logging-format="text"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.271997    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272001    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272004    2554 flags.go:64] FLAG: --manifest-url=""
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272008    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272012    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272016    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272020    2554 flags.go:64] FLAG: --max-pods="110"
Jul 08 19:23:47.278896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272023    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272027    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272030    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272034    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272037    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272040    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272043    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272050    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272053    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272057    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272060    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272063    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272076    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272079    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272083    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272086    2554 flags.go:64] FLAG: --port="10250"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272089    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272092    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c7289f257395c71"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272096    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272099    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272102    2554 flags.go:64] FLAG: --register-node="true"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272109    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272118    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272121    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 08 19:23:47.279551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272125    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272128    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272132    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272137    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272141    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272144    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272147    2554 flags.go:64] FLAG: --runonce="false"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272151    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272154    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272157    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272161    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272164    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272168    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272171    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272175    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272178    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272181    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272184    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272187    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272190    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272193    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272196    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272201    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272204    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272207    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 19:23:47.280216 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272211    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272214    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272217    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272220    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272224    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272228    2554 flags.go:64] FLAG: --v="2"
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272232    2554 flags.go:64] FLAG: --version="false"
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272237    2554 flags.go:64] FLAG: --vmodule=""
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272240    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.272244    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275356    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275370    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275374    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275378    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275383    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275386    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275390    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275393    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275396    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275399    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275402    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275405    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:23:47.280924 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275408    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275411    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275413    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275416    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275419    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275422    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275425    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275428    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275431    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275433    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275436    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275439    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275442    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275446    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275450    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275454    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275459    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275462    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275465    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275468    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:23:47.281503 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275471    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275475    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275478    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275481    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275484    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275487    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275490    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275493    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275495    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275498    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275501    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275504    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275507    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275510    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275514    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275516    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275519    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275522    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275525    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275528    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:23:47.282049 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275531    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275534    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275537    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275540    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275544    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275548    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275551    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275554    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275556    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275560    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275563    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275566    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275569    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275572    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275574    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275577    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275580    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275583    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275586    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275588    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:23:47.282626 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275591    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275594    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275597    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275600    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275602    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275605    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275608    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275611    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275616    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275619    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275622    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275626    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275630    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275633    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275636    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275639    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275656    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275659    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275662    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275665    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:23:47.283168 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275668    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:23:47.283690 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275671    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:23:47.283690 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275674    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:23:47.283690 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275677    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:23:47.283690 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275679    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:23:47.283690 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275684    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:23:47.283690 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.275687    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:23:47.283690 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.276271    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 19:23:47.283900 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.283804    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 19:23:47.283900 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.283823    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 19:23:47.284816 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.284804    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 19:23:47.284856 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.284816    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 19:23:47.284887 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284877    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:23:47.284887 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284884    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284889    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284893    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284896    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284899    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284902    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284905    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284908    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284910    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284913    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284916    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284919    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284922    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284925    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284928    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284931    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284934    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284937    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284939    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284942    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:23:47.284944 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284945    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284948    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284951    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284954    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284958    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284960    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284963    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284966    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284970    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284973    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284976    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284978    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284981    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284984    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284987    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284990    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284992    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284995    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.284998    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285000    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:23:47.285448 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285003    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285006    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285008    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285011    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285014    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285017    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285019    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285022    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285025    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285029    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285034    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285038    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285042    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285045    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285049    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285052    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285055    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285058    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285061    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:23:47.285986 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285064    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285067    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285070    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285073    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285076    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285079    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285082    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285085    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285088    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285091    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285093    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285096    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285099    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285102    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285105    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285107    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285110    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285113    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285115    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:23:47.286470 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285118    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285121    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285124    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285127    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285129    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285133    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285136    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285138    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285142    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285145    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285148    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285150    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285153    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285156    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285159    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285162    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285169    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285172    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285175    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:23:47.287000 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285178    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.285183    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285307    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285312    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285316    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285319    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285322    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285325    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285328    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285331    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285333    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285336    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285339    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285342    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285345    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:23:47.287520 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285348    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285351    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285354    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285356    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285359    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285362    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285365    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285368    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285372    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285396    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285401    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285404    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285407    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285411    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285414    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285418    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285421    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285424    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285427    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285430    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:23:47.287928 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285433    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285435    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285438    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285441    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285444    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285447    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285449    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285452    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285455    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285458    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285461    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285464    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285467    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285470    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285473    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285475    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285478    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285481    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285484    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285487    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:23:47.288455 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285490    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285493    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285496    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285498    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285501    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285505    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285509    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285512    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285522    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285525    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285528    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285531    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285534    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285537    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285539    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285542    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285545    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285548    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285550    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:23:47.289008 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285553    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285556    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285559    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285561    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285564    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285567    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285571    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285574    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285578    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285581    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285584    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285587    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285590    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285592    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285595    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285598    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285601    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285603    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285606    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:23:47.289496 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285609    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285611    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285614    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285623    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285626    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285629    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285631    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:47.285634    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.285639    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.285794    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.287950    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.289639    2554 server.go:1019] "Starting client certificate rotation"
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.289753    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 19:23:47.289999 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.289792    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 19:23:47.292565 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.292551    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 19:23:47.293802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.293781    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 19:23:47.310420 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.310395    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 08 19:23:47.312629 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.312610    2554 log.go:25] "Validated CRI v1 image API"
Jul 08 19:23:47.313471 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.313454    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 19:23:47.316258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.316235    2554 fs.go:135] Filesystem UUIDs: map[3d3e5441-5207-48d5-98a2-f6a36755add6:/dev/nvme0n1p3 7994127e-ae45-4374-927c-3f1ea74db925:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 08 19:23:47.316325 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.316256    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 19:23:47.322166 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.322040    2554 manager.go:216] Machine: {Timestamp:2026-07-08 19:23:47.320290661 +0000 UTC m=+0.404064505 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107887 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de82d57d27b2512a0cb4e7fc04e1c SystemUUID:ec2de82d-57d2-7b25-12a0-cb4e7fc04e1c BootID:19f2e8e0-df34-417b-822f-6ea929aee090 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:ae:f6:8a:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:ae:f6:8a:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:16:da:8b:39:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 19:23:47.322166 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.322159    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 19:23:47.322287 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.322250    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 19:23:47.325588 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.325570    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 19:23:47.325887 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.325857    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 19:23:47.326045 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.325890    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 19:23:47.326684 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.326673    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 19:23:47.326736 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.326685    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 19:23:47.326736 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.326721    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 19:23:47.326736 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.326736    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 19:23:47.328334 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.328323    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 19:23:47.331454 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.331441    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 19:23:47.331593 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.331583    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 19:23:47.331627 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.331615    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 19:23:47.331662 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.331637    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 19:23:47.331662 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.331652    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 19:23:47.331662 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.331661    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 08 19:23:47.331764 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.331673    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 19:23:47.332108 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.332086    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 19:23:47.332154 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.332113    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 19:23:47.334553 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.334537    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 19:23:47.336488 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.336473    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 19:23:47.336549 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.336507    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 19:23:47.338297 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338284    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 19:23:47.338340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338303    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 19:23:47.338340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338309    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 19:23:47.338340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338316    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 19:23:47.338340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338326    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 19:23:47.338340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338332    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 19:23:47.338340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338340    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 19:23:47.338498 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338346    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 19:23:47.338498 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338352    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 19:23:47.338498 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338358    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 19:23:47.338498 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338367    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 19:23:47.338498 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.338373    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 19:23:47.339311 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.339301    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 19:23:47.339311 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.339311    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 19:23:47.342777 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.342763    2554 server.go:1268] "Started kubelet"
Jul 08 19:23:47.342857 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.342832    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 19:23:47.343389 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.343098    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 19:23:47.343389 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.343158    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 19:23:47.343791 ip-10-0-136-213 systemd[1]: Started Kubernetes Kubelet.
Jul 08 19:23:47.344445 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.344247    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 19:23:47.344445 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.344265    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 19:23:47.344445 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.344401    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 19:23:47.345208 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.345183    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 19:23:47.345554 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.345540    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 19:23:47.349087 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.349067    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 19:23:47.351786 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.351769    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 19:23:47.351874 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.351787    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 19:23:47.351874 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.351839    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:47.356476 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.351307    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-213.ec2.internal.18c066ee95f3986d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-213.ec2.internal,UID:ip-10-0-136-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-213.ec2.internal,},FirstTimestamp:2026-07-08 19:23:47.342735469 +0000 UTC m=+0.426509313,LastTimestamp:2026-07-08 19:23:47.342735469 +0000 UTC m=+0.426509313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-213.ec2.internal,}"
Jul 08 19:23:47.357137 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.356648    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 19:23:47.357137 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.356809    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 19:23:47.357137 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.357030    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 19:23:47.357137 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.357040    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 19:23:47.357351 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.357148    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 19:23:47.358199 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.357751    2554 factory.go:55] Registering systemd factory
Jul 08 19:23:47.358199 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.357773    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 08 19:23:47.358199 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.358162    2554 factory.go:153] Registering CRI-O factory
Jul 08 19:23:47.358199 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.358180    2554 factory.go:223] Registration of the crio container factory successfully
Jul 08 19:23:47.358612 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.358242    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 19:23:47.358612 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.358268    2554 factory.go:103] Registering Raw factory
Jul 08 19:23:47.358612 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.358286    2554 manager.go:1196] Started watching for new ooms in manager
Jul 08 19:23:47.359790 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.358985    2554 manager.go:349] Starting recovery of all containers
Jul 08 19:23:47.362899 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.362867    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 19:23:47.362995 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.362963    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 19:23:47.371249 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.371074    2554 manager.go:354] Recovery completed
Jul 08 19:23:47.375706 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.375678    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:23:47.377799 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.377777    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xscqh"
Jul 08 19:23:47.377875 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.377836    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:23:47.377875 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.377866    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:23:47.377875 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.377876    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:23:47.378413 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.378398    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 19:23:47.378413 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.378412    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 19:23:47.378535 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.378430    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:23:47.378535 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.378432    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 19:23:47.379306 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.379279    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:23:47.379353 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.379315    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:23:47.379353 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.379332    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:23:47.379896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.379883    2554 policy_none.go:49] "None policy: Start"
Jul 08 19:23:47.379941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.379900    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 19:23:47.379941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.379912    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 19:23:47.380604 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.380511    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-213.ec2.internal.18c066ee980b66ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-213.ec2.internal,UID:ip-10-0-136-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-213.ec2.internal,},FirstTimestamp:2026-07-08 19:23:47.377850111 +0000 UTC m=+0.461623955,LastTimestamp:2026-07-08 19:23:47.377850111 +0000 UTC m=+0.461623955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-213.ec2.internal,}"
Jul 08 19:23:47.381075 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.381062    2554 policy_none.go:47] "Start"
Jul 08 19:23:47.386973 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.386958    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xscqh"
Jul 08 19:23:47.414279 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.414262    2554 manager.go:337] "Starting Device Plugin manager"
Jul 08 19:23:47.414367 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.414292    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 19:23:47.414367 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.414302    2554 server.go:87] "Starting device plugin registration server"
Jul 08 19:23:47.414580 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.414557    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 19:23:47.414657 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.414573    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 19:23:47.414730 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.414674    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 19:23:47.414785 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.414754    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 19:23:47.414785 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.414761    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 19:23:47.415413 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.415392    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 19:23:47.415489 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.415451    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:47.489920 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.489872    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 19:23:47.491230 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.491213    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 19:23:47.491294 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.491254    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 19:23:47.491294 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.491282    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 19:23:47.491388 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.491328    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 19:23:47.494114 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.494094    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:23:47.516084 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.516023    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:23:47.517136 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.517121    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:23:47.517215 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.517150    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:23:47.517215 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.517163    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:23:47.517215 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.517188    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.527239 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.527219    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.527319 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.527244    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-213.ec2.internal\": node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:47.557552 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.557516    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:47.592463 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.592430    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal"]
Jul 08 19:23:47.592621 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.592528    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:23:47.593536 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.593517    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:23:47.593643 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.593556    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:23:47.593643 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.593570    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:23:47.595096 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595078    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:23:47.595211 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595196    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.595262 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595229    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:23:47.595840 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595824    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:23:47.595922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595852    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:23:47.595922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595862    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:23:47.595922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595824    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:23:47.596028 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595932    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:23:47.596028 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.595942    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:23:47.598745 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.598725    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.598841 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.598755    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:23:47.599499 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.599483    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:23:47.599573 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.599517    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:23:47.599573 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.599530    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:23:47.623514 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.623496    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-213.ec2.internal\" not found" node="ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.628593 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.628579    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-213.ec2.internal\" not found" node="ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.658247 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.658206    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:47.658684 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.658661    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.658791 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.658694    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8afef05007b8d8fcc1b2b5da41446350-config\") pod \"kube-apiserver-proxy-ip-10-0-136-213.ec2.internal\" (UID: \"8afef05007b8d8fcc1b2b5da41446350\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.658791 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.658714    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.759263 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.759197    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:47.759263 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.759245    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.759263 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.759277    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.759524 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.759298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8afef05007b8d8fcc1b2b5da41446350-config\") pod \"kube-apiserver-proxy-ip-10-0-136-213.ec2.internal\" (UID: \"8afef05007b8d8fcc1b2b5da41446350\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.759524 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.759347    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8afef05007b8d8fcc1b2b5da41446350-config\") pod \"kube-apiserver-proxy-ip-10-0-136-213.ec2.internal\" (UID: \"8afef05007b8d8fcc1b2b5da41446350\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.759524 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.759354    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.759524 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.759364    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.859941 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.859870    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:47.928584 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.928552    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.932969 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:47.932703    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:47.960905 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:47.960878    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.062388 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.062336    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.163390 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.163308    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.263545 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.263503    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.289665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.289605    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 19:23:48.289824 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.289802    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 19:23:48.322777 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.322753    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:23:48.355184 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.355158    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:23:48.364331 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.364306    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.388484 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.388438    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 19:18:48 +0000 UTC" deadline="2028-03-14 11:27:19.588127245 +0000 UTC"
Jul 08 19:23:48.388484 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.388476    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14752h3m31.199655024s"
Jul 08 19:23:48.464945 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.464858    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.566024 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.565985    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.666592 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.666557    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.705610 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:48.705577    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb9d98d9c0e675fe807d55fcbd0e30a.slice/crio-d07760856409c7c387054cc94964ee8c9c2bcc2843b725a6822b7764df037419 WatchSource:0}: Error finding container d07760856409c7c387054cc94964ee8c9c2bcc2843b725a6822b7764df037419: Status 404 returned error can't find the container with id d07760856409c7c387054cc94964ee8c9c2bcc2843b725a6822b7764df037419
Jul 08 19:23:48.705983 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:48.705958    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afef05007b8d8fcc1b2b5da41446350.slice/crio-293d7ff1c601bdcfefd36c24f7cbd2c1c2d833a44e462180c990b2df230bcd53 WatchSource:0}: Error finding container 293d7ff1c601bdcfefd36c24f7cbd2c1c2d833a44e462180c990b2df230bcd53: Status 404 returned error can't find the container with id 293d7ff1c601bdcfefd36c24f7cbd2c1c2d833a44e462180c990b2df230bcd53
Jul 08 19:23:48.712046 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.712024    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 19:23:48.767795 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.767702    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.868454 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:48.868412    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found"
Jul 08 19:23:48.929521 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.929490    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:23:48.956668 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.956635    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:48.974232 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.974207    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 19:23:48.975386 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.975372    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal"
Jul 08 19:23:48.982869 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:48.982855    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 19:23:49.333805 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.333769    2554 apiserver.go:52] "Watching apiserver"
Jul 08 19:23:49.341157 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.341131    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 19:23:49.341497 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.341476    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-8xt7n","openshift-ovn-kubernetes/ovnkube-node-vtqcg","kube-system/konnectivity-agent-nrcb5","kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff","openshift-cluster-node-tuning-operator/tuned-hlsrp","openshift-image-registry/node-ca-wchgt","openshift-multus/multus-additional-cni-plugins-l7k5q","openshift-multus/multus-qr5fs","openshift-multus/network-metrics-daemon-svtnq","kube-system/global-pull-secret-syncer-dkd8x","openshift-dns/node-resolver-rmxfc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal","openshift-network-diagnostics/network-check-target-tcmjl"]
Jul 08 19:23:49.343660 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.343645    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:49.343732 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.343714    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:23:49.344772 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.344752    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.344875 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.344822    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:23:49.345826 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.345810    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.347026 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.347008    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:49.347093 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.347076    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:23:49.347940 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.347920    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 19:23:49.348027 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.347964    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 19:23:49.348027 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.347954    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hjlnm\""
Jul 08 19:23:49.348758 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.348741    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.349947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.349932    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.351725 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.351214    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 19:23:49.351725 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.351321    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 19:23:49.351725 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.351577    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nngx2\""
Jul 08 19:23:49.351725 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.351639    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 19:23:49.353635 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.352071    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:23:49.353635 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.352094    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 19:23:49.353635 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.352141    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4rjmq\""
Jul 08 19:23:49.354063 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.353924    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.355915 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.355890    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.356671 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.356652    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 19:23:49.356802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.356748    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7cf7x\""
Jul 08 19:23:49.356802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.356759    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 19:23:49.356947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.356802    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 19:23:49.356947 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.356808    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 19:23:49.357370 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.357345    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.357915 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.357899    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 19:23:49.358039 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.358022    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7nsz9\""
Jul 08 19:23:49.358111 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.358057    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 19:23:49.358258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.358244    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 19:23:49.358962 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.358943    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.359726 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.359687    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 19:23:49.359909 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.359893    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sblpj\""
Jul 08 19:23:49.360037 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.360016    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 19:23:49.360489 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.360471    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.361077 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361026    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 19:23:49.361287 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361259    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 19:23:49.361386 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361348    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:23:49.361484 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361396    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 19:23:49.361553 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361488    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 19:23:49.361709 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361689    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kctj9\""
Jul 08 19:23:49.361817 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361779    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 19:23:49.361889 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.361874    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 19:23:49.362130 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.362099    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.362731 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.362713    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 19:23:49.362914 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.362896    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jmcm6\""
Jul 08 19:23:49.363169 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.363150    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 19:23:49.363244 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.363213    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 19:23:49.364235 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.364218    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltrq6\""
Jul 08 19:23:49.364312 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.364256    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 19:23:49.364552 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.364536    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 19:23:49.367440 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.367421    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 19:23:49.372041 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372022    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.372135 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372048    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-socket-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.372135 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372066    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-registration-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.372135 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372091    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-slash\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372135 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372116    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-ovnkube-config\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372300 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372145    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-conf-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.372300 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372300 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7920a1e-1707-4ea8-b643-bc41f37ae37c-kubelet-config\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.372300 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysctl-conf\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372300 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372280    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-run\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372308    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-var-lib-kubelet\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372326    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-tmp\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372345    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-socket-dir-parent\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzh6l\" (UniqueName: \"kubernetes.io/projected/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-kube-api-access-pzh6l\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372400    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372432    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-host-slash\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372450    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4x4s\" (UniqueName: \"kubernetes.io/projected/e715f486-90f1-47dd-84e1-b11d8ea3f690-kube-api-access-w4x4s\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-system-cni-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.372503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372487    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-cni-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372511    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-kubelet\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372535    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-systemd-units\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372552    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372569    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-env-overrides\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372589    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-ovnkube-script-lib\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372620    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-cni-bin\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372654    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-log-socket\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372670    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-cni-netd\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372688    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysconfig\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372729    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-kubernetes\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372756    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-sys\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372774    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-lib-modules\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372797    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpcb6\" (UniqueName: \"kubernetes.io/projected/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-kube-api-access-kpcb6\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372814    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372831    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cni-binary-copy\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.372954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372845    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-systemd\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372862    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-etc-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372882    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372911    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-device-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372940    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/691d9e19-0679-47a8-8740-143a58393343-agent-certs\") pod \"konnectivity-agent-nrcb5\" (UID: \"691d9e19-0679-47a8-8740-143a58393343\") " pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372960    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.372991    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-kubelet\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373015    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-node-log\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373041    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-os-release\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373060    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrs49\" (UniqueName: \"kubernetes.io/projected/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-kube-api-access-hrs49\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373075    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-os-release\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373090    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysctl-d\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373111    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-tuned\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373131    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv7hz\" (UniqueName: \"kubernetes.io/projected/e4a36369-143a-414b-909d-255562a484f9-kube-api-access-cv7hz\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373162    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-netns\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373194    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-run-netns\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.373796 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373217    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373234    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-sys-fs\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373249    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-ovn\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373273    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-cni-bin\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373303    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvrmv\" (UniqueName: \"kubernetes.io/projected/b0e10660-e154-485b-b2fa-9a0abc79af19-kube-api-access-dvrmv\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373332    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-system-cni-dir\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373351    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-hostroot\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373382    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-modprobe-d\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373400    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-cnibin\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373416    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-cni-multus\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373447    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/691d9e19-0679-47a8-8740-143a58393343-konnectivity-ca\") pod \"konnectivity-agent-nrcb5\" (UID: \"691d9e19-0679-47a8-8740-143a58393343\") " pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-multus-certs\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373482    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-systemd\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cnibin\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373532    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373554    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-etc-kubernetes\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.374665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373571    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg745\" (UniqueName: \"kubernetes.io/projected/c68a9266-bb64-4c55-8d31-09cc84852974-kube-api-access-bg745\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373599    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7920a1e-1707-4ea8-b643-bc41f37ae37c-dbus\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373641    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-iptables-alerter-script\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373661    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0e10660-e154-485b-b2fa-9a0abc79af19-ovn-node-metrics-cert\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373676    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c68a9266-bb64-4c55-8d31-09cc84852974-cni-binary-copy\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373708    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-k8s-cni-cncf-io\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373727    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c68a9266-bb64-4c55-8d31-09cc84852974-multus-daemon-config\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373747    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-var-lib-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373762    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.375727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.373788    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-host\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.394916 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.394895    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xjsk"
Jul 08 19:23:49.402820 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.402799    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xjsk"
Jul 08 19:23:49.458839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.458819    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 19:23:49.474533 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474499    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474539    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cni-binary-copy\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-systemd\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474588    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-etc-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474630    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474667    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-systemd\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxtv6\" (UniqueName: \"kubernetes.io/projected/7bd296cb-0758-49ec-86bd-cec21f806e35-kube-api-access-cxtv6\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.474685    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:49.474705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-device-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474722    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-etc-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474733    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/691d9e19-0679-47a8-8740-143a58393343-agent-certs\") pod \"konnectivity-agent-nrcb5\" (UID: \"691d9e19-0679-47a8-8740-143a58393343\") " pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.474779    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:49.974753746 +0000 UTC m=+3.058527590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-kubelet\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474827    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-device-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474878    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-kubelet\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474913    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-node-log\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474943    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-os-release\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474979    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrs49\" (UniqueName: \"kubernetes.io/projected/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-kube-api-access-hrs49\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.474980    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-node-log\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-os-release\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475037    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysctl-d\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475058    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-os-release\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.475119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475119    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-os-release\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475150    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475190    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysctl-d\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475192    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-tuned\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475200    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cni-binary-copy\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475209    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv7hz\" (UniqueName: \"kubernetes.io/projected/e4a36369-143a-414b-909d-255562a484f9-kube-api-access-cv7hz\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-netns\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475306    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-run-netns\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475333    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-sys-fs\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475367    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-netns\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475383    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-ovn\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475385    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-run-netns\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-cni-bin\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475436    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvrmv\" (UniqueName: \"kubernetes.io/projected/b0e10660-e154-485b-b2fa-9a0abc79af19-kube-api-access-dvrmv\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475449    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-sys-fs\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475462    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-system-cni-dir\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.475802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475471    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-ovn\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475485    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475492    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98n4p\" (UniqueName: \"kubernetes.io/projected/442201d0-2162-400c-914b-a9e257242a4b-kube-api-access-98n4p\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475499    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-cni-bin\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475555    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-hostroot\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475597    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-modprobe-d\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/442201d0-2162-400c-914b-a9e257242a4b-hosts-file\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475699    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-system-cni-dir\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475696    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-hostroot\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475733    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-cnibin\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475780    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-modprobe-d\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475816    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-cni-multus\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475846    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-cnibin\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475878    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/691d9e19-0679-47a8-8740-143a58393343-konnectivity-ca\") pod \"konnectivity-agent-nrcb5\" (UID: \"691d9e19-0679-47a8-8740-143a58393343\") " pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-multus-certs\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475931    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-cni-multus\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.475988    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-systemd\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476019    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-systemd\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.476577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476052    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cnibin\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476081    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476122    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-etc-kubernetes\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476144    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg745\" (UniqueName: \"kubernetes.io/projected/c68a9266-bb64-4c55-8d31-09cc84852974-kube-api-access-bg745\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476143    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-multus-certs\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476203    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7920a1e-1707-4ea8-b643-bc41f37ae37c-dbus\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476234    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-iptables-alerter-script\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476274    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442201d0-2162-400c-914b-a9e257242a4b-tmp-dir\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476304    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0e10660-e154-485b-b2fa-9a0abc79af19-ovn-node-metrics-cert\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476387    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/691d9e19-0679-47a8-8740-143a58393343-konnectivity-ca\") pod \"konnectivity-agent-nrcb5\" (UID: \"691d9e19-0679-47a8-8740-143a58393343\") " pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476413    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7920a1e-1707-4ea8-b643-bc41f37ae37c-dbus\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.476943    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-iptables-alerter-script\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477007    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-etc-kubernetes\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477053    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-cnibin\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477072    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477107    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c68a9266-bb64-4c55-8d31-09cc84852974-cni-binary-copy\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-k8s-cni-cncf-io\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.477469 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477159    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477189    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477230    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-run-k8s-cni-cncf-io\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477214    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c68a9266-bb64-4c55-8d31-09cc84852974-multus-daemon-config\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477269    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-var-lib-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477370    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-host\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477481    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477530    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-socket-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477559    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-registration-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477596    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-host\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477614    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-slash\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477665    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-var-lib-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477669    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-ovnkube-config\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477709    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-run-openvswitch\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477763    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-registration-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477764    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c68a9266-bb64-4c55-8d31-09cc84852974-multus-daemon-config\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.478378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477746    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7bd296cb-0758-49ec-86bd-cec21f806e35-serviceca\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477826    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-conf-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.477848    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477879    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.477918    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret podName:a7920a1e-1707-4ea8-b643-bc41f37ae37c nodeName:}" failed. No retries permitted until 2026-07-08 19:23:49.977900774 +0000 UTC m=+3.061674623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret") pod "global-pull-secret-syncer-dkd8x" (UID: "a7920a1e-1707-4ea8-b643-bc41f37ae37c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477942    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7920a1e-1707-4ea8-b643-bc41f37ae37c-kubelet-config\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477953    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477973    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysctl-conf\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.477998    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-run\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478003    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-conf-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478024    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-var-lib-kubelet\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-tmp\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478070    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-socket-dir-parent\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478069    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c68a9266-bb64-4c55-8d31-09cc84852974-cni-binary-copy\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478094    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzh6l\" (UniqueName: \"kubernetes.io/projected/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-kube-api-access-pzh6l\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478137    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-slash\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478168    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.479288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478194    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-host-slash\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478216    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bd296cb-0758-49ec-86bd-cec21f806e35-host\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478241    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4x4s\" (UniqueName: \"kubernetes.io/projected/e715f486-90f1-47dd-84e1-b11d8ea3f690-kube-api-access-w4x4s\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478294    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-system-cni-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478321    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-cni-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478354    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7920a1e-1707-4ea8-b643-bc41f37ae37c-kubelet-config\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478355    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-ovnkube-config\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478415    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-kubelet\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478440    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-systemd-units\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478444    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4a36369-143a-414b-909d-255562a484f9-socket-dir\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478435    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-var-lib-kubelet\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478514    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478537    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-system-cni-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478583    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-host-slash\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478624    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478661    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysctl-conf\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478464    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478687    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-cni-dir\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.479941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478709    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-run\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478747    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-kubelet\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478785    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-systemd-units\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478793    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-multus-socket-dir-parent\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478863    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-env-overrides\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478877    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-tuned\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478896    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-ovnkube-script-lib\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478924    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-cni-bin\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478950    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-log-socket\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478973    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-cni-netd\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.478999    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysconfig\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479022    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-kubernetes\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479048    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-sys\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479073    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-lib-modules\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpcb6\" (UniqueName: \"kubernetes.io/projected/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-kube-api-access-kpcb6\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479186    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/691d9e19-0679-47a8-8740-143a58393343-agent-certs\") pod \"konnectivity-agent-nrcb5\" (UID: \"691d9e19-0679-47a8-8740-143a58393343\") " pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479024    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0e10660-e154-485b-b2fa-9a0abc79af19-ovn-node-metrics-cert\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479278    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-host-cni-netd\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.480530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479050    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b0e10660-e154-485b-b2fa-9a0abc79af19-log-socket\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479307    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-env-overrides\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479324    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-sysconfig\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479368    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b0e10660-e154-485b-b2fa-9a0abc79af19-ovnkube-script-lib\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479367    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-etc-kubernetes\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479372    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-sys\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479397    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-lib-modules\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.479408    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c68a9266-bb64-4c55-8d31-09cc84852974-host-var-lib-cni-bin\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.481139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.480163    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-tmp\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.482535 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.482514    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:23:49.482535 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.482538    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:23:49.482718 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.482553    2554 projected.go:196] Error preparing data for projected volume kube-api-access-hd8v4 for pod openshift-network-diagnostics/network-check-target-tcmjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:49.482718 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.482649    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4 podName:c1e7bc80-d582-4815-89d6-143115cafb84 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:49.982632461 +0000 UTC m=+3.066406310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hd8v4" (UniqueName: "kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4") pod "network-check-target-tcmjl" (UID: "c1e7bc80-d582-4815-89d6-143115cafb84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:49.484072 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.484044    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrs49\" (UniqueName: \"kubernetes.io/projected/9ef6dda8-01b0-4d0f-b3fb-0524145ba196-kube-api-access-hrs49\") pod \"multus-additional-cni-plugins-l7k5q\" (UID: \"9ef6dda8-01b0-4d0f-b3fb-0524145ba196\") " pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.484448 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.484432    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvrmv\" (UniqueName: \"kubernetes.io/projected/b0e10660-e154-485b-b2fa-9a0abc79af19-kube-api-access-dvrmv\") pod \"ovnkube-node-vtqcg\" (UID: \"b0e10660-e154-485b-b2fa-9a0abc79af19\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.484552 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.484534    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg745\" (UniqueName: \"kubernetes.io/projected/c68a9266-bb64-4c55-8d31-09cc84852974-kube-api-access-bg745\") pod \"multus-qr5fs\" (UID: \"c68a9266-bb64-4c55-8d31-09cc84852974\") " pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.485025 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.485006    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv7hz\" (UniqueName: \"kubernetes.io/projected/e4a36369-143a-414b-909d-255562a484f9-kube-api-access-cv7hz\") pod \"aws-ebs-csi-driver-node-gwnff\" (UID: \"e4a36369-143a-414b-909d-255562a484f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.485654 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.485638    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzh6l\" (UniqueName: \"kubernetes.io/projected/a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710-kube-api-access-pzh6l\") pod \"tuned-hlsrp\" (UID: \"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710\") " pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.486577 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.486561    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4x4s\" (UniqueName: \"kubernetes.io/projected/e715f486-90f1-47dd-84e1-b11d8ea3f690-kube-api-access-w4x4s\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:49.489865 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.489841    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpcb6\" (UniqueName: \"kubernetes.io/projected/22e687a3-a7d0-4510-b05f-ade17b1ca4bb-kube-api-access-kpcb6\") pod \"iptables-alerter-8xt7n\" (UID: \"22e687a3-a7d0-4510-b05f-ade17b1ca4bb\") " pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.496293 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.496253    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" event={"ID":"ffb9d98d9c0e675fe807d55fcbd0e30a","Type":"ContainerStarted","Data":"d07760856409c7c387054cc94964ee8c9c2bcc2843b725a6822b7764df037419"}
Jul 08 19:23:49.497316 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.497297    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" event={"ID":"8afef05007b8d8fcc1b2b5da41446350","Type":"ContainerStarted","Data":"293d7ff1c601bdcfefd36c24f7cbd2c1c2d833a44e462180c990b2df230bcd53"}
Jul 08 19:23:49.579566 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.579514    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442201d0-2162-400c-914b-a9e257242a4b-tmp-dir\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.579773 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.579585    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7bd296cb-0758-49ec-86bd-cec21f806e35-serviceca\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.579773 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.579620    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bd296cb-0758-49ec-86bd-cec21f806e35-host\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.579773 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.579683    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxtv6\" (UniqueName: \"kubernetes.io/projected/7bd296cb-0758-49ec-86bd-cec21f806e35-kube-api-access-cxtv6\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.579952 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.579903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98n4p\" (UniqueName: \"kubernetes.io/projected/442201d0-2162-400c-914b-a9e257242a4b-kube-api-access-98n4p\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.580091 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.579743    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bd296cb-0758-49ec-86bd-cec21f806e35-host\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.580091 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.579978    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/442201d0-2162-400c-914b-a9e257242a4b-hosts-file\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.580207 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.580144    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7bd296cb-0758-49ec-86bd-cec21f806e35-serviceca\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.580207 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.580159    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/442201d0-2162-400c-914b-a9e257242a4b-tmp-dir\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.580207 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.580172    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/442201d0-2162-400c-914b-a9e257242a4b-hosts-file\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.588599 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.588529    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98n4p\" (UniqueName: \"kubernetes.io/projected/442201d0-2162-400c-914b-a9e257242a4b-kube-api-access-98n4p\") pod \"node-resolver-rmxfc\" (UID: \"442201d0-2162-400c-914b-a9e257242a4b\") " pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.588928 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.588906    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxtv6\" (UniqueName: \"kubernetes.io/projected/7bd296cb-0758-49ec-86bd-cec21f806e35-kube-api-access-cxtv6\") pod \"node-ca-wchgt\" (UID: \"7bd296cb-0758-49ec-86bd-cec21f806e35\") " pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.656749 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.656715    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:23:49.664382 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.664157    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff"
Jul 08 19:23:49.667562 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.667528    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691d9e19_0679_47a8_8740_143a58393343.slice/crio-78b25ab3bb5d4d0a7f73c90babaabac71339e8afc063c9707999f540c47ede8f WatchSource:0}: Error finding container 78b25ab3bb5d4d0a7f73c90babaabac71339e8afc063c9707999f540c47ede8f: Status 404 returned error can't find the container with id 78b25ab3bb5d4d0a7f73c90babaabac71339e8afc063c9707999f540c47ede8f
Jul 08 19:23:49.672734 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.672682    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:23:49.679542 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.679519    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlsrp"
Jul 08 19:23:49.684015 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.683864    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qr5fs"
Jul 08 19:23:49.684389 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.684353    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a36369_143a_414b_909d_255562a484f9.slice/crio-37b4cd6e51358b2f7a8b6a89713cf94e17db64763d8b2c23d83df87150bc5656 WatchSource:0}: Error finding container 37b4cd6e51358b2f7a8b6a89713cf94e17db64763d8b2c23d83df87150bc5656: Status 404 returned error can't find the container with id 37b4cd6e51358b2f7a8b6a89713cf94e17db64763d8b2c23d83df87150bc5656
Jul 08 19:23:49.690519 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.690498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l7k5q"
Jul 08 19:23:49.692331 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.692294    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ee9e6b_c6a1_453a_8e8d_75c3e6ec6710.slice/crio-22932b6fc6d346b233e4e23fa9be7ee0b2984af7631643ec9f22e09d96c47437 WatchSource:0}: Error finding container 22932b6fc6d346b233e4e23fa9be7ee0b2984af7631643ec9f22e09d96c47437: Status 404 returned error can't find the container with id 22932b6fc6d346b233e4e23fa9be7ee0b2984af7631643ec9f22e09d96c47437
Jul 08 19:23:49.694790 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.694767    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e10660_e154_485b_b2fa_9a0abc79af19.slice/crio-ea5d52872afe85e6bd217ccc994d8b8bfc49ab4d7cb623e5a1fe203dd72c1e65 WatchSource:0}: Error finding container ea5d52872afe85e6bd217ccc994d8b8bfc49ab4d7cb623e5a1fe203dd72c1e65: Status 404 returned error can't find the container with id ea5d52872afe85e6bd217ccc994d8b8bfc49ab4d7cb623e5a1fe203dd72c1e65
Jul 08 19:23:49.696596 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.696576    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xt7n"
Jul 08 19:23:49.701779 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.701759    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wchgt"
Jul 08 19:23:49.707523 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.707491    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68a9266_bb64_4c55_8d31_09cc84852974.slice/crio-53f9cf3f02cd713bb5d46905513f10e6b90330122336dc9e929c7b0bdbe2ad41 WatchSource:0}: Error finding container 53f9cf3f02cd713bb5d46905513f10e6b90330122336dc9e929c7b0bdbe2ad41: Status 404 returned error can't find the container with id 53f9cf3f02cd713bb5d46905513f10e6b90330122336dc9e929c7b0bdbe2ad41
Jul 08 19:23:49.708813 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.708794    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rmxfc"
Jul 08 19:23:49.709048 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.709023    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef6dda8_01b0_4d0f_b3fb_0524145ba196.slice/crio-e415350adb27b0c6b71342786bb75eef82d3b62ba2af3755bceed20188ef39a1 WatchSource:0}: Error finding container e415350adb27b0c6b71342786bb75eef82d3b62ba2af3755bceed20188ef39a1: Status 404 returned error can't find the container with id e415350adb27b0c6b71342786bb75eef82d3b62ba2af3755bceed20188ef39a1
Jul 08 19:23:49.714216 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.714187    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e687a3_a7d0_4510_b05f_ade17b1ca4bb.slice/crio-f2944ef5e188c8fc18b5b2930171e4fa398852849045201fa6c9e433c5a042ce WatchSource:0}: Error finding container f2944ef5e188c8fc18b5b2930171e4fa398852849045201fa6c9e433c5a042ce: Status 404 returned error can't find the container with id f2944ef5e188c8fc18b5b2930171e4fa398852849045201fa6c9e433c5a042ce
Jul 08 19:23:49.725932 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.725906    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd296cb_0758_49ec_86bd_cec21f806e35.slice/crio-8058c51040f4b1bfdb561bb774380cb2f6c3cad8e130502067c4215ea9971cfa WatchSource:0}: Error finding container 8058c51040f4b1bfdb561bb774380cb2f6c3cad8e130502067c4215ea9971cfa: Status 404 returned error can't find the container with id 8058c51040f4b1bfdb561bb774380cb2f6c3cad8e130502067c4215ea9971cfa
Jul 08 19:23:49.728857 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:23:49.728835    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442201d0_2162_400c_914b_a9e257242a4b.slice/crio-5dddb1e32d585ba0c41c282901be449e222bf885d218e61f7bf1ef9568824af1 WatchSource:0}: Error finding container 5dddb1e32d585ba0c41c282901be449e222bf885d218e61f7bf1ef9568824af1: Status 404 returned error can't find the container with id 5dddb1e32d585ba0c41c282901be449e222bf885d218e61f7bf1ef9568824af1
Jul 08 19:23:49.817299 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.817265    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:23:49.983547 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.983454    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:49.983547 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.983521    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:49.983553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983648    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983678    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983698    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983711    2554 projected.go:196] Error preparing data for projected volume kube-api-access-hd8v4 for pod openshift-network-diagnostics/network-check-target-tcmjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983726    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret podName:a7920a1e-1707-4ea8-b643-bc41f37ae37c nodeName:}" failed. No retries permitted until 2026-07-08 19:23:50.983705291 +0000 UTC m=+4.067479139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret") pod "global-pull-secret-syncer-dkd8x" (UID: "a7920a1e-1707-4ea8-b643-bc41f37ae37c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983736    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:49.983805 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983748    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4 podName:c1e7bc80-d582-4815-89d6-143115cafb84 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:50.983736661 +0000 UTC m=+4.067510504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd8v4" (UniqueName: "kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4") pod "network-check-target-tcmjl" (UID: "c1e7bc80-d582-4815-89d6-143115cafb84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:49.984145 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:49.983821    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:50.983802424 +0000 UTC m=+4.067576271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:50.407314 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.407173    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:18:49 +0000 UTC" deadline="2028-01-16 21:01:48.637674002 +0000 UTC"
Jul 08 19:23:50.407314 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.407213    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13369h37m58.230466633s"
Jul 08 19:23:50.492413 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.492088    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:50.492413 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.492236    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:23:50.505219 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.505096    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wchgt" event={"ID":"7bd296cb-0758-49ec-86bd-cec21f806e35","Type":"ContainerStarted","Data":"8058c51040f4b1bfdb561bb774380cb2f6c3cad8e130502067c4215ea9971cfa"}
Jul 08 19:23:50.507573 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.507490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xt7n" event={"ID":"22e687a3-a7d0-4510-b05f-ade17b1ca4bb","Type":"ContainerStarted","Data":"f2944ef5e188c8fc18b5b2930171e4fa398852849045201fa6c9e433c5a042ce"}
Jul 08 19:23:50.509373 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.509272    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerStarted","Data":"e415350adb27b0c6b71342786bb75eef82d3b62ba2af3755bceed20188ef39a1"}
Jul 08 19:23:50.512417 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.512347    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qr5fs" event={"ID":"c68a9266-bb64-4c55-8d31-09cc84852974","Type":"ContainerStarted","Data":"53f9cf3f02cd713bb5d46905513f10e6b90330122336dc9e929c7b0bdbe2ad41"}
Jul 08 19:23:50.514363 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.514307    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nrcb5" event={"ID":"691d9e19-0679-47a8-8740-143a58393343","Type":"ContainerStarted","Data":"78b25ab3bb5d4d0a7f73c90babaabac71339e8afc063c9707999f540c47ede8f"}
Jul 08 19:23:50.516148 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.516080    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rmxfc" event={"ID":"442201d0-2162-400c-914b-a9e257242a4b","Type":"ContainerStarted","Data":"5dddb1e32d585ba0c41c282901be449e222bf885d218e61f7bf1ef9568824af1"}
Jul 08 19:23:50.518981 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.518918    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlsrp" event={"ID":"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710","Type":"ContainerStarted","Data":"22932b6fc6d346b233e4e23fa9be7ee0b2984af7631643ec9f22e09d96c47437"}
Jul 08 19:23:50.521246 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.521146    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"ea5d52872afe85e6bd217ccc994d8b8bfc49ab4d7cb623e5a1fe203dd72c1e65"}
Jul 08 19:23:50.525746 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.525661    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff" event={"ID":"e4a36369-143a-414b-909d-255562a484f9","Type":"ContainerStarted","Data":"37b4cd6e51358b2f7a8b6a89713cf94e17db64763d8b2c23d83df87150bc5656"}
Jul 08 19:23:50.993439 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.993398    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:50.993746 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.993475    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:50.993746 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:50.993513    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:50.993746 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.993706    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:23:50.993746 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.993728    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:23:50.993746 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.993741    2554 projected.go:196] Error preparing data for projected volume kube-api-access-hd8v4 for pod openshift-network-diagnostics/network-check-target-tcmjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:50.994145 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.993805    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4 podName:c1e7bc80-d582-4815-89d6-143115cafb84 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:52.9937861 +0000 UTC m=+6.077559933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd8v4" (UniqueName: "kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4") pod "network-check-target-tcmjl" (UID: "c1e7bc80-d582-4815-89d6-143115cafb84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:50.994223 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.994214    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:50.994275 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.994262    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret podName:a7920a1e-1707-4ea8-b643-bc41f37ae37c nodeName:}" failed. No retries permitted until 2026-07-08 19:23:52.994246764 +0000 UTC m=+6.078020603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret") pod "global-pull-secret-syncer-dkd8x" (UID: "a7920a1e-1707-4ea8-b643-bc41f37ae37c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:50.994338 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.994320    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:50.994387 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:50.994351    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:52.994340204 +0000 UTC m=+6.078114036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:51.407882 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:51.407789    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:18:49 +0000 UTC" deadline="2028-01-18 07:33:02.671405195 +0000 UTC"
Jul 08 19:23:51.407882 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:51.407833    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13404h9m11.263577225s"
Jul 08 19:23:51.505728 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:51.502843    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:51.505728 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:51.503030    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:23:51.505728 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:51.502856    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:51.505728 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:51.503279    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:23:52.491936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:52.491833    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:52.492457 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:52.491974    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:23:53.018124 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:53.018080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:53.018309 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:53.018135    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:53.018309 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:53.018183    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:53.018447 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018308    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:53.018447 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018376    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret podName:a7920a1e-1707-4ea8-b643-bc41f37ae37c nodeName:}" failed. No retries permitted until 2026-07-08 19:23:57.018355672 +0000 UTC m=+10.102129519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret") pod "global-pull-secret-syncer-dkd8x" (UID: "a7920a1e-1707-4ea8-b643-bc41f37ae37c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:53.018821 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018792    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:53.018936 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018817    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:23:53.018936 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018847    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:23:53.018936 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018861    2554 projected.go:196] Error preparing data for projected volume kube-api-access-hd8v4 for pod openshift-network-diagnostics/network-check-target-tcmjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:53.018936 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018871    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:57.018852668 +0000 UTC m=+10.102626504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:53.018936 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.018915    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4 podName:c1e7bc80-d582-4815-89d6-143115cafb84 nodeName:}" failed. No retries permitted until 2026-07-08 19:23:57.018898142 +0000 UTC m=+10.102671997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd8v4" (UniqueName: "kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4") pod "network-check-target-tcmjl" (UID: "c1e7bc80-d582-4815-89d6-143115cafb84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:53.492377 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:53.492254    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:53.492377 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:53.492305    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:53.492917 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.492413    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:23:53.492917 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:53.492561    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:23:54.492381 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:54.492160    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:54.492906 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:54.492495    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:23:55.492718 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:55.492537    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:55.492718 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:55.492580    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:55.492718 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:55.492698    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:23:55.493305 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:55.492974    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:23:56.491754 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:56.491716    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:56.491904 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:56.491843    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:23:57.055628 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:57.055572    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:57.056077 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:57.055644    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:57.056077 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:57.055693    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:57.056077 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.055833    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:57.056077 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.055894    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret podName:a7920a1e-1707-4ea8-b643-bc41f37ae37c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:05.055875902 +0000 UTC m=+18.139649733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret") pod "global-pull-secret-syncer-dkd8x" (UID: "a7920a1e-1707-4ea8-b643-bc41f37ae37c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:23:57.056287 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.056241    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:23:57.056287 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.056272    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:23:57.056287 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.056284    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:57.056435 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.056333    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:24:05.056316336 +0000 UTC m=+18.140090165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:23:57.056435 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.056286    2554 projected.go:196] Error preparing data for projected volume kube-api-access-hd8v4 for pod openshift-network-diagnostics/network-check-target-tcmjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:57.056435 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.056388    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4 podName:c1e7bc80-d582-4815-89d6-143115cafb84 nodeName:}" failed. No retries permitted until 2026-07-08 19:24:05.056378245 +0000 UTC m=+18.140152080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd8v4" (UniqueName: "kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4") pod "network-check-target-tcmjl" (UID: "c1e7bc80-d582-4815-89d6-143115cafb84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:23:57.493571 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:57.493312    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:57.493571 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.493437    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:23:57.493849 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:57.493802    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:57.493975 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:57.493936    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:23:58.491895 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:58.491855    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:23:58.492358 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:58.491980    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:23:59.492274 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:59.492200    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:23:59.497979 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:59.497934    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:23:59.498460 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:23:59.498436    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:23:59.498653 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:23:59.498600    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:00.491468 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:00.491433    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:00.491673 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:00.491542    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:01.491963 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:01.491889    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:01.492386 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:01.491903    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:01.492386 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:01.492026    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:01.492386 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:01.492116    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:01.565928 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:01.565660    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlsrp" event={"ID":"a9ee9e6b-c6a1-453a-8e8d-75c3e6ec6710","Type":"ContainerStarted","Data":"34cb5ad5a027667211b7ff6070143d653cb788e3f087c561bb4e7e00aadc0b86"}
Jul 08 19:24:01.567409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:01.567381    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" event={"ID":"8afef05007b8d8fcc1b2b5da41446350","Type":"ContainerStarted","Data":"d20e86e83f8029abf83737cc6b3f61c4e00065f63e34cf48820b0635a8536290"}
Jul 08 19:24:01.586166 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:01.586115    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hlsrp" podStartSLOduration=2.312865477 podStartE2EDuration="13.586097058s" totalImagesPullingTime="11.273231581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:01.585580323 +0000 UTC m=+14.669354175" watchObservedRunningTime="2026-07-08 19:24:01.586097058 +0000 UTC m=+14.669870909"
Jul 08 19:24:01.599009 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:01.598961    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" podStartSLOduration=12.598945153 podStartE2EDuration="12.598945153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:01.598774115 +0000 UTC m=+14.682547969" watchObservedRunningTime="2026-07-08 19:24:01.598945153 +0000 UTC m=+14.682719004"
Jul 08 19:24:02.492553 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.492308    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:02.493009 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:02.492594    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:02.571088 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.571051    2554 generic.go:356] "Generic (PLEG): container finished" podID="ffb9d98d9c0e675fe807d55fcbd0e30a" containerID="61c6b70e58ed10b87ba657dc8489a7595fe519ccf0e4df722e83578f17fedf9a" exitCode=0
Jul 08 19:24:02.571247 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.571136    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" event={"ID":"ffb9d98d9c0e675fe807d55fcbd0e30a","Type":"ContainerDied","Data":"61c6b70e58ed10b87ba657dc8489a7595fe519ccf0e4df722e83578f17fedf9a"}
Jul 08 19:24:02.572633 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.572597    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wchgt" event={"ID":"7bd296cb-0758-49ec-86bd-cec21f806e35","Type":"ContainerStarted","Data":"15b5aaea2a9ef38939b56f37bb10df3a6f82873578049f26137146fff81eabea"}
Jul 08 19:24:02.574114 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.574085    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ef6dda8-01b0-4d0f-b3fb-0524145ba196" containerID="e1257cac58a3d933d805ba84001b94efb8aa0caf3b1f2ed99fa158ad5f4d63dc" exitCode=0
Jul 08 19:24:02.574256 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.574161    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerDied","Data":"e1257cac58a3d933d805ba84001b94efb8aa0caf3b1f2ed99fa158ad5f4d63dc"}
Jul 08 19:24:02.575580 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.575561    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nrcb5" event={"ID":"691d9e19-0679-47a8-8740-143a58393343","Type":"ContainerStarted","Data":"fc4e27566f673ad90e7fae4f0ac9a445a3df945ffc5a1d920de8e28abb85eb00"}
Jul 08 19:24:02.576966 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.576934    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rmxfc" event={"ID":"442201d0-2162-400c-914b-a9e257242a4b","Type":"ContainerStarted","Data":"c345a589dd650df6d1293568c722b35ddcc75715b351b0c44c6d7bc31a920bf6"}
Jul 08 19:24:02.578227 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.578205    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff" event={"ID":"e4a36369-143a-414b-909d-255562a484f9","Type":"ContainerStarted","Data":"9f77342b6e8942c9ac15c94ee25398bd652c13851bf3fd44fb7ca43cc24818b9"}
Jul 08 19:24:02.598178 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.598132    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nrcb5" podStartSLOduration=3.543377709 podStartE2EDuration="14.598114332s" totalImagesPullingTime="11.054736623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:02.597844116 +0000 UTC m=+15.681617969" watchObservedRunningTime="2026-07-08 19:24:02.598114332 +0000 UTC m=+15.681888195"
Jul 08 19:24:02.632070 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.632021    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wchgt" podStartSLOduration=3.6326728150000003 podStartE2EDuration="14.631999132s" totalImagesPullingTime="10.999326317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:02.631373312 +0000 UTC m=+15.715147164" watchObservedRunningTime="2026-07-08 19:24:02.631999132 +0000 UTC m=+15.715772983"
Jul 08 19:24:02.644977 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:02.644934    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rmxfc" podStartSLOduration=3.649532679 podStartE2EDuration="14.644917905s" totalImagesPullingTime="10.995385226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:02.644454384 +0000 UTC m=+15.728228235" watchObservedRunningTime="2026-07-08 19:24:02.644917905 +0000 UTC m=+15.728691755"
Jul 08 19:24:03.463969 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.463938    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:24:03.464604 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.464582    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:24:03.491745 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.491717    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:03.491881 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:03.491854    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:03.492003 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.491909    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:03.492060 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:03.492028    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:03.582732 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.582657    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" event={"ID":"ffb9d98d9c0e675fe807d55fcbd0e30a","Type":"ContainerStarted","Data":"1686a44957cbe474140b73a666d0a81e97f9054917a3a28c6a713b88285c13f7"}
Jul 08 19:24:03.584610 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.584578    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xt7n" event={"ID":"22e687a3-a7d0-4510-b05f-ade17b1ca4bb","Type":"ContainerStarted","Data":"5aaaf407d7c6d92d83c160bf221714ef786490c948e3a0c33a28cbefcbf55908"}
Jul 08 19:24:03.585422 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.585378    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:24:03.586103 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.586056    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nrcb5"
Jul 08 19:24:03.598794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.598742    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" podStartSLOduration=14.598721524 podStartE2EDuration="14.598721524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:03.597842083 +0000 UTC m=+16.681615935" watchObservedRunningTime="2026-07-08 19:24:03.598721524 +0000 UTC m=+16.682495380"
Jul 08 19:24:03.610345 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.610303    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 19:24:03.623566 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:03.623519    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8xt7n" podStartSLOduration=4.614951315 podStartE2EDuration="15.623500896s" totalImagesPullingTime="11.008549581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:03.623351035 +0000 UTC m=+16.707124886" watchObservedRunningTime="2026-07-08 19:24:03.623500896 +0000 UTC m=+16.707274748"
Jul 08 19:24:04.426212 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:04.426043    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T19:24:03.610324145Z","UUID":"1273bfcb-7188-47f9-8385-f6c3f516a76e","Handler":null,"Name":"","Endpoint":""}
Jul 08 19:24:04.427872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:04.427846    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 19:24:04.427994 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:04.427895    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 19:24:04.491544 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:04.491512    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:04.491743 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:04.491654    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:04.589208 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:04.589176    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff" event={"ID":"e4a36369-143a-414b-909d-255562a484f9","Type":"ContainerStarted","Data":"d4c9dd20e3d25effd0b62a7ee8b84e3f73f6c78cf4dd8f065e99a1b16a43b3e2"}
Jul 08 19:24:05.121258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:05.121220    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:05.121547 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:05.121288    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:05.121547 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:05.121315    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:05.121547 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.121475    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:24:05.121547 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.121503    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:24:05.121547 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.121517    2554 projected.go:196] Error preparing data for projected volume kube-api-access-hd8v4 for pod openshift-network-diagnostics/network-check-target-tcmjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:24:05.121834 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.121573    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4 podName:c1e7bc80-d582-4815-89d6-143115cafb84 nodeName:}" failed. No retries permitted until 2026-07-08 19:24:21.121555966 +0000 UTC m=+34.205329795 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd8v4" (UniqueName: "kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4") pod "network-check-target-tcmjl" (UID: "c1e7bc80-d582-4815-89d6-143115cafb84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:24:05.121897 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.121879    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:24:05.121973 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.121939    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:24:21.121922285 +0000 UTC m=+34.205696121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:24:05.121973 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.121879    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:24:05.122161 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.122017    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret podName:a7920a1e-1707-4ea8-b643-bc41f37ae37c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:21.122000554 +0000 UTC m=+34.205774394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret") pod "global-pull-secret-syncer-dkd8x" (UID: "a7920a1e-1707-4ea8-b643-bc41f37ae37c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:24:05.492485 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:05.492407    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:05.492668 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:05.492407    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:05.492668 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.492545    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:05.492793 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:05.492677    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:06.492140 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:06.492059    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:06.492605 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:06.492183    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:07.493175 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:07.492962    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:07.493652 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:07.493030    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:07.493652 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:07.493277    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:07.493652 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:07.493356    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:08.491804 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:08.491768    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:08.491969 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:08.491904    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:09.492395 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:09.492354    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:09.492957 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:09.492485    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:09.492957 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:09.492543    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:09.492957 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:09.492669    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:10.492163 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:10.492130    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:10.492343 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:10.492236    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:11.492506 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:11.492474    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:11.492958 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:11.492474    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:11.492958 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:11.492641    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:11.492958 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:11.492685    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:12.491731 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:12.491685    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:12.491917 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:12.491827    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:13.492478 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:13.492438    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:13.492896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:13.492486    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:13.492896 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:13.492561    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:13.492896 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:13.492731    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:14.492258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.492090    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:14.492389 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:14.492330    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:14.612114 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.611997    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ef6dda8-01b0-4d0f-b3fb-0524145ba196" containerID="7f6db6816e3120ee0bbf1346a3a117d67e2e7d9f06fa14b0e9b56561c1f0e9d6" exitCode=0
Jul 08 19:24:14.612114 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.612080    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerDied","Data":"7f6db6816e3120ee0bbf1346a3a117d67e2e7d9f06fa14b0e9b56561c1f0e9d6"}
Jul 08 19:24:14.614011 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.613803    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qr5fs" event={"ID":"c68a9266-bb64-4c55-8d31-09cc84852974","Type":"ContainerStarted","Data":"f88859b9dbb4c5a4a3be7e3172653898faf0a60830fa29e6ec0160b76b50e72c"}
Jul 08 19:24:14.616916 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.616882    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"f2d7fc58e474dd94d709b48376a1f848e865c2d09909e2b5247e2a83dc4837c8"}
Jul 08 19:24:14.617022 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.616981    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"8a1e6ac41355edcabf00a57faefcd599fedf188aa0966b4e1269a5d18684beac"}
Jul 08 19:24:14.617088 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.617033    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"32d9488875ad4724669406a3ad2eb87aeaef90f3d4a21905d095ff6e126e8aec"}
Jul 08 19:24:14.617137 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.617111    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"4aa17d77a771091e1fb7cb51ea39349c1c7b8d14b3de522f0c3c41b9c8dedc91"}
Jul 08 19:24:14.619646 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.619606    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff" event={"ID":"e4a36369-143a-414b-909d-255562a484f9","Type":"ContainerStarted","Data":"8758b4c060e2cc5f5ef4016707bbc9643e3c26e1f0bbbd070308805e39d02fad"}
Jul 08 19:24:14.648189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.648146    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qr5fs" podStartSLOduration=2.2708531499999998 podStartE2EDuration="26.648131754s" totalImagesPullingTime="24.377278604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:14.647596334 +0000 UTC m=+27.731370185" watchObservedRunningTime="2026-07-08 19:24:14.648131754 +0000 UTC m=+27.731905605"
Jul 08 19:24:14.664597 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:14.664555    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwnff" podStartSLOduration=3.6107786539999998 podStartE2EDuration="26.664541138s" totalImagesPullingTime="23.053762484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:14.664284352 +0000 UTC m=+27.748058202" watchObservedRunningTime="2026-07-08 19:24:14.664541138 +0000 UTC m=+27.748315022"
Jul 08 19:24:15.492419 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:15.492338    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:15.492586 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:15.492468    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:15.492586 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:15.492524    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:15.492724 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:15.492668    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:15.625862 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:15.625818    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"f329750c1810d1917fe15751e8b76f554e6f310a335460e1ad7f30e479e0268a"}
Jul 08 19:24:15.626392 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:15.625919    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"36447d0a77375e57e7e7a5685cc321190793b3d986325f3d22732fa95b8f2ba8"}
Jul 08 19:24:16.491910 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:16.491833    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:16.492088 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:16.491930    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:16.629965 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:16.629924    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ef6dda8-01b0-4d0f-b3fb-0524145ba196" containerID="300afc5e178c32c2def276a83206281d9b4a03674335d9e04c0db1a73f6a3939" exitCode=0
Jul 08 19:24:16.630338 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:16.629967    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerDied","Data":"300afc5e178c32c2def276a83206281d9b4a03674335d9e04c0db1a73f6a3939"}
Jul 08 19:24:17.492179 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:17.492144    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:17.492382 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:17.492249    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:17.492382 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:17.492301    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:17.492457 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:17.492415    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:17.636361 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:17.636329    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"3944c8d726041437505762bb46ad73e7556e82489c109ad636ccf9dd3c16d5d5"}
Jul 08 19:24:18.492356 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:18.492327    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:18.492499 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:18.492417    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:18.641241 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:18.641163    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ef6dda8-01b0-4d0f-b3fb-0524145ba196" containerID="dc74b1d1ef7b90166dbd75410e96fdb9287da22f4a6173b8e7c39f20cedb6f93" exitCode=0
Jul 08 19:24:18.641241 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:18.641204    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerDied","Data":"dc74b1d1ef7b90166dbd75410e96fdb9287da22f4a6173b8e7c39f20cedb6f93"}
Jul 08 19:24:19.492658 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.492344    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:19.492837 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.492406    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:19.492837 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:19.492745    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:19.492919 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:19.492850    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:19.648610 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.648572    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" event={"ID":"b0e10660-e154-485b-b2fa-9a0abc79af19","Type":"ContainerStarted","Data":"f974d4bccee48a7637f2282a9971074a304c1c0605456da1998ad83d6088474f"}
Jul 08 19:24:19.649184 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.648876    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:24:19.649184 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.648952    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:24:19.649184 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.648999    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:24:19.665244 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.665221    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:24:19.665366 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.665317    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:24:19.683003 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:19.682960    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg" podStartSLOduration=7.552513908 podStartE2EDuration="31.682946999s" totalImagesPullingTime="24.130433091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:19.682550038 +0000 UTC m=+32.766323889" watchObservedRunningTime="2026-07-08 19:24:19.682946999 +0000 UTC m=+32.766720849"
Jul 08 19:24:20.491966 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:20.491888    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:20.492239 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:20.492046    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:21.064206 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.064169    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dkd8x"]
Jul 08 19:24:21.064662 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.064309    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:21.064662 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.064416    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:21.066716 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.066692    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tcmjl"]
Jul 08 19:24:21.066838 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.066782    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:21.066895 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.066874    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:21.069570 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.069544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svtnq"]
Jul 08 19:24:21.069687 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.069674    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:21.069791 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.069773    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:21.141394 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.141352    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:21.141581 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.141407    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:21.141581 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:21.141455    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:21.141581 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141516    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:24:21.141581 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141577    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:24:21.141825 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141587    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:24:53.141570883 +0000 UTC m=+66.225344724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:24:21.141825 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141602    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:24:21.141825 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141639    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:24:21.141825 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141644    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret podName:a7920a1e-1707-4ea8-b643-bc41f37ae37c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:53.141610953 +0000 UTC m=+66.225384788 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret") pod "global-pull-secret-syncer-dkd8x" (UID: "a7920a1e-1707-4ea8-b643-bc41f37ae37c") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:24:21.141825 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141654    2554 projected.go:196] Error preparing data for projected volume kube-api-access-hd8v4 for pod openshift-network-diagnostics/network-check-target-tcmjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:24:21.141825 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:21.141720    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4 podName:c1e7bc80-d582-4815-89d6-143115cafb84 nodeName:}" failed. No retries permitted until 2026-07-08 19:24:53.141705574 +0000 UTC m=+66.225479426 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hd8v4" (UniqueName: "kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4") pod "network-check-target-tcmjl" (UID: "c1e7bc80-d582-4815-89d6-143115cafb84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:24:22.491681 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:22.491646    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:22.492232 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:22.491646    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:22.492232 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:22.491766    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:22.492232 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:22.491646    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:22.492232 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:22.491897    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:22.492232 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:22.491941    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:24.492243 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:24.492170    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:24.492655 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:24.492288    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:24.492655 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:24.492294    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:24.492655 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:24.492297    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:24.492655 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:24.492403    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:24.492655 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:24.492455    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:25.665415 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:25.665238    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ef6dda8-01b0-4d0f-b3fb-0524145ba196" containerID="532dfdf10b3960c4fb414c5df82cdf33d90e757924a2a667c56acd06b9022412" exitCode=0
Jul 08 19:24:25.665826 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:25.665325    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerDied","Data":"532dfdf10b3960c4fb414c5df82cdf33d90e757924a2a667c56acd06b9022412"}
Jul 08 19:24:26.492439 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.492398    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:26.492439 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.492437    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:26.492732 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.492541    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:24:26.492732 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.492578    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dkd8x" podUID="a7920a1e-1707-4ea8-b643-bc41f37ae37c"
Jul 08 19:24:26.492732 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.492612    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:26.492732 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.492707    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcmjl" podUID="c1e7bc80-d582-4815-89d6-143115cafb84"
Jul 08 19:24:26.670275 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.670245    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ef6dda8-01b0-4d0f-b3fb-0524145ba196" containerID="0dbdbd91f35fe028696cc31a088649e69ea5269f8916f581a09d25081b916a81" exitCode=0
Jul 08 19:24:26.670802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.670288    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerDied","Data":"0dbdbd91f35fe028696cc31a088649e69ea5269f8916f581a09d25081b916a81"}
Jul 08 19:24:26.701387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.701366    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeReady"
Jul 08 19:24:26.701501 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.701489    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 19:24:26.735919 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.735887    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b5785657c-cgkjd"]
Jul 08 19:24:26.760829 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.760803    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5lvw7"]
Jul 08 19:24:26.760990 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.760929    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.763313 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.763158    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 19:24:26.763313 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.763221    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 19:24:26.763559 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.763470    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 19:24:26.763559 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.763498    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-phtdc\""
Jul 08 19:24:26.768984 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.768961    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 19:24:26.777222 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.777201    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5785657c-cgkjd"]
Jul 08 19:24:26.777324 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.777232    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mkkt7"]
Jul 08 19:24:26.777362 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.777319    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.779461 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.779437    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 19:24:26.779461 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.779449    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 19:24:26.779643 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.779452    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dclc4\""
Jul 08 19:24:26.791240 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.791220    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5lvw7"]
Jul 08 19:24:26.791328 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.791260    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkkt7"]
Jul 08 19:24:26.791368 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.791331    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:26.793724 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.793707    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 19:24:26.793826 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.793747    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qgtw2\""
Jul 08 19:24:26.794068 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.794053    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 19:24:26.794250 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.794188    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 19:24:26.880150 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880113    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-image-registry-private-configuration\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880150 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880147    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880355 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880169    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-registry-certificates\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880355 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880241    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c94254-c8e2-401c-a617-d9233c41e47c-tmp-dir\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.880355 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880282    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/766d57ce-b128-4237-9695-e689778ec75e-ca-trust-extracted\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880355 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880303    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mxdf\" (UniqueName: \"kubernetes.io/projected/15c94254-c8e2-401c-a617-d9233c41e47c-kube-api-access-5mxdf\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.880355 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-installation-pull-secrets\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880355 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880347    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-trusted-ca\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880535 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880368    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15c94254-c8e2-401c-a617-d9233c41e47c-config-volume\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.880535 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880382    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-bound-sa-token\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880535 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880403    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msbnc\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-kube-api-access-msbnc\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.880535 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.880438    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.981045 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981003    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-image-registry-private-configuration\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981045 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981045    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981062    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-registry-certificates\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981098    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f686f053-5871-4fb2-a166-bf03f11ac95a-cert\") pod \"ingress-canary-mkkt7\" (UID: \"f686f053-5871-4fb2-a166-bf03f11ac95a\") " pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981119    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c94254-c8e2-401c-a617-d9233c41e47c-tmp-dir\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981143    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/766d57ce-b128-4237-9695-e689778ec75e-ca-trust-extracted\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981163    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mxdf\" (UniqueName: \"kubernetes.io/projected/15c94254-c8e2-401c-a617-d9233c41e47c-kube-api-access-5mxdf\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.981163    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.981186    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:24:26.981276 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.981246    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:24:27.481224951 +0000 UTC m=+40.564998780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981340    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-installation-pull-secrets\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981401    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-trusted-ca\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981430    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15c94254-c8e2-401c-a617-d9233c41e47c-config-volume\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981454    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-bound-sa-token\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981480    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msbnc\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-kube-api-access-msbnc\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981484    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c94254-c8e2-401c-a617-d9233c41e47c-tmp-dir\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981543    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/766d57ce-b128-4237-9695-e689778ec75e-ca-trust-extracted\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981672    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.981747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981704    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q97j\" (UniqueName: \"kubernetes.io/projected/f686f053-5871-4fb2-a166-bf03f11ac95a-kube-api-access-9q97j\") pod \"ingress-canary-mkkt7\" (UID: \"f686f053-5871-4fb2-a166-bf03f11ac95a\") " pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:26.982071 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.981812    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:24:26.982071 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:26.981856    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:27.481842844 +0000 UTC m=+40.565616676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:24:26.982071 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.981902    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-registry-certificates\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.982167 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.982127    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15c94254-c8e2-401c-a617-d9233c41e47c-config-volume\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.982240 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.982222    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-trusted-ca\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.985250 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.985224    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-installation-pull-secrets\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.985353 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.985226    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-image-registry-private-configuration\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.991499 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.991468    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msbnc\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-kube-api-access-msbnc\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:26.991733 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.991717    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mxdf\" (UniqueName: \"kubernetes.io/projected/15c94254-c8e2-401c-a617-d9233c41e47c-kube-api-access-5mxdf\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:26.991829 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:26.991807    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-bound-sa-token\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:27.082303 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.082231    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q97j\" (UniqueName: \"kubernetes.io/projected/f686f053-5871-4fb2-a166-bf03f11ac95a-kube-api-access-9q97j\") pod \"ingress-canary-mkkt7\" (UID: \"f686f053-5871-4fb2-a166-bf03f11ac95a\") " pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:27.082303 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.082296    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f686f053-5871-4fb2-a166-bf03f11ac95a-cert\") pod \"ingress-canary-mkkt7\" (UID: \"f686f053-5871-4fb2-a166-bf03f11ac95a\") " pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:27.084743 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.084722    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f686f053-5871-4fb2-a166-bf03f11ac95a-cert\") pod \"ingress-canary-mkkt7\" (UID: \"f686f053-5871-4fb2-a166-bf03f11ac95a\") " pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:27.090034 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.090014    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q97j\" (UniqueName: \"kubernetes.io/projected/f686f053-5871-4fb2-a166-bf03f11ac95a-kube-api-access-9q97j\") pod \"ingress-canary-mkkt7\" (UID: \"f686f053-5871-4fb2-a166-bf03f11ac95a\") " pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:27.098839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.098824    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkkt7"
Jul 08 19:24:27.289242 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.289064    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkkt7"]
Jul 08 19:24:27.292730 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:24:27.292703    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf686f053_5871_4fb2_a166_bf03f11ac95a.slice/crio-264f6cdba38be2bdbdac5f91186e60c6ee32ffe0996dfc9a4640b202e4e85032 WatchSource:0}: Error finding container 264f6cdba38be2bdbdac5f91186e60c6ee32ffe0996dfc9a4640b202e4e85032: Status 404 returned error can't find the container with id 264f6cdba38be2bdbdac5f91186e60c6ee32ffe0996dfc9a4640b202e4e85032
Jul 08 19:24:27.485398 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.485369    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:27.485601 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.485430    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:27.485601 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:27.485507    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:24:27.485601 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:27.485544    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:24:27.485601 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:27.485558    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:24:27.485601 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:27.485563    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:28.485547541 +0000 UTC m=+41.569321370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:24:27.485814 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:27.485609    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:24:28.485594605 +0000 UTC m=+41.569368436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:24:27.676223 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.676184    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" event={"ID":"9ef6dda8-01b0-4d0f-b3fb-0524145ba196","Type":"ContainerStarted","Data":"f37a4e023d6a7af5694aac118b64ae67842c000ff03acbddcc0d5d1f5afd067a"}
Jul 08 19:24:27.677315 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.677295    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkkt7" event={"ID":"f686f053-5871-4fb2-a166-bf03f11ac95a","Type":"ContainerStarted","Data":"264f6cdba38be2bdbdac5f91186e60c6ee32ffe0996dfc9a4640b202e4e85032"}
Jul 08 19:24:27.696524 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:27.696473    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l7k5q" podStartSLOduration=7.695310159 podStartE2EDuration="39.696451764s" totalImagesPullingTime="32.001141605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:27.695156528 +0000 UTC m=+40.778930381" watchObservedRunningTime="2026-07-08 19:24:27.696451764 +0000 UTC m=+40.780225618"
Jul 08 19:24:28.492347 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.492311    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:28.492568 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.492360    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:28.492568 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.492314    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:28.492568 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.492314    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:28.492568 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:28.492481    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:24:28.492568 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.492409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:28.492568 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:28.492492    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:24:28.492891 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:28.492590    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:24:28.492891 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:28.492639    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:24:30.492598191 +0000 UTC m=+43.576372044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:24:28.492891 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:28.492659    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:30.492649521 +0000 UTC m=+43.576423351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:24:28.494663 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.494646    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 19:24:28.495711 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.495504    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 19:24:28.495711 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.495523    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98h84\""
Jul 08 19:24:28.495711 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.495565    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgx5c\""
Jul 08 19:24:28.495711 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.495580    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 19:24:28.495711 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:28.495600    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 19:24:30.507162 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:30.507128    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:30.507613 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:30.507297    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:30.507613 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:30.507308    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:24:30.507613 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:30.507386    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:34.507364142 +0000 UTC m=+47.591137977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:24:30.507613 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:30.507440    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:24:30.507613 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:30.507459    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:24:30.507613 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:30.507514    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:24:34.507498323 +0000 UTC m=+47.591272152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:24:31.687665 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:31.687610    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkkt7" event={"ID":"f686f053-5871-4fb2-a166-bf03f11ac95a","Type":"ContainerStarted","Data":"18ba116e749fd64d7afe9feb5cd55d9f84b86fb08ce70721a8fb3d90f6b24cdb"}
Jul 08 19:24:31.702956 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:31.702903    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mkkt7" podStartSLOduration=1.936159926 podStartE2EDuration="5.702885826s" totalImagesPullingTime="3.7667259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:31.702047888 +0000 UTC m=+44.785821738" watchObservedRunningTime="2026-07-08 19:24:31.702885826 +0000 UTC m=+44.786659693"
Jul 08 19:24:34.537995 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:34.537953    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:34.538511 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:34.538010    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:34.538511 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:34.538102    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:24:34.538511 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:34.538113    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:24:34.538511 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:34.538139    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:24:34.538511 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:34.538162    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:24:42.538148273 +0000 UTC m=+55.621922116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:24:34.538511 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:34.538211    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:42.538191827 +0000 UTC m=+55.621965676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:24:42.599283 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:42.599229    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:42.599776 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:42.599302    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:42.599776 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:42.599383    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:24:42.599776 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:42.599400    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:24:42.599776 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:42.599414    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:24:42.599776 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:42.599446    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:24:58.599429284 +0000 UTC m=+71.683203113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:24:42.599776 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:42.599460    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:24:58.599454454 +0000 UTC m=+71.683228282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:24:51.663552 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:51.663524    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtqcg"
Jul 08 19:24:53.180815 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.180762    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:24:53.180815 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.180825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:53.181290 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.180887    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:53.183678 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.183659    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 19:24:53.183790 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.183657    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 19:24:53.183790 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.183699    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 19:24:53.191607 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:53.191582    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 19:24:53.191729 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:53.191659    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:25:57.191642838 +0000 UTC m=+130.275416668 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : secret "metrics-daemon-secret" not found
Jul 08 19:24:53.193905 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.193885    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 19:24:53.194907 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.194881    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7920a1e-1707-4ea8-b643-bc41f37ae37c-original-pull-secret\") pod \"global-pull-secret-syncer-dkd8x\" (UID: \"a7920a1e-1707-4ea8-b643-bc41f37ae37c\") " pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:53.221479 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.221445    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd8v4\" (UniqueName: \"kubernetes.io/projected/c1e7bc80-d582-4815-89d6-143115cafb84-kube-api-access-hd8v4\") pod \"network-check-target-tcmjl\" (UID: \"c1e7bc80-d582-4815-89d6-143115cafb84\") " pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:53.402179 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.402133    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dkd8x"
Jul 08 19:24:53.415066 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.415045    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98h84\""
Jul 08 19:24:53.422859 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.422837    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:24:53.530474 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.530441    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dkd8x"]
Jul 08 19:24:53.533826 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:24:53.533795    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7920a1e_1707_4ea8_b643_bc41f37ae37c.slice/crio-4cf339ad190c5b4c31b56c516e780b86f4abfea1be25b0ef8916eb678d277522 WatchSource:0}: Error finding container 4cf339ad190c5b4c31b56c516e780b86f4abfea1be25b0ef8916eb678d277522: Status 404 returned error can't find the container with id 4cf339ad190c5b4c31b56c516e780b86f4abfea1be25b0ef8916eb678d277522
Jul 08 19:24:53.554753 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.554729    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tcmjl"]
Jul 08 19:24:53.557384 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:24:53.557356    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e7bc80_d582_4815_89d6_143115cafb84.slice/crio-1e316bf9d515188f96e7e63ea7c6a4e388f31b598132d2e4af52e438bae9e71e WatchSource:0}: Error finding container 1e316bf9d515188f96e7e63ea7c6a4e388f31b598132d2e4af52e438bae9e71e: Status 404 returned error can't find the container with id 1e316bf9d515188f96e7e63ea7c6a4e388f31b598132d2e4af52e438bae9e71e
Jul 08 19:24:53.739098 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.739015    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dkd8x" event={"ID":"a7920a1e-1707-4ea8-b643-bc41f37ae37c","Type":"ContainerStarted","Data":"4cf339ad190c5b4c31b56c516e780b86f4abfea1be25b0ef8916eb678d277522"}
Jul 08 19:24:53.740053 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:53.740031    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tcmjl" event={"ID":"c1e7bc80-d582-4815-89d6-143115cafb84","Type":"ContainerStarted","Data":"1e316bf9d515188f96e7e63ea7c6a4e388f31b598132d2e4af52e438bae9e71e"}
Jul 08 19:24:58.624301 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:58.624260    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:24:58.624763 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:24:58.624322    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:24:58.624763 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:58.624420    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:24:58.624763 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:58.624453    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:24:58.624763 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:58.624469    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:24:58.624763 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:58.624504    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:25:30.624481965 +0000 UTC m=+103.708255807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:24:58.624763 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:24:58.624520    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:25:30.624514647 +0000 UTC m=+103.708288476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:25:00.761832 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:00.761796    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tcmjl" event={"ID":"c1e7bc80-d582-4815-89d6-143115cafb84","Type":"ContainerStarted","Data":"619c915d4724b3d3bf6d645a290571ed5289fe930d2291bd2a79023c1d234df3"}
Jul 08 19:25:00.762256 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:00.761926    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:25:00.763245 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:00.763217    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dkd8x" event={"ID":"a7920a1e-1707-4ea8-b643-bc41f37ae37c","Type":"ContainerStarted","Data":"663d19f042dd6da9df3e79fc257be0eb850d6c5ced60764a05dadd7f643e56e5"}
Jul 08 19:25:00.781709 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:00.781662    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tcmjl" podStartSLOduration=66.618932279 podStartE2EDuration="1m12.781648685s" totalImagesPullingTime="6.162716406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:25:00.780725036 +0000 UTC m=+73.864498886" watchObservedRunningTime="2026-07-08 19:25:00.781648685 +0000 UTC m=+73.865422536"
Jul 08 19:25:00.796841 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:00.796788    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dkd8x" podStartSLOduration=66.608134244 podStartE2EDuration="1m12.796769602s" totalImagesPullingTime="6.188635358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:25:00.796321354 +0000 UTC m=+73.880095206" watchObservedRunningTime="2026-07-08 19:25:00.796769602 +0000 UTC m=+73.880543454"
Jul 08 19:25:30.650446 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:30.650409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:25:30.650909 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:30.650470    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:25:30.650909 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:25:30.650565    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:25:30.650909 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:25:30.650610    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:25:30.650909 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:25:30.650643    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:25:30.650909 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:25:30.650647    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:26:34.650630864 +0000 UTC m=+167.734404706 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:25:30.650909 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:25:30.650721    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:26:34.650675496 +0000 UTC m=+167.734449347 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:25:31.768891 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:31.768863    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tcmjl"
Jul 08 19:25:57.230811 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:25:57.230759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:25:57.231302 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:25:57.230887    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 19:25:57.231302 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:25:57.230943    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:27:59.230928762 +0000 UTC m=+252.314702591 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : secret "metrics-daemon-secret" not found
Jul 08 19:26:29.772639 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:29.772571    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" podUID="766d57ce-b128-4237-9695-e689778ec75e"
Jul 08 19:26:29.785677 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:29.785649    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5lvw7" podUID="15c94254-c8e2-401c-a617-d9233c41e47c"
Jul 08 19:26:29.976286 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:26:29.976252    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:26:29.976286 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:26:29.976290    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:26:31.508073 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:31.508034    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:26:34.687037 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:26:34.687001    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:26:34.687470 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:26:34.687061    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:26:34.687470 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:34.687151    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 19:26:34.687470 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:34.687174    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 19:26:34.687470 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:34.687196    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5785657c-cgkjd: secret "image-registry-tls" not found
Jul 08 19:26:34.687470 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:34.687199    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls podName:15c94254-c8e2-401c-a617-d9233c41e47c nodeName:}" failed. No retries permitted until 2026-07-08 19:28:36.687186996 +0000 UTC m=+289.770960825 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls") pod "dns-default-5lvw7" (UID: "15c94254-c8e2-401c-a617-d9233c41e47c") : secret "dns-default-metrics-tls" not found
Jul 08 19:26:34.687470 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:26:34.687269    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls podName:766d57ce-b128-4237-9695-e689778ec75e nodeName:}" failed. No retries permitted until 2026-07-08 19:28:36.687252167 +0000 UTC m=+289.771025996 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls") pod "image-registry-b5785657c-cgkjd" (UID: "766d57ce-b128-4237-9695-e689778ec75e") : secret "image-registry-tls" not found
Jul 08 19:26:43.492211 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:26:43.492128    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:27:59.271929 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:27:59.271868    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:27:59.272494 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:27:59.272048    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 19:27:59.272494 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:27:59.272149    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs podName:e715f486-90f1-47dd-84e1-b11d8ea3f690 nodeName:}" failed. No retries permitted until 2026-07-08 19:30:01.272127189 +0000 UTC m=+374.355901019 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs") pod "network-metrics-daemon-svtnq" (UID: "e715f486-90f1-47dd-84e1-b11d8ea3f690") : secret "metrics-daemon-secret" not found
Jul 08 19:28:14.812982 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.812900    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"]
Jul 08 19:28:14.814687 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.814671    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:14.817494 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.817471    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 08 19:28:14.817494 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.817490    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 08 19:28:14.817707 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.817522    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ldmjc\""
Jul 08 19:28:14.828355 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.828332    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"]
Jul 08 19:28:14.882446 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.882398    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:14.882660 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.882541    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:14.906173 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.906136    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"]
Jul 08 19:28:14.908237 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.908221    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:14.911048 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.911022    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4tskz\""
Jul 08 19:28:14.911843 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.911821    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"]
Jul 08 19:28:14.912193 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.912174    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 08 19:28:14.912717 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.912696    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:28:14.912717 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.912708    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 08 19:28:14.913705 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.913686    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8zj64"]
Jul 08 19:28:14.913793 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.913765    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"
Jul 08 19:28:14.915522 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.915505    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:14.916059 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.916044    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:28:14.916557 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.916542    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 19:28:14.917075 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.917009    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xv5fs\""
Jul 08 19:28:14.917834 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.917814    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 08 19:28:14.918409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.918395    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:28:14.918486 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.918399    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 08 19:28:14.918688 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.918672    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xl6dt\""
Jul 08 19:28:14.918754 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.918677    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 08 19:28:14.923486 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.923471    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"]
Jul 08 19:28:14.925258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.925242    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"]
Jul 08 19:28:14.925554 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.925535    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 08 19:28:14.926222 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.926204    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"]
Jul 08 19:28:14.928300 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.928275    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"
Jul 08 19:28:14.930645 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.930610    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9jh6c\""
Jul 08 19:28:14.937717 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.937687    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"]
Jul 08 19:28:14.938568 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.938549    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8zj64"]
Jul 08 19:28:14.983440 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983405    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33ad7dc8-4317-4678-9b61-f9c7dfec68da-serving-cert\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:14.983603 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983447    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:14.983603 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983515    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9jfs\" (UniqueName: \"kubernetes.io/projected/33ad7dc8-4317-4678-9b61-f9c7dfec68da-kube-api-access-d9jfs\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:14.983603 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983548    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcwlh\" (UniqueName: \"kubernetes.io/projected/db54376f-0888-444e-a3ea-b302d25afcac-kube-api-access-kcwlh\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:14.983603 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983568    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnwt\" (UniqueName: \"kubernetes.io/projected/0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef-kube-api-access-kjnwt\") pod \"volume-data-source-validator-5d456fdbcd-t8ftt\" (UID: \"0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"
Jul 08 19:28:14.983797 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983661    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ad7dc8-4317-4678-9b61-f9c7dfec68da-config\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:14.983797 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983685    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33ad7dc8-4317-4678-9b61-f9c7dfec68da-trusted-ca\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:14.983797 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983705    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w85fj\" (UniqueName: \"kubernetes.io/projected/2bad4ad6-a706-4cae-b79f-be0fdc8c3eef-kube-api-access-w85fj\") pod \"network-check-source-989f8b8dc-lt6r6\" (UID: \"2bad4ad6-a706-4cae-b79f-be0fdc8c3eef\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"
Jul 08 19:28:14.983797 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983733    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:14.983797 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.983752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:14.983942 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:14.983867    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 19:28:14.983942 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:14.983920    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert podName:c2df2a6f-8d63-40ba-b8a6-c5431d00edf4 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:15.483905125 +0000 UTC m=+268.567678954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7x4g8" (UID: "c2df2a6f-8d63-40ba-b8a6-c5431d00edf4") : secret "networking-console-plugin-cert" not found
Jul 08 19:28:14.984329 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:14.984313    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:15.017994 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.017962    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"]
Jul 08 19:28:15.019846 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.019829    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.028727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.028695    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:28:15.029230 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.029212    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 08 19:28:15.029493 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.029476    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 08 19:28:15.030242 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.030226    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 08 19:28:15.030293 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.030228    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tb6gp\""
Jul 08 19:28:15.038769 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.038743    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"]
Jul 08 19:28:15.085126 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085036    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwlh\" (UniqueName: \"kubernetes.io/projected/db54376f-0888-444e-a3ea-b302d25afcac-kube-api-access-kcwlh\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:15.085126 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085088    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ad7dc8-4317-4678-9b61-f9c7dfec68da-config\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.085413 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085266    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws62c\" (UniqueName: \"kubernetes.io/projected/7c1b3c09-ea56-4b29-9394-130c9b0594eb-kube-api-access-ws62c\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.085413 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9jfs\" (UniqueName: \"kubernetes.io/projected/33ad7dc8-4317-4678-9b61-f9c7dfec68da-kube-api-access-d9jfs\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.085413 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085369    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:15.085413 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w85fj\" (UniqueName: \"kubernetes.io/projected/2bad4ad6-a706-4cae-b79f-be0fdc8c3eef-kube-api-access-w85fj\") pod \"network-check-source-989f8b8dc-lt6r6\" (UID: \"2bad4ad6-a706-4cae-b79f-be0fdc8c3eef\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"
Jul 08 19:28:15.085648 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085436    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33ad7dc8-4317-4678-9b61-f9c7dfec68da-trusted-ca\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.085648 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085463    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33ad7dc8-4317-4678-9b61-f9c7dfec68da-serving-cert\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.085648 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:15.085483    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 19:28:15.085648 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085490    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c1b3c09-ea56-4b29-9394-130c9b0594eb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.085648 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:15.085547    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls podName:db54376f-0888-444e-a3ea-b302d25afcac nodeName:}" failed. No retries permitted until 2026-07-08 19:28:15.585526001 +0000 UTC m=+268.669299836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zwt9b" (UID: "db54376f-0888-444e-a3ea-b302d25afcac") : secret "samples-operator-tls" not found
Jul 08 19:28:15.085648 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085581    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1b3c09-ea56-4b29-9394-130c9b0594eb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.085940 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnwt\" (UniqueName: \"kubernetes.io/projected/0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef-kube-api-access-kjnwt\") pod \"volume-data-source-validator-5d456fdbcd-t8ftt\" (UID: \"0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"
Jul 08 19:28:15.085940 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.085792    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ad7dc8-4317-4678-9b61-f9c7dfec68da-config\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.086241 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.086224    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33ad7dc8-4317-4678-9b61-f9c7dfec68da-trusted-ca\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.087697 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.087681    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33ad7dc8-4317-4678-9b61-f9c7dfec68da-serving-cert\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.095888 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.095862    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w85fj\" (UniqueName: \"kubernetes.io/projected/2bad4ad6-a706-4cae-b79f-be0fdc8c3eef-kube-api-access-w85fj\") pod \"network-check-source-989f8b8dc-lt6r6\" (UID: \"2bad4ad6-a706-4cae-b79f-be0fdc8c3eef\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"
Jul 08 19:28:15.095992 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.095892    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcwlh\" (UniqueName: \"kubernetes.io/projected/db54376f-0888-444e-a3ea-b302d25afcac-kube-api-access-kcwlh\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:15.100214 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.100190    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9jfs\" (UniqueName: \"kubernetes.io/projected/33ad7dc8-4317-4678-9b61-f9c7dfec68da-kube-api-access-d9jfs\") pod \"console-operator-68b757fb67-8zj64\" (UID: \"33ad7dc8-4317-4678-9b61-f9c7dfec68da\") " pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.100324 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.100303    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnwt\" (UniqueName: \"kubernetes.io/projected/0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef-kube-api-access-kjnwt\") pod \"volume-data-source-validator-5d456fdbcd-t8ftt\" (UID: \"0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"
Jul 08 19:28:15.186483 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.186443    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws62c\" (UniqueName: \"kubernetes.io/projected/7c1b3c09-ea56-4b29-9394-130c9b0594eb-kube-api-access-ws62c\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.186673 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.186532    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c1b3c09-ea56-4b29-9394-130c9b0594eb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.186673 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.186558    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1b3c09-ea56-4b29-9394-130c9b0594eb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.187875 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.187853    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c1b3c09-ea56-4b29-9394-130c9b0594eb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.188763 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.188742    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1b3c09-ea56-4b29-9394-130c9b0594eb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.207547 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.207523    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws62c\" (UniqueName: \"kubernetes.io/projected/7c1b3c09-ea56-4b29-9394-130c9b0594eb-kube-api-access-ws62c\") pod \"kube-storage-version-migrator-operator-846bf668f7-qsvrc\" (UID: \"7c1b3c09-ea56-4b29-9394-130c9b0594eb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.226184 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.226157    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"
Jul 08 19:28:15.231646 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.231612    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:15.238454 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.238417    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"
Jul 08 19:28:15.328004 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.327964    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"
Jul 08 19:28:15.384500 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.384344    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8zj64"]
Jul 08 19:28:15.387192 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:15.387144    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ad7dc8_4317_4678_9b61_f9c7dfec68da.slice/crio-3a2156fc83dccc7211f3f3208b2f00370a65537c8c6ebb52ef28212d61b5f96d WatchSource:0}: Error finding container 3a2156fc83dccc7211f3f3208b2f00370a65537c8c6ebb52ef28212d61b5f96d: Status 404 returned error can't find the container with id 3a2156fc83dccc7211f3f3208b2f00370a65537c8c6ebb52ef28212d61b5f96d
Jul 08 19:28:15.397493 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.397466    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt"]
Jul 08 19:28:15.400288 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:15.400263    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0ebf99_4dd5_40a7_8dae_1c7472a0eaef.slice/crio-b57048b1b27b47d6621c0801c8e22f50e9609c857715b6ce5ff5cbd81d61b35f WatchSource:0}: Error finding container b57048b1b27b47d6621c0801c8e22f50e9609c857715b6ce5ff5cbd81d61b35f: Status 404 returned error can't find the container with id b57048b1b27b47d6621c0801c8e22f50e9609c857715b6ce5ff5cbd81d61b35f
Jul 08 19:28:15.471418 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.471387    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc"]
Jul 08 19:28:15.474446 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:15.474420    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1b3c09_ea56_4b29_9394_130c9b0594eb.slice/crio-7217c6ebe99b7e6d48e1103bb35232c1f67c304e1f39c05035f1d62fa6a85ac2 WatchSource:0}: Error finding container 7217c6ebe99b7e6d48e1103bb35232c1f67c304e1f39c05035f1d62fa6a85ac2: Status 404 returned error can't find the container with id 7217c6ebe99b7e6d48e1103bb35232c1f67c304e1f39c05035f1d62fa6a85ac2
Jul 08 19:28:15.488117 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.488090    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:15.488249 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:15.488233    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 19:28:15.488293 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:15.488288    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert podName:c2df2a6f-8d63-40ba-b8a6-c5431d00edf4 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:16.488274149 +0000 UTC m=+269.572047977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7x4g8" (UID: "c2df2a6f-8d63-40ba-b8a6-c5431d00edf4") : secret "networking-console-plugin-cert" not found
Jul 08 19:28:15.588730 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.588652    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:15.588896 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:15.588813    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 19:28:15.588959 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:15.588903    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls podName:db54376f-0888-444e-a3ea-b302d25afcac nodeName:}" failed. No retries permitted until 2026-07-08 19:28:16.588881691 +0000 UTC m=+269.672655533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zwt9b" (UID: "db54376f-0888-444e-a3ea-b302d25afcac") : secret "samples-operator-tls" not found
Jul 08 19:28:15.603668 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:15.603642    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6"]
Jul 08 19:28:15.606723 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:15.606701    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bad4ad6_a706_4cae_b79f_be0fdc8c3eef.slice/crio-36b2de640ec28265a6a08eabc1d74eddc118d5cf5b7705391753862910a4f2dc WatchSource:0}: Error finding container 36b2de640ec28265a6a08eabc1d74eddc118d5cf5b7705391753862910a4f2dc: Status 404 returned error can't find the container with id 36b2de640ec28265a6a08eabc1d74eddc118d5cf5b7705391753862910a4f2dc
Jul 08 19:28:16.217052 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:16.217004    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc" event={"ID":"7c1b3c09-ea56-4b29-9394-130c9b0594eb","Type":"ContainerStarted","Data":"7217c6ebe99b7e6d48e1103bb35232c1f67c304e1f39c05035f1d62fa6a85ac2"}
Jul 08 19:28:16.218387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:16.218351    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt" event={"ID":"0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef","Type":"ContainerStarted","Data":"b57048b1b27b47d6621c0801c8e22f50e9609c857715b6ce5ff5cbd81d61b35f"}
Jul 08 19:28:16.219485 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:16.219452    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" event={"ID":"33ad7dc8-4317-4678-9b61-f9c7dfec68da","Type":"ContainerStarted","Data":"3a2156fc83dccc7211f3f3208b2f00370a65537c8c6ebb52ef28212d61b5f96d"}
Jul 08 19:28:16.221018 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:16.220994    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6" event={"ID":"2bad4ad6-a706-4cae-b79f-be0fdc8c3eef","Type":"ContainerStarted","Data":"9b8e2022a34a643066769913ba0b9c23f91fce657337ac3418efefb28bd6a22e"}
Jul 08 19:28:16.221115 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:16.221036    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6" event={"ID":"2bad4ad6-a706-4cae-b79f-be0fdc8c3eef","Type":"ContainerStarted","Data":"36b2de640ec28265a6a08eabc1d74eddc118d5cf5b7705391753862910a4f2dc"}
Jul 08 19:28:16.497187 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:16.497050    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:16.497363 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:16.497203    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 19:28:16.497363 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:16.497279    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert podName:c2df2a6f-8d63-40ba-b8a6-c5431d00edf4 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:18.497259356 +0000 UTC m=+271.581033191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7x4g8" (UID: "c2df2a6f-8d63-40ba-b8a6-c5431d00edf4") : secret "networking-console-plugin-cert" not found
Jul 08 19:28:16.597976 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:16.597927    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:16.598155 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:16.598122    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 19:28:16.598222 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:16.598202    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls podName:db54376f-0888-444e-a3ea-b302d25afcac nodeName:}" failed. No retries permitted until 2026-07-08 19:28:18.598179546 +0000 UTC m=+271.681953397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zwt9b" (UID: "db54376f-0888-444e-a3ea-b302d25afcac") : secret "samples-operator-tls" not found
Jul 08 19:28:17.225381 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:17.225348    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt" event={"ID":"0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef","Type":"ContainerStarted","Data":"f267ee12c9ab573fe01021692bafef441096a2f048335cf99e27bc07468d5e1d"}
Jul 08 19:28:17.247067 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:17.247017    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lt6r6" podStartSLOduration=3.246997839 podStartE2EDuration="3.246997839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:16.246739856 +0000 UTC m=+269.330513707" watchObservedRunningTime="2026-07-08 19:28:17.246997839 +0000 UTC m=+270.330771693"
Jul 08 19:28:17.247408 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:17.247376    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t8ftt" podStartSLOduration=1.6103254489999999 podStartE2EDuration="3.247363686s" totalImagesPullingTime="1.637038237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:17.246794077 +0000 UTC m=+270.330567932" watchObservedRunningTime="2026-07-08 19:28:17.247363686 +0000 UTC m=+270.331137537"
Jul 08 19:28:18.512565 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.512537    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:18.512942 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.512663    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 19:28:18.512942 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.512717    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert podName:c2df2a6f-8d63-40ba-b8a6-c5431d00edf4 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:22.512702469 +0000 UTC m=+275.596476301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7x4g8" (UID: "c2df2a6f-8d63-40ba-b8a6-c5431d00edf4") : secret "networking-console-plugin-cert" not found
Jul 08 19:28:18.581740 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.581702    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-42m9g"]
Jul 08 19:28:18.584389 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.584365    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.586694 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.586669    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 19:28:18.587051 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.587031    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 19:28:18.587111 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.587035    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 19:28:18.587740 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.587324    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 19:28:18.588136 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.588120    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5vrqz\""
Jul 08 19:28:18.594849 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.594826    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-42m9g"]
Jul 08 19:28:18.613270 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.613248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:18.613396 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.613380    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 19:28:18.613465 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.613435    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls podName:db54376f-0888-444e-a3ea-b302d25afcac nodeName:}" failed. No retries permitted until 2026-07-08 19:28:22.61342225 +0000 UTC m=+275.697196079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zwt9b" (UID: "db54376f-0888-444e-a3ea-b302d25afcac") : secret "samples-operator-tls" not found
Jul 08 19:28:18.713729 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.713691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c9980-ddef-4e85-843c-3f3d99d28e01-data-volume\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.713931 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.713737    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.713931 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.713805    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c9980-ddef-4e85-843c-3f3d99d28e01-crio-socket\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.713931 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.713868    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.714073 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.713942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xch\" (UniqueName: \"kubernetes.io/projected/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-api-access-v2xch\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.814954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.814870    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xch\" (UniqueName: \"kubernetes.io/projected/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-api-access-v2xch\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.814954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.814926    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c9980-ddef-4e85-843c-3f3d99d28e01-data-volume\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.814954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.814947    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.814982    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c9980-ddef-4e85-843c-3f3d99d28e01-crio-socket\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.815013    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.815114    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.815121    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c9980-ddef-4e85-843c-3f3d99d28e01-crio-socket\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.815162    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.815208    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:19.315187818 +0000 UTC m=+272.398961659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.815208    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c9980-ddef-4e85-843c-3f3d99d28e01-data-volume\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:18.815224 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:18.815221    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:19.31521557 +0000 UTC m=+272.398989398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : configmap "kube-rbac-proxy" not found
Jul 08 19:28:18.823426 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:18.823401    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xch\" (UniqueName: \"kubernetes.io/projected/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-api-access-v2xch\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:19.237632 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.237590    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/0.log"
Jul 08 19:28:19.237807 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.237659    2554 generic.go:356] "Generic (PLEG): container finished" podID="33ad7dc8-4317-4678-9b61-f9c7dfec68da" containerID="d87e6dca7303c7678387327901e2b15764c9ae800b4d3c0f302bd3cd82d4bb68" exitCode=255
Jul 08 19:28:19.237807 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.237751    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" event={"ID":"33ad7dc8-4317-4678-9b61-f9c7dfec68da","Type":"ContainerDied","Data":"d87e6dca7303c7678387327901e2b15764c9ae800b4d3c0f302bd3cd82d4bb68"}
Jul 08 19:28:19.237994 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.237969    2554 scope.go:117] "RemoveContainer" containerID="d87e6dca7303c7678387327901e2b15764c9ae800b4d3c0f302bd3cd82d4bb68"
Jul 08 19:28:19.239326 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.239305    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc" event={"ID":"7c1b3c09-ea56-4b29-9394-130c9b0594eb","Type":"ContainerStarted","Data":"ad6899836808b2bf66dc0b9ca09f259ffd89e40998ac312aed9994824446cc90"}
Jul 08 19:28:19.318316 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.318286    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:19.318472 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:19.318451    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 19:28:19.318544 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:19.318525    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:20.318504847 +0000 UTC m=+273.402278696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : configmap "kube-rbac-proxy" not found
Jul 08 19:28:19.318694 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.318589    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:19.318907 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:19.318889    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:19.318991 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:19.318944    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:20.318928295 +0000 UTC m=+273.402702124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:19.988946 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.988884    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc" podStartSLOduration=2.996851419 podStartE2EDuration="5.988866152s" totalImagesPullingTime="2.992014733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:19.276789746 +0000 UTC m=+272.360563598" watchObservedRunningTime="2026-07-08 19:28:19.988866152 +0000 UTC m=+273.072640019"
Jul 08 19:28:19.989349 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.989329    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"]
Jul 08 19:28:19.991334 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.991319    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"
Jul 08 19:28:19.994325 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.994309    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 19:28:19.994824 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.994808    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 19:28:19.995802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:19.995787    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rwkrp\""
Jul 08 19:28:20.010496 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.010473    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"]
Jul 08 19:28:20.124603 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.124566    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnbds\" (UniqueName: \"kubernetes.io/projected/aaf3de34-9622-4caa-8d13-66ae822f36c5-kube-api-access-vnbds\") pod \"migrator-d57d58cc9-4wbtk\" (UID: \"aaf3de34-9622-4caa-8d13-66ae822f36c5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"
Jul 08 19:28:20.225499 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.225457    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnbds\" (UniqueName: \"kubernetes.io/projected/aaf3de34-9622-4caa-8d13-66ae822f36c5-kube-api-access-vnbds\") pod \"migrator-d57d58cc9-4wbtk\" (UID: \"aaf3de34-9622-4caa-8d13-66ae822f36c5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"
Jul 08 19:28:20.234740 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.234708    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnbds\" (UniqueName: \"kubernetes.io/projected/aaf3de34-9622-4caa-8d13-66ae822f36c5-kube-api-access-vnbds\") pod \"migrator-d57d58cc9-4wbtk\" (UID: \"aaf3de34-9622-4caa-8d13-66ae822f36c5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"
Jul 08 19:28:20.243218 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.243162    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/1.log"
Jul 08 19:28:20.243567 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.243553    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/0.log"
Jul 08 19:28:20.243659 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.243586    2554 generic.go:356] "Generic (PLEG): container finished" podID="33ad7dc8-4317-4678-9b61-f9c7dfec68da" containerID="c8e1aa20e4b135fac67fabf6a795825cb0b0e3335616d238693b51d0922cf812" exitCode=255
Jul 08 19:28:20.243723 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.243672    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" event={"ID":"33ad7dc8-4317-4678-9b61-f9c7dfec68da","Type":"ContainerDied","Data":"c8e1aa20e4b135fac67fabf6a795825cb0b0e3335616d238693b51d0922cf812"}
Jul 08 19:28:20.243777 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.243729    2554 scope.go:117] "RemoveContainer" containerID="d87e6dca7303c7678387327901e2b15764c9ae800b4d3c0f302bd3cd82d4bb68"
Jul 08 19:28:20.243974 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.243954    2554 scope.go:117] "RemoveContainer" containerID="c8e1aa20e4b135fac67fabf6a795825cb0b0e3335616d238693b51d0922cf812"
Jul 08 19:28:20.244171 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:20.244147    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8zj64_openshift-console-operator(33ad7dc8-4317-4678-9b61-f9c7dfec68da)\"" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" podUID="33ad7dc8-4317-4678-9b61-f9c7dfec68da"
Jul 08 19:28:20.300016 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.299980    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"
Jul 08 19:28:20.326874 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.326829    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:20.327031 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:20.327009    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:20.327112 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:20.327097    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:22.327073319 +0000 UTC m=+275.410847152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:20.327194 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.327163    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:20.327302 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:20.327265    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 19:28:20.327405 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:20.327346    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:22.327325016 +0000 UTC m=+275.411098845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : configmap "kube-rbac-proxy" not found
Jul 08 19:28:20.437799 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.437772    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk"]
Jul 08 19:28:20.440164 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:20.440142    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf3de34_9622_4caa_8d13_66ae822f36c5.slice/crio-08d61d52a89cf2e187f822b3582cb666e49c5d396248362514744a62bc373a4b WatchSource:0}: Error finding container 08d61d52a89cf2e187f822b3582cb666e49c5d396248362514744a62bc373a4b: Status 404 returned error can't find the container with id 08d61d52a89cf2e187f822b3582cb666e49c5d396248362514744a62bc373a4b
Jul 08 19:28:20.573226 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:20.573154    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rmxfc_442201d0-2162-400c-914b-a9e257242a4b/dns-node-resolver/0.log"
Jul 08 19:28:21.247998 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:21.247957    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk" event={"ID":"aaf3de34-9622-4caa-8d13-66ae822f36c5","Type":"ContainerStarted","Data":"08d61d52a89cf2e187f822b3582cb666e49c5d396248362514744a62bc373a4b"}
Jul 08 19:28:21.249331 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:21.249310    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/1.log"
Jul 08 19:28:21.249654 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:21.249634    2554 scope.go:117] "RemoveContainer" containerID="c8e1aa20e4b135fac67fabf6a795825cb0b0e3335616d238693b51d0922cf812"
Jul 08 19:28:21.249793 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:21.249775    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8zj64_openshift-console-operator(33ad7dc8-4317-4678-9b61-f9c7dfec68da)\"" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" podUID="33ad7dc8-4317-4678-9b61-f9c7dfec68da"
Jul 08 19:28:21.778780 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:21.778755    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wchgt_7bd296cb-0758-49ec-86bd-cec21f806e35/node-ca/0.log"
Jul 08 19:28:22.344763 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:22.344513    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:22.344763 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:22.344606    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:22.344763 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.344757    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 19:28:22.345164 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.344761    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:22.345164 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.344818    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:26.344799651 +0000 UTC m=+279.428573493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : configmap "kube-rbac-proxy" not found
Jul 08 19:28:22.345164 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.344969    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:26.344909514 +0000 UTC m=+279.428683343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:22.546709 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:22.546608    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:22.546851 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.546762    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 19:28:22.546851 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.546825    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert podName:c2df2a6f-8d63-40ba-b8a6-c5431d00edf4 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:30.546810845 +0000 UTC m=+283.630584679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7x4g8" (UID: "c2df2a6f-8d63-40ba-b8a6-c5431d00edf4") : secret "networking-console-plugin-cert" not found
Jul 08 19:28:22.578043 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:22.578016    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkkt7_f686f053-5871-4fb2-a166-bf03f11ac95a/serve-healthcheck-canary/0.log"
Jul 08 19:28:22.647725 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:22.647678    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:22.647857 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.647825    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 19:28:22.647897 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:22.647883    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls podName:db54376f-0888-444e-a3ea-b302d25afcac nodeName:}" failed. No retries permitted until 2026-07-08 19:28:30.647868124 +0000 UTC m=+283.731641954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zwt9b" (UID: "db54376f-0888-444e-a3ea-b302d25afcac") : secret "samples-operator-tls" not found
Jul 08 19:28:23.219097 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.219066    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-jxq4v"]
Jul 08 19:28:23.221477 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.221460    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.228026 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.228001    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 19:28:23.228130 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.228037    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 19:28:23.228130 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.228008    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 19:28:23.228293 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.228278    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 19:28:23.229151 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.229137    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mc4vb\""
Jul 08 19:28:23.236343 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.236324    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-jxq4v"]
Jul 08 19:28:23.259686 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.259657    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk" event={"ID":"aaf3de34-9622-4caa-8d13-66ae822f36c5","Type":"ContainerStarted","Data":"5e6974a6e96486b7632df3a4994c7a582005ac0bbbd45bad2070b72502105da8"}
Jul 08 19:28:23.259811 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.259713    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk" event={"ID":"aaf3de34-9622-4caa-8d13-66ae822f36c5","Type":"ContainerStarted","Data":"e718eed3c2f8ecbc4bc4646e1390f6218c31ccb422557743c43dce2f301ab851"}
Jul 08 19:28:23.288363 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.288313    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4wbtk" podStartSLOduration=2.454547183 podStartE2EDuration="4.288298202s" totalImagesPullingTime="1.833751019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:23.287849357 +0000 UTC m=+276.371623207" watchObservedRunningTime="2026-07-08 19:28:23.288298202 +0000 UTC m=+276.372072052"
Jul 08 19:28:23.352684 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.352649    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/14df55a7-2335-4301-a1cc-98ec2d32f557-signing-key\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.353071 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.352760    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdlrr\" (UniqueName: \"kubernetes.io/projected/14df55a7-2335-4301-a1cc-98ec2d32f557-kube-api-access-qdlrr\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.353071 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.352782    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/14df55a7-2335-4301-a1cc-98ec2d32f557-signing-cabundle\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.453370 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.453332    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/14df55a7-2335-4301-a1cc-98ec2d32f557-signing-key\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.453529 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.453441    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdlrr\" (UniqueName: \"kubernetes.io/projected/14df55a7-2335-4301-a1cc-98ec2d32f557-kube-api-access-qdlrr\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.453529 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.453465    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/14df55a7-2335-4301-a1cc-98ec2d32f557-signing-cabundle\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.454069 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.454052    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/14df55a7-2335-4301-a1cc-98ec2d32f557-signing-cabundle\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.455750 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.455731    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/14df55a7-2335-4301-a1cc-98ec2d32f557-signing-key\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.465893 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.465868    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdlrr\" (UniqueName: \"kubernetes.io/projected/14df55a7-2335-4301-a1cc-98ec2d32f557-kube-api-access-qdlrr\") pod \"service-ca-758f599c5-jxq4v\" (UID: \"14df55a7-2335-4301-a1cc-98ec2d32f557\") " pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.529900 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.529823    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-jxq4v"
Jul 08 19:28:23.657363 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:23.657333    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-jxq4v"]
Jul 08 19:28:23.660633 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:23.660592    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14df55a7_2335_4301_a1cc_98ec2d32f557.slice/crio-8529da2d0fe025f25c43e4f7ab3569d035e5dd241aec2dc534b94f3bbdb70de8 WatchSource:0}: Error finding container 8529da2d0fe025f25c43e4f7ab3569d035e5dd241aec2dc534b94f3bbdb70de8: Status 404 returned error can't find the container with id 8529da2d0fe025f25c43e4f7ab3569d035e5dd241aec2dc534b94f3bbdb70de8
Jul 08 19:28:24.264653 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:24.264606    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-jxq4v" event={"ID":"14df55a7-2335-4301-a1cc-98ec2d32f557","Type":"ContainerStarted","Data":"8529da2d0fe025f25c43e4f7ab3569d035e5dd241aec2dc534b94f3bbdb70de8"}
Jul 08 19:28:25.232735 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:25.232702    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:25.233147 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:25.232757    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:25.233147 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:25.233128    2554 scope.go:117] "RemoveContainer" containerID="c8e1aa20e4b135fac67fabf6a795825cb0b0e3335616d238693b51d0922cf812"
Jul 08 19:28:25.233324 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:25.233302    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8zj64_openshift-console-operator(33ad7dc8-4317-4678-9b61-f9c7dfec68da)\"" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" podUID="33ad7dc8-4317-4678-9b61-f9c7dfec68da"
Jul 08 19:28:26.273321 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:26.273281    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-jxq4v" event={"ID":"14df55a7-2335-4301-a1cc-98ec2d32f557","Type":"ContainerStarted","Data":"51344a91e065994827e35d508b27404f43db93bb45ff9f10d2ef0f9c7f06e002"}
Jul 08 19:28:26.291674 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:26.291611    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-jxq4v" podStartSLOduration=1.161495986 podStartE2EDuration="3.291595949s" totalImagesPullingTime="2.130099963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:26.290930002 +0000 UTC m=+279.374703854" watchObservedRunningTime="2026-07-08 19:28:26.291595949 +0000 UTC m=+279.375369801"
Jul 08 19:28:26.378888 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:26.378854    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:26.379002 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:26.378978    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:26.379047 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:26.378977    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 19:28:26.379146 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:26.379116    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:26.379248 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:26.379073    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:34.379055112 +0000 UTC m=+287.462828963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : configmap "kube-rbac-proxy" not found
Jul 08 19:28:26.379248 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:26.379204    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:34.379188162 +0000 UTC m=+287.462962002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:30.614851 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:30.614804    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:30.615429 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:30.614952    2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 19:28:30.615429 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:30.615020    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert podName:c2df2a6f-8d63-40ba-b8a6-c5431d00edf4 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:46.615002669 +0000 UTC m=+299.698776498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7x4g8" (UID: "c2df2a6f-8d63-40ba-b8a6-c5431d00edf4") : secret "networking-console-plugin-cert" not found
Jul 08 19:28:30.715977 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:30.715943    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:30.718259 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:30.718228    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db54376f-0888-444e-a3ea-b302d25afcac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zwt9b\" (UID: \"db54376f-0888-444e-a3ea-b302d25afcac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:30.817721 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:30.817670    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"
Jul 08 19:28:30.951436 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:30.951405    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b"]
Jul 08 19:28:31.291547 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:31.291512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b" event={"ID":"db54376f-0888-444e-a3ea-b302d25afcac","Type":"ContainerStarted","Data":"b3d260e73956e4ae63b5e861c9adf3c07b497896e37f020d95db27fcb5f0b2b9"}
Jul 08 19:28:32.977133 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:32.977095    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5lvw7" podUID="15c94254-c8e2-401c-a617-d9233c41e47c"
Jul 08 19:28:32.977133 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:32.977122    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" podUID="766d57ce-b128-4237-9695-e689778ec75e"
Jul 08 19:28:33.304483 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:33.304389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b" event={"ID":"db54376f-0888-444e-a3ea-b302d25afcac","Type":"ContainerStarted","Data":"999514d449fdfe41763846b166d5b40a09a08385431a5cc9fe113c620c2bd330"}
Jul 08 19:28:33.304483 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:33.304442    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:28:33.304685 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:33.304492    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b" event={"ID":"db54376f-0888-444e-a3ea-b302d25afcac","Type":"ContainerStarted","Data":"c05f2785a71ab6fac41a3f1fe5e7c0cc1b4af616b725ef724074146f56075f3a"}
Jul 08 19:28:33.304685 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:33.304658    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:28:33.328912 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:33.328861    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zwt9b" podStartSLOduration=17.324853244 podStartE2EDuration="19.328847021s" totalImagesPullingTime="2.003993777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:33.327138516 +0000 UTC m=+286.410912356" watchObservedRunningTime="2026-07-08 19:28:33.328847021 +0000 UTC m=+286.412620871"
Jul 08 19:28:34.447525 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:34.447489    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:34.447995 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:34.447584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:34.447995 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:34.447745    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:34.447995 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:34.447844    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls podName:642c9980-ddef-4e85-843c-3f3d99d28e01 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:50.447821044 +0000 UTC m=+303.531594888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-42m9g" (UID: "642c9980-ddef-4e85-843c-3f3d99d28e01") : secret "insights-runtime-extractor-tls" not found
Jul 08 19:28:34.448153 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:34.448042    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c9980-ddef-4e85-843c-3f3d99d28e01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:35.492344 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:35.492314    2554 scope.go:117] "RemoveContainer" containerID="c8e1aa20e4b135fac67fabf6a795825cb0b0e3335616d238693b51d0922cf812"
Jul 08 19:28:36.315171 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.315142    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:28:36.315555 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.315539    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/1.log"
Jul 08 19:28:36.315606 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.315571    2554 generic.go:356] "Generic (PLEG): container finished" podID="33ad7dc8-4317-4678-9b61-f9c7dfec68da" containerID="4b2ec84eb6d76f821dfd3f2d191a94a29f8552e24a58259838b1433bd74e8f3f" exitCode=255
Jul 08 19:28:36.315667 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.315606    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" event={"ID":"33ad7dc8-4317-4678-9b61-f9c7dfec68da","Type":"ContainerDied","Data":"4b2ec84eb6d76f821dfd3f2d191a94a29f8552e24a58259838b1433bd74e8f3f"}
Jul 08 19:28:36.315701 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.315666    2554 scope.go:117] "RemoveContainer" containerID="c8e1aa20e4b135fac67fabf6a795825cb0b0e3335616d238693b51d0922cf812"
Jul 08 19:28:36.315981 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.315964    2554 scope.go:117] "RemoveContainer" containerID="4b2ec84eb6d76f821dfd3f2d191a94a29f8552e24a58259838b1433bd74e8f3f"
Jul 08 19:28:36.316135 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:36.316117    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8zj64_openshift-console-operator(33ad7dc8-4317-4678-9b61-f9c7dfec68da)\"" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" podUID="33ad7dc8-4317-4678-9b61-f9c7dfec68da"
Jul 08 19:28:36.766076 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.766046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:28:36.766562 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.766176    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:28:36.768356 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.768320    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"image-registry-b5785657c-cgkjd\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") " pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:28:36.768356 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.768334    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15c94254-c8e2-401c-a617-d9233c41e47c-metrics-tls\") pod \"dns-default-5lvw7\" (UID: \"15c94254-c8e2-401c-a617-d9233c41e47c\") " pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:28:36.908631 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.908599    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-phtdc\""
Jul 08 19:28:36.908789 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.908653    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dclc4\""
Jul 08 19:28:36.915884 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.915868    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:28:36.915978 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:36.915964    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:28:37.103147 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.103110    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5lvw7"]
Jul 08 19:28:37.106431 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:37.106407    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c94254_c8e2_401c_a617_d9233c41e47c.slice/crio-cb56606053f14bbeb96955ebdd5e12cc779053f50c605ac9470f744b12d31a50 WatchSource:0}: Error finding container cb56606053f14bbeb96955ebdd5e12cc779053f50c605ac9470f744b12d31a50: Status 404 returned error can't find the container with id cb56606053f14bbeb96955ebdd5e12cc779053f50c605ac9470f744b12d31a50
Jul 08 19:28:37.121756 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.121728    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5785657c-cgkjd"]
Jul 08 19:28:37.125889 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:37.125866    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766d57ce_b128_4237_9695_e689778ec75e.slice/crio-16c9af1c1e055250ac3433ae7f2e6df671319b11146a4513bad086fab0bec5ba WatchSource:0}: Error finding container 16c9af1c1e055250ac3433ae7f2e6df671319b11146a4513bad086fab0bec5ba: Status 404 returned error can't find the container with id 16c9af1c1e055250ac3433ae7f2e6df671319b11146a4513bad086fab0bec5ba
Jul 08 19:28:37.320453 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.320379    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:28:37.321602 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.321576    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5lvw7" event={"ID":"15c94254-c8e2-401c-a617-d9233c41e47c","Type":"ContainerStarted","Data":"cb56606053f14bbeb96955ebdd5e12cc779053f50c605ac9470f744b12d31a50"}
Jul 08 19:28:37.325802 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.325771    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" event={"ID":"766d57ce-b128-4237-9695-e689778ec75e","Type":"ContainerStarted","Data":"f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e"}
Jul 08 19:28:37.325923 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.325816    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" event={"ID":"766d57ce-b128-4237-9695-e689778ec75e","Type":"ContainerStarted","Data":"16c9af1c1e055250ac3433ae7f2e6df671319b11146a4513bad086fab0bec5ba"}
Jul 08 19:28:37.325923 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.325854    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:28:37.353068 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:37.353019    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" podStartSLOduration=289.353003578 podStartE2EDuration="4m49.353003578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:37.35140895 +0000 UTC m=+290.435182802" watchObservedRunningTime="2026-07-08 19:28:37.353003578 +0000 UTC m=+290.436777428"
Jul 08 19:28:40.339506 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:40.339469    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5lvw7" event={"ID":"15c94254-c8e2-401c-a617-d9233c41e47c","Type":"ContainerStarted","Data":"73d5ccb3c0c231d29e1044e891bc7452ec39d9efaf8ba8fbe239992e181312bd"}
Jul 08 19:28:40.339909 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:40.339520    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5lvw7" event={"ID":"15c94254-c8e2-401c-a617-d9233c41e47c","Type":"ContainerStarted","Data":"4aad973d84d29ef9bd7b0c2cf4d783ec1938b9d92fae8d8c20d9a5102380032e"}
Jul 08 19:28:40.339909 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:40.339551    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:28:40.360295 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:40.360246    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5lvw7" podStartSLOduration=252.09668746 podStartE2EDuration="4m14.360231795s" totalImagesPullingTime="2.263544335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:40.35947428 +0000 UTC m=+293.443248132" watchObservedRunningTime="2026-07-08 19:28:40.360231795 +0000 UTC m=+293.444005623"
Jul 08 19:28:45.232659 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:45.232601    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:45.233103 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:45.232683    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:28:45.233103 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:45.232974    2554 scope.go:117] "RemoveContainer" containerID="4b2ec84eb6d76f821dfd3f2d191a94a29f8552e24a58259838b1433bd74e8f3f"
Jul 08 19:28:45.233201 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:45.233126    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8zj64_openshift-console-operator(33ad7dc8-4317-4678-9b61-f9c7dfec68da)\"" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" podUID="33ad7dc8-4317-4678-9b61-f9c7dfec68da"
Jul 08 19:28:46.493478 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:46.493437    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-svtnq" podUID="e715f486-90f1-47dd-84e1-b11d8ea3f690"
Jul 08 19:28:46.637485 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:46.637447    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:46.639762 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:46.639741    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2df2a6f-8d63-40ba-b8a6-c5431d00edf4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7x4g8\" (UID: \"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:46.922957 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:46.922928    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"
Jul 08 19:28:47.062884 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:47.062853    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8"]
Jul 08 19:28:47.065892 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:47.065863    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2df2a6f_8d63_40ba_b8a6_c5431d00edf4.slice/crio-4b096d672fb43923684cfd6e7ff181208c4a8910a8878f9f0342e920cad752b5 WatchSource:0}: Error finding container 4b096d672fb43923684cfd6e7ff181208c4a8910a8878f9f0342e920cad752b5: Status 404 returned error can't find the container with id 4b096d672fb43923684cfd6e7ff181208c4a8910a8878f9f0342e920cad752b5
Jul 08 19:28:47.363064 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:47.362981    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8" event={"ID":"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4","Type":"ContainerStarted","Data":"4b096d672fb43923684cfd6e7ff181208c4a8910a8878f9f0342e920cad752b5"}
Jul 08 19:28:47.367391 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:47.367359    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:28:47.368060 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:47.368042    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:28:47.377000 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:47.376983    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 19:28:49.372036 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.372003    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8" event={"ID":"c2df2a6f-8d63-40ba-b8a6-c5431d00edf4","Type":"ContainerStarted","Data":"ba23dc8c94d17f7267d26c046659a672b1cb4efa72d94d5dc77ca12c538fdf32"}
Jul 08 19:28:49.389520 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.389473    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7x4g8" podStartSLOduration=33.772531855 podStartE2EDuration="35.389457789s" totalImagesPullingTime="1.616925934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:49.388401883 +0000 UTC m=+302.472175735" watchObservedRunningTime="2026-07-08 19:28:49.389457789 +0000 UTC m=+302.473231640"
Jul 08 19:28:49.756170 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.756133    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"]
Jul 08 19:28:49.758393 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.758378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:49.760879 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.760852    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 08 19:28:49.760991 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.760937    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9jld4\""
Jul 08 19:28:49.771574 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.771551    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"]
Jul 08 19:28:49.863493 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.863449    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/869e903f-dcb9-4785-aafc-db70c9728fc8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ccq55\" (UID: \"869e903f-dcb9-4785-aafc-db70c9728fc8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:49.964320 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:49.964287    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/869e903f-dcb9-4785-aafc-db70c9728fc8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ccq55\" (UID: \"869e903f-dcb9-4785-aafc-db70c9728fc8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:49.964524 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:49.964427    2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 08 19:28:49.964524 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:49.964485    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869e903f-dcb9-4785-aafc-db70c9728fc8-tls-certificates podName:869e903f-dcb9-4785-aafc-db70c9728fc8 nodeName:}" failed. No retries permitted until 2026-07-08 19:28:50.464471648 +0000 UTC m=+303.548245478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/869e903f-dcb9-4785-aafc-db70c9728fc8-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-ccq55" (UID: "869e903f-dcb9-4785-aafc-db70c9728fc8") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 08 19:28:50.345219 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.345192    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5lvw7"
Jul 08 19:28:50.468597 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.468557    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/869e903f-dcb9-4785-aafc-db70c9728fc8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ccq55\" (UID: \"869e903f-dcb9-4785-aafc-db70c9728fc8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:50.469097 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.468614    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:50.471006 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.470981    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/869e903f-dcb9-4785-aafc-db70c9728fc8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ccq55\" (UID: \"869e903f-dcb9-4785-aafc-db70c9728fc8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:50.471006 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.470991    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c9980-ddef-4e85-843c-3f3d99d28e01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42m9g\" (UID: \"642c9980-ddef-4e85-843c-3f3d99d28e01\") " pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:50.668499 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.668459    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:50.743929 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.743907    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5vrqz\""
Jul 08 19:28:50.750849 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.750829    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-42m9g"
Jul 08 19:28:50.795347 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.795317    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"]
Jul 08 19:28:50.798833 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:50.798801    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869e903f_dcb9_4785_aafc_db70c9728fc8.slice/crio-5b63c51681446275132f8832df233bb41c2d3ec9c37f055174b86661d82e62d3 WatchSource:0}: Error finding container 5b63c51681446275132f8832df233bb41c2d3ec9c37f055174b86661d82e62d3: Status 404 returned error can't find the container with id 5b63c51681446275132f8832df233bb41c2d3ec9c37f055174b86661d82e62d3
Jul 08 19:28:50.801411 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.801390    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 19:28:50.885564 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:50.885537    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-42m9g"]
Jul 08 19:28:50.888589 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:50.888565    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642c9980_ddef_4e85_843c_3f3d99d28e01.slice/crio-38706f1e0737d329b980e5bcf87d7c01373ca39de2ea312376bea6186ea4d5b7 WatchSource:0}: Error finding container 38706f1e0737d329b980e5bcf87d7c01373ca39de2ea312376bea6186ea4d5b7: Status 404 returned error can't find the container with id 38706f1e0737d329b980e5bcf87d7c01373ca39de2ea312376bea6186ea4d5b7
Jul 08 19:28:51.378636 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:51.378485    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42m9g" event={"ID":"642c9980-ddef-4e85-843c-3f3d99d28e01","Type":"ContainerStarted","Data":"38706f1e0737d329b980e5bcf87d7c01373ca39de2ea312376bea6186ea4d5b7"}
Jul 08 19:28:51.379560 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:51.379536    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55" event={"ID":"869e903f-dcb9-4785-aafc-db70c9728fc8","Type":"ContainerStarted","Data":"5b63c51681446275132f8832df233bb41c2d3ec9c37f055174b86661d82e62d3"}
Jul 08 19:28:53.389132 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.389092    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55" event={"ID":"869e903f-dcb9-4785-aafc-db70c9728fc8","Type":"ContainerStarted","Data":"cdf3f7388328b266595e7e95315fc286eaded17a79fd680197906ef8cdc3471c"}
Jul 08 19:28:53.389593 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.389277    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:53.394879 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.394852    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55"
Jul 08 19:28:53.406455 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.406393    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ccq55" podStartSLOduration=2.782211844 podStartE2EDuration="4.406375568s" totalImagesPullingTime="1.624163724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:53.404584483 +0000 UTC m=+306.488358331" watchObservedRunningTime="2026-07-08 19:28:53.406375568 +0000 UTC m=+306.490149420"
Jul 08 19:28:53.845242 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.845168    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"]
Jul 08 19:28:53.847663 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.847639    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.850218 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.850191    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 08 19:28:53.851283 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.851135    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 19:28:53.851283 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.851149    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cql75\""
Jul 08 19:28:53.851283 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.851151    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 08 19:28:53.851283 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.851199    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 19:28:53.851283 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.851149    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 19:28:53.857892 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.857822    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"]
Jul 08 19:28:53.895424 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.895382    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/533d4f16-4619-46b0-b490-9e9ad53d3386-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.895612 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.895430    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/533d4f16-4619-46b0-b490-9e9ad53d3386-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.895612 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.895490    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmxbc\" (UniqueName: \"kubernetes.io/projected/533d4f16-4619-46b0-b490-9e9ad53d3386-kube-api-access-xmxbc\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.895612 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.895536    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/533d4f16-4619-46b0-b490-9e9ad53d3386-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.996067 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.996032    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/533d4f16-4619-46b0-b490-9e9ad53d3386-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.996255 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.996076    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/533d4f16-4619-46b0-b490-9e9ad53d3386-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.996255 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.996226    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmxbc\" (UniqueName: \"kubernetes.io/projected/533d4f16-4619-46b0-b490-9e9ad53d3386-kube-api-access-xmxbc\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.996371 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.996307    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/533d4f16-4619-46b0-b490-9e9ad53d3386-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.996855 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.996811    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/533d4f16-4619-46b0-b490-9e9ad53d3386-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.998840 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.998808    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/533d4f16-4619-46b0-b490-9e9ad53d3386-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:53.999302 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:53.999252    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/533d4f16-4619-46b0-b490-9e9ad53d3386-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:54.019902 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:54.019865    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmxbc\" (UniqueName: \"kubernetes.io/projected/533d4f16-4619-46b0-b490-9e9ad53d3386-kube-api-access-xmxbc\") pod \"prometheus-operator-567f7b8b7c-6nf5c\" (UID: \"533d4f16-4619-46b0-b490-9e9ad53d3386\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:54.158534 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:54.158505    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"
Jul 08 19:28:54.883794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:54.883762    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c"]
Jul 08 19:28:54.887469 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:54.887436    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533d4f16_4619_46b0_b490_9e9ad53d3386.slice/crio-bf9928e06762f7635df13b3d700d71e75477af2aed6861328d947228ee217a58 WatchSource:0}: Error finding container bf9928e06762f7635df13b3d700d71e75477af2aed6861328d947228ee217a58: Status 404 returned error can't find the container with id bf9928e06762f7635df13b3d700d71e75477af2aed6861328d947228ee217a58
Jul 08 19:28:55.397397 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:55.397369    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42m9g" event={"ID":"642c9980-ddef-4e85-843c-3f3d99d28e01","Type":"ContainerStarted","Data":"fa8ceccc1804643c4e6e5cb257bccf4ce97c102d3b7ff6ebe3097e336b0aa360"}
Jul 08 19:28:55.398419 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:55.398396    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c" event={"ID":"533d4f16-4619-46b0-b490-9e9ad53d3386","Type":"ContainerStarted","Data":"bf9928e06762f7635df13b3d700d71e75477af2aed6861328d947228ee217a58"}
Jul 08 19:28:56.406315 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:56.406281    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42m9g" event={"ID":"642c9980-ddef-4e85-843c-3f3d99d28e01","Type":"ContainerStarted","Data":"09479c0fed589f3577c6fb7120d809b301d4a513de850eb992f3400a09afb8ba"}
Jul 08 19:28:56.921366 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:56.921330    2554 patch_prober.go:28] interesting pod/image-registry-b5785657c-cgkjd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 19:28:56.921534 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:56.921387    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" podUID="766d57ce-b128-4237-9695-e689778ec75e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 19:28:57.412764 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:57.412728    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c" event={"ID":"533d4f16-4619-46b0-b490-9e9ad53d3386","Type":"ContainerStarted","Data":"84d94dbea036d93896ea04c04054ff74fb29b2c7d362a48e7624b8bf467ed3a1"}
Jul 08 19:28:57.413207 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:57.412804    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c" event={"ID":"533d4f16-4619-46b0-b490-9e9ad53d3386","Type":"ContainerStarted","Data":"f2b0e7c22af19244dc313f18f8768b8d40eb793646e9b7e2e9752a6cca7b5030"}
Jul 08 19:28:57.432721 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:57.432671    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6nf5c" podStartSLOduration=2.93095094 podStartE2EDuration="4.432654473s" totalImagesPullingTime="1.501703533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:57.431202335 +0000 UTC m=+310.514976186" watchObservedRunningTime="2026-07-08 19:28:57.432654473 +0000 UTC m=+310.516428323"
Jul 08 19:28:58.334544 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:58.334471    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:28:58.418590 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:58.418549    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42m9g" event={"ID":"642c9980-ddef-4e85-843c-3f3d99d28e01","Type":"ContainerStarted","Data":"9e039e8f6fc3c3b2e3e2c50f3a89e949cf6ae16befdaa52b5840b260c08bd7cf"}
Jul 08 19:28:58.436155 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:58.436111    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-42m9g" podStartSLOduration=33.483382793 podStartE2EDuration="40.43609452s" totalImagesPullingTime="6.952711727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:28:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:28:58.435793662 +0000 UTC m=+311.519567516" watchObservedRunningTime="2026-07-08 19:28:58.43609452 +0000 UTC m=+311.519868371"
Jul 08 19:28:58.491609 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:58.491580    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:28:59.258601 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.258567    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"]
Jul 08 19:28:59.261322 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.261305    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.264249 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.264226    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 19:28:59.264384 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.264230    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nvdk9\""
Jul 08 19:28:59.264384 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.264285    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 19:28:59.284325 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.284302    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"]
Jul 08 19:28:59.296486 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.296456    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fz9jr"]
Jul 08 19:28:59.298691 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.298675    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.301980 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.301958    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 19:28:59.302109 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.302017    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 19:28:59.302397 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.302379    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 19:28:59.303041 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.303020    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7zzsr\""
Jul 08 19:28:59.341533 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341482    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-textfile\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.341533 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341525    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.341864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341557    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-tls\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.341864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341609    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-accelerators-collector-config\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.341864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341723    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.341864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341751    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d22sj\" (UniqueName: \"kubernetes.io/projected/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-kube-api-access-d22sj\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.341864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341787    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-metrics-client-ca\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.341864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341812    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.341864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341833    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk5mb\" (UniqueName: \"kubernetes.io/projected/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-kube-api-access-tk5mb\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.342171 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341884    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-sys\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.342171 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341917    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-wtmp\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.342171 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341952    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-root\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.342171 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.341977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442359 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442325    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-root\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442359 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442386    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-textfile\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442432    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-root\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442590    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-tls\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442641    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-accelerators-collector-config\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442696    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442726    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d22sj\" (UniqueName: \"kubernetes.io/projected/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-kube-api-access-d22sj\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442741    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-textfile\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442790    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-metrics-client-ca\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442831    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.442899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442855    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk5mb\" (UniqueName: \"kubernetes.io/projected/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-kube-api-access-tk5mb\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.443444 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-sys\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.443444 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.442950    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-wtmp\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.443444 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.443098    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-wtmp\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.443444 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.443263    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-accelerators-collector-config\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.443444 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:59.443281    2554 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 08 19:28:59.443444 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:28:59.443344    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-tls podName:09e163ed-dd6c-47aa-a0ef-1876e9a2189c nodeName:}" failed. No retries permitted until 2026-07-08 19:28:59.94332715 +0000 UTC m=+313.027100982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-j6v2q" (UID: "09e163ed-dd6c-47aa-a0ef-1876e9a2189c") : secret "openshift-state-metrics-tls" not found
Jul 08 19:28:59.443779 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.443595    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-metrics-client-ca\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.443779 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.443684    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-sys\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.444239 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.444211    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.445818 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.445796    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-tls\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.446407 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.446390    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.446532 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.446511    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.454403 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.454377    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk5mb\" (UniqueName: \"kubernetes.io/projected/174a7b71-da8c-477b-bdb5-2f8ddd9cf2db-kube-api-access-tk5mb\") pod \"node-exporter-fz9jr\" (UID: \"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db\") " pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.455398 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.455376    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d22sj\" (UniqueName: \"kubernetes.io/projected/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-kube-api-access-d22sj\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.609611 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.609531    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fz9jr"
Jul 08 19:28:59.619843 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:28:59.619816    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174a7b71_da8c_477b_bdb5_2f8ddd9cf2db.slice/crio-757b0aed71e5a98b9a7018093dd35cd7865c782a11aa2161ed29c41097a7a7d9 WatchSource:0}: Error finding container 757b0aed71e5a98b9a7018093dd35cd7865c782a11aa2161ed29c41097a7a7d9: Status 404 returned error can't find the container with id 757b0aed71e5a98b9a7018093dd35cd7865c782a11aa2161ed29c41097a7a7d9
Jul 08 19:28:59.948338 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.948303    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:28:59.950640 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:28:59.950607    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09e163ed-dd6c-47aa-a0ef-1876e9a2189c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j6v2q\" (UID: \"09e163ed-dd6c-47aa-a0ef-1876e9a2189c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:29:00.170978 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:00.170935    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"
Jul 08 19:29:00.340499 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:00.340409    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q"]
Jul 08 19:29:00.343472 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:29:00.343442    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e163ed_dd6c_47aa_a0ef_1876e9a2189c.slice/crio-4fd29301c34981eefdde233bda7d2e3dab0918c397451d3cdb42326a581ac07b WatchSource:0}: Error finding container 4fd29301c34981eefdde233bda7d2e3dab0918c397451d3cdb42326a581ac07b: Status 404 returned error can't find the container with id 4fd29301c34981eefdde233bda7d2e3dab0918c397451d3cdb42326a581ac07b
Jul 08 19:29:00.438999 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:00.438965    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fz9jr" event={"ID":"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db","Type":"ContainerStarted","Data":"757b0aed71e5a98b9a7018093dd35cd7865c782a11aa2161ed29c41097a7a7d9"}
Jul 08 19:29:00.441274 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:00.441241    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q" event={"ID":"09e163ed-dd6c-47aa-a0ef-1876e9a2189c","Type":"ContainerStarted","Data":"f746dde8c4981c9f381d709075148e7de4db65d70aa8f0b25fd8e52fc993e51a"}
Jul 08 19:29:00.441390 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:00.441303    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q" event={"ID":"09e163ed-dd6c-47aa-a0ef-1876e9a2189c","Type":"ContainerStarted","Data":"4fd29301c34981eefdde233bda7d2e3dab0918c397451d3cdb42326a581ac07b"}
Jul 08 19:29:00.492151 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:00.492133    2554 scope.go:117] "RemoveContainer" containerID="4b2ec84eb6d76f821dfd3f2d191a94a29f8552e24a58259838b1433bd74e8f3f"
Jul 08 19:29:01.450101 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.450053    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q" event={"ID":"09e163ed-dd6c-47aa-a0ef-1876e9a2189c","Type":"ContainerStarted","Data":"12a064993b6c250df509036f9cfb201a4f1f4592dd9d28d413fc7a68a75c39f5"}
Jul 08 19:29:01.452219 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.452197    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:29:01.452361 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.452302    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" event={"ID":"33ad7dc8-4317-4678-9b61-f9c7dfec68da","Type":"ContainerStarted","Data":"bad4f2d85a62ad2dddd799f1247027de176bc6f836b434e7700b5bf634fc8651"}
Jul 08 19:29:01.452694 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.452648    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:29:01.454863 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.454838    2554 generic.go:356] "Generic (PLEG): container finished" podID="174a7b71-da8c-477b-bdb5-2f8ddd9cf2db" containerID="94a01c57c1b32eadc8d59030e24f4f7b0fa2987e8b9bf11d139b455050583a03" exitCode=0
Jul 08 19:29:01.454981 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.454882    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fz9jr" event={"ID":"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db","Type":"ContainerDied","Data":"94a01c57c1b32eadc8d59030e24f4f7b0fa2987e8b9bf11d139b455050583a03"}
Jul 08 19:29:01.458335 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.458313    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-8zj64"
Jul 08 19:29:01.487306 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:01.487256    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-8zj64" podStartSLOduration=44.409836321 podStartE2EDuration="47.487233988s" totalImagesPullingTime="3.077397667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:29:01.486179776 +0000 UTC m=+314.569953631" watchObservedRunningTime="2026-07-08 19:29:01.487233988 +0000 UTC m=+314.571007850"
Jul 08 19:29:02.462661 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:02.462607    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q" event={"ID":"09e163ed-dd6c-47aa-a0ef-1876e9a2189c","Type":"ContainerStarted","Data":"11cd76b01b58c2a33a3d3dc9c7fc99f45da45906d926c6fe7ecc13316b63854c"}
Jul 08 19:29:02.464744 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:02.464720    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fz9jr" event={"ID":"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db","Type":"ContainerStarted","Data":"8bc9731b8fea6397bd8ddd01f36aa1e7d9506dbfa77d11ea4014b355fee2f9e5"}
Jul 08 19:29:02.464840 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:02.464765    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fz9jr" event={"ID":"174a7b71-da8c-477b-bdb5-2f8ddd9cf2db","Type":"ContainerStarted","Data":"80b92ca0d50ff40f308408e4d4bef08dd235e1c3a2e8b90dd249154b02b91953"}
Jul 08 19:29:02.485261 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:02.485216    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j6v2q" podStartSLOduration=2.348155707 podStartE2EDuration="3.485201814s" totalImagesPullingTime="1.137046107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:29:02.483758263 +0000 UTC m=+315.567532114" watchObservedRunningTime="2026-07-08 19:29:02.485201814 +0000 UTC m=+315.568975665"
Jul 08 19:29:02.506639 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:02.502609    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fz9jr" podStartSLOduration=2.293680186 podStartE2EDuration="3.502590216s" totalImagesPullingTime="1.141465576s" totalInitContainerRuntime="67.444454ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:29:02.502120293 +0000 UTC m=+315.585894145" watchObservedRunningTime="2026-07-08 19:29:02.502590216 +0000 UTC m=+315.586364071"
Jul 08 19:29:05.580447 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.580411    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b5785657c-cgkjd"]
Jul 08 19:29:05.763515 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.763479    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:29:05.767602 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.767577    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.775591 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.775571    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 19:29:05.775831 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.775814    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 19:29:05.775918 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.775849    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 19:29:05.775987 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.775970    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 19:29:05.776823 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.776809    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 19:29:05.777054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.777037    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qw89m\""
Jul 08 19:29:05.777054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.777046    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 19:29:05.777181 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.777046    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 19:29:05.783915 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.783886    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 19:29:05.783915 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.783903    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 19:29:05.784063 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.783925    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 19:29:05.784063 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.783927    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 19:29:05.784218 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.784202    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 19:29:05.785448 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.785432    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5tt7o9t6q7dar\""
Jul 08 19:29:05.785984 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.785969    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 19:29:05.797928 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.797901    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798020 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.797933    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798020 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.797965    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-config-out\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798077    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798230 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798105    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798230 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798126    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798230 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798174    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798237    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-config\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798273    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798304    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7dp\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-kube-api-access-2h7dp\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798330    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798356    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798387 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798386    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-web-config\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798661 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798412    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798661 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798428    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798661 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798455    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798661 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798480    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.798661 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.798501    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.799764 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.799747    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 19:29:05.808423 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.808407    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 19:29:05.853506 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.853434    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:29:05.899324 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.899296    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-config\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.899513 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.899335    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.899782 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.899762    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7dp\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-kube-api-access-2h7dp\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.899872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.899795    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.899981 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.899952    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.899991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-web-config\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900032    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900059    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900119 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900116    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900339 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900339 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900181    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900339 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900210    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900339 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900235    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900339 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900275    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-config-out\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.900339 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900302    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.901046 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900343    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.901046 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900395    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.901046 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900436    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.901046 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900486    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.901046 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.900509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.904463 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.903300    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.904463 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.904008    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.904936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.904911    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.905644 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.905537    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.906696 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.906077    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-config\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.906696 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.906416    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.907830 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.907651    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.908708 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.908263    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.908708 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.908259    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.909189 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.909099    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.910241 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.910204    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.910828 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.910704    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.910933 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.910911    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.911611 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.911585    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-web-config\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.912414 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.912362    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.912737 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.912707    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7dp\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-kube-api-access-2h7dp\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.914438 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.914411    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.914861 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.914446    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-config-out\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.915787 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.915768    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:05.918129 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:05.918104    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:06.077366 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:06.077327    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:06.226645 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:06.226606    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:29:06.228935 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:29:06.228910    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39278e31_d38e_4214_992f_050a2a0d3316.slice/crio-66759468a283d4ce931945b38373010806e5b7ea0bcd51e10db6eb38696556d1 WatchSource:0}: Error finding container 66759468a283d4ce931945b38373010806e5b7ea0bcd51e10db6eb38696556d1: Status 404 returned error can't find the container with id 66759468a283d4ce931945b38373010806e5b7ea0bcd51e10db6eb38696556d1
Jul 08 19:29:06.481427 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:06.481392    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerStarted","Data":"66759468a283d4ce931945b38373010806e5b7ea0bcd51e10db6eb38696556d1"}
Jul 08 19:29:07.391189 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:29:07.391154    2554 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39278e31_d38e_4214_992f_050a2a0d3316.slice/crio-conmon-8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78.scope\": RecentStats: unable to find data in memory cache]"
Jul 08 19:29:07.485534 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:07.485497    2554 generic.go:356] "Generic (PLEG): container finished" podID="39278e31-d38e-4214-992f-050a2a0d3316" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78" exitCode=0
Jul 08 19:29:07.485703 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:07.485573    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"}
Jul 08 19:29:11.510078 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:11.509987    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerStarted","Data":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"}
Jul 08 19:29:11.510078 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:11.510057    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerStarted","Data":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"}
Jul 08 19:29:14.528262 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:14.528169    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerStarted","Data":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"}
Jul 08 19:29:14.528262 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:14.528238    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerStarted","Data":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"}
Jul 08 19:29:14.528262 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:14.528265    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerStarted","Data":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"}
Jul 08 19:29:14.528754 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:14.528295    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerStarted","Data":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"}
Jul 08 19:29:14.577807 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:14.577745    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.154988934 podStartE2EDuration="9.577727278s" totalImagesPullingTime="7.403657316s" totalInitContainerRuntime="19.081028ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:29:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:29:14.577300953 +0000 UTC m=+327.661074824" watchObservedRunningTime="2026-07-08 19:29:14.577727278 +0000 UTC m=+327.661501136"
Jul 08 19:29:16.077642 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:16.077593    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:29:29.587481 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:29.587450    2554 generic.go:356] "Generic (PLEG): container finished" podID="7c1b3c09-ea56-4b29-9394-130c9b0594eb" containerID="ad6899836808b2bf66dc0b9ca09f259ffd89e40998ac312aed9994824446cc90" exitCode=0
Jul 08 19:29:29.587914 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:29.587524    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc" event={"ID":"7c1b3c09-ea56-4b29-9394-130c9b0594eb","Type":"ContainerDied","Data":"ad6899836808b2bf66dc0b9ca09f259ffd89e40998ac312aed9994824446cc90"}
Jul 08 19:29:29.587914 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:29.587850    2554 scope.go:117] "RemoveContainer" containerID="ad6899836808b2bf66dc0b9ca09f259ffd89e40998ac312aed9994824446cc90"
Jul 08 19:29:30.597894 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:30.597857    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qsvrc" event={"ID":"7c1b3c09-ea56-4b29-9394-130c9b0594eb","Type":"ContainerStarted","Data":"f48f54212de1b12392a4f4150dfb34430f4730250395aa91ed9c4272cde3a2d6"}
Jul 08 19:29:30.599862 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:30.599826    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" podUID="766d57ce-b128-4237-9695-e689778ec75e" containerName="registry" containerID="cri-o://f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e" gracePeriod=30
Jul 08 19:29:30.878266 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:30.878237    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:29:31.028529 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028498    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.028703 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028541    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/766d57ce-b128-4237-9695-e689778ec75e-ca-trust-extracted\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.028703 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028576    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-installation-pull-secrets\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.028703 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028605    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-registry-certificates\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.028703 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028665    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msbnc\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-kube-api-access-msbnc\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.028870 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028804    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-image-registry-private-configuration\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.028870 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028858    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-bound-sa-token\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.028969 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.028896    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-trusted-ca\") pod \"766d57ce-b128-4237-9695-e689778ec75e\" (UID: \"766d57ce-b128-4237-9695-e689778ec75e\") "
Jul 08 19:29:31.029138 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.029105    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:29:31.029234 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.029218    2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-registry-certificates\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.029530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.029503    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:29:31.031198 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.031100    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:29:31.031306 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.031185    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:29:31.031378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.031323    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:29:31.031378 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.031368    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-kube-api-access-msbnc" (OuterVolumeSpecName: "kube-api-access-msbnc") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "kube-api-access-msbnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:29:31.031539 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.031520    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:29:31.037146 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.037125    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766d57ce-b128-4237-9695-e689778ec75e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "766d57ce-b128-4237-9695-e689778ec75e" (UID: "766d57ce-b128-4237-9695-e689778ec75e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:29:31.129936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.129856    2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-registry-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.129936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.129883    2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/766d57ce-b128-4237-9695-e689778ec75e-ca-trust-extracted\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.129936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.129893    2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-installation-pull-secrets\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.129936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.129902    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msbnc\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-kube-api-access-msbnc\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.129936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.129911    2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/766d57ce-b128-4237-9695-e689778ec75e-image-registry-private-configuration\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.129936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.129920    2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/766d57ce-b128-4237-9695-e689778ec75e-bound-sa-token\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.129936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.129928    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/766d57ce-b128-4237-9695-e689778ec75e-trusted-ca\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:29:31.602884 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.602852    2554 generic.go:356] "Generic (PLEG): container finished" podID="766d57ce-b128-4237-9695-e689778ec75e" containerID="f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e" exitCode=0
Jul 08 19:29:31.603260 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.602896    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5785657c-cgkjd"
Jul 08 19:29:31.603260 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.602936    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" event={"ID":"766d57ce-b128-4237-9695-e689778ec75e","Type":"ContainerDied","Data":"f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e"}
Jul 08 19:29:31.603260 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.602989    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5785657c-cgkjd" event={"ID":"766d57ce-b128-4237-9695-e689778ec75e","Type":"ContainerDied","Data":"16c9af1c1e055250ac3433ae7f2e6df671319b11146a4513bad086fab0bec5ba"}
Jul 08 19:29:31.603260 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.603012    2554 scope.go:117] "RemoveContainer" containerID="f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e"
Jul 08 19:29:31.613209 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.613184    2554 scope.go:117] "RemoveContainer" containerID="f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e"
Jul 08 19:29:31.613463 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:29:31.613441    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e\": container with ID starting with f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e not found: ID does not exist" containerID="f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e"
Jul 08 19:29:31.613530 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.613478    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e"} err="failed to get container status \"f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e\": rpc error: code = NotFound desc = could not find container \"f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e\": container with ID starting with f91d7455cf46e6d3a663645b55bf9c8662660d4c22bcbb183bc60d2520f8646e not found: ID does not exist"
Jul 08 19:29:31.622038 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.622017    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b5785657c-cgkjd"]
Jul 08 19:29:31.626456 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:31.626437    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b5785657c-cgkjd"]
Jul 08 19:29:33.496364 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:33.496333    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="766d57ce-b128-4237-9695-e689778ec75e" path="/var/lib/kubelet/pods/766d57ce-b128-4237-9695-e689778ec75e/volumes"
Jul 08 19:29:44.555381 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:29:44.555289    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkkt7_f686f053-5871-4fb2-a166-bf03f11ac95a/serve-healthcheck-canary/0.log"
Jul 08 19:30:01.278474 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:01.278430    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:30:01.280854 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:01.280831    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e715f486-90f1-47dd-84e1-b11d8ea3f690-metrics-certs\") pod \"network-metrics-daemon-svtnq\" (UID: \"e715f486-90f1-47dd-84e1-b11d8ea3f690\") " pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:30:01.494603 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:01.494575    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgx5c\""
Jul 08 19:30:01.502341 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:01.502322    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svtnq"
Jul 08 19:30:01.634664 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:01.634612    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svtnq"]
Jul 08 19:30:01.637591 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:30:01.637559    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode715f486_90f1_47dd_84e1_b11d8ea3f690.slice/crio-5e7243cf1868dc57a9749ac1ffc390c7bbe3c1e621db11d008fb46083bd7d39e WatchSource:0}: Error finding container 5e7243cf1868dc57a9749ac1ffc390c7bbe3c1e621db11d008fb46083bd7d39e: Status 404 returned error can't find the container with id 5e7243cf1868dc57a9749ac1ffc390c7bbe3c1e621db11d008fb46083bd7d39e
Jul 08 19:30:01.718290 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:01.718254    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svtnq" event={"ID":"e715f486-90f1-47dd-84e1-b11d8ea3f690","Type":"ContainerStarted","Data":"5e7243cf1868dc57a9749ac1ffc390c7bbe3c1e621db11d008fb46083bd7d39e"}
Jul 08 19:30:03.729629 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:03.729574    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svtnq" event={"ID":"e715f486-90f1-47dd-84e1-b11d8ea3f690","Type":"ContainerStarted","Data":"6af669a7f168dbeaa9a64017133e7ac29ad752059fb55a090be3269f9179181f"}
Jul 08 19:30:04.735330 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:04.735293    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svtnq" event={"ID":"e715f486-90f1-47dd-84e1-b11d8ea3f690","Type":"ContainerStarted","Data":"3c5930f5d4e381e10b56410cb3b00c32b8f5b8c9160aa345e7c114cc2b1e71b3"}
Jul 08 19:30:04.754258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:04.754207    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-svtnq" podStartSLOduration=374.784866644 podStartE2EDuration="6m16.754192811s" totalImagesPullingTime="1.969326167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:30:04.752871194 +0000 UTC m=+377.836645048" watchObservedRunningTime="2026-07-08 19:30:04.754192811 +0000 UTC m=+377.837966662"
Jul 08 19:30:06.078457 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:06.078428    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:06.099091 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:06.099064    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:06.757723 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:06.757694    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:23.973783 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:23.973748    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:30:23.974267 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:23.974119    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="prometheus" containerID="cri-o://09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da" gracePeriod=600
Jul 08 19:30:23.974267 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:23.974149    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy" containerID="cri-o://01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef" gracePeriod=600
Jul 08 19:30:23.974267 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:23.974176    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="thanos-sidecar" containerID="cri-o://af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373" gracePeriod=600
Jul 08 19:30:23.974409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:23.974193    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-web" containerID="cri-o://58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8" gracePeriod=600
Jul 08 19:30:23.974409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:23.974261    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef" gracePeriod=600
Jul 08 19:30:23.974508 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:23.974259    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="config-reloader" containerID="cri-o://b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d" gracePeriod=600
Jul 08 19:30:24.229678 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.229597    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.372583 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372544    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-grpc-tls\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.372794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372592    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-metrics-client-certs\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.372794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372610    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-thanos-prometheus-http-client-file\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.372794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372656    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-kube-rbac-proxy\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.372794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372672    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-2\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.372794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372762    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-kubelet-serving-ca-bundle\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372812    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372851    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-0\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372879    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-1\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372910    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-tls\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372935    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-web-config\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372942    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.372961    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-tls-assets\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373004    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-metrics-client-ca\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373058 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373045    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-db\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373468 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373076    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h7dp\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-kube-api-access-2h7dp\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373468 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373104    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373468 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373141    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:30:24.373468 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373160    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-config-out\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.373699 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373482    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:30:24.373699 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.373513    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:30:24.375187 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.374559    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:30:24.375490 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375457    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.375605 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375503    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.375605 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375519    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-trusted-ca-bundle\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.375605 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375566    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-serving-certs-ca-bundle\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.375605 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375597    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-config\") pod \"39278e31-d38e-4214-992f-050a2a0d3316\" (UID: \"39278e31-d38e-4214-992f-050a2a0d3316\") "
Jul 08 19:30:24.375839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375596    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.375909 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375873    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.375962 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375886    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-metrics-client-ca\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.375962 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375935    2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-grpc-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.375962 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375954    2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-metrics-client-certs\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.376105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375969    2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-kube-rbac-proxy\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.376105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.375985    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.376105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376001    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.376105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376017    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.376105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376019    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.376105 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376032    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.376392 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376129    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.376529 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376492    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:30:24.376585 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376564    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-config-out" (OuterVolumeSpecName: "config-out") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:30:24.376914 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.376891    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:30:24.377064 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.377042    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:30:24.378034 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.378013    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-kube-api-access-2h7dp" (OuterVolumeSpecName: "kube-api-access-2h7dp") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "kube-api-access-2h7dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:30:24.378100 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.378059    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:30:24.378176 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.378159    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.378348 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.378331    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-config" (OuterVolumeSpecName: "config") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.387941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.387909    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-web-config" (OuterVolumeSpecName: "web-config") pod "39278e31-d38e-4214-992f-050a2a0d3316" (UID: "39278e31-d38e-4214-992f-050a2a0d3316"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:30:24.476675 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476637    2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-config-out\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476675 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476668    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476675 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476678    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39278e31-d38e-4214-992f-050a2a0d3316-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476675 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476686    2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-config\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476695    2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476706    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476714    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476723    2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-web-config\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476731    2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-tls-assets\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476738    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39278e31-d38e-4214-992f-050a2a0d3316-prometheus-k8s-db\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476746    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h7dp\" (UniqueName: \"kubernetes.io/projected/39278e31-d38e-4214-992f-050a2a0d3316-kube-api-access-2h7dp\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.476922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.476756    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39278e31-d38e-4214-992f-050a2a0d3316-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:30:24.814491 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814454    2554 generic.go:356] "Generic (PLEG): container finished" podID="39278e31-d38e-4214-992f-050a2a0d3316" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef" exitCode=0
Jul 08 19:30:24.814491 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814482    2554 generic.go:356] "Generic (PLEG): container finished" podID="39278e31-d38e-4214-992f-050a2a0d3316" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef" exitCode=0
Jul 08 19:30:24.814491 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814490    2554 generic.go:356] "Generic (PLEG): container finished" podID="39278e31-d38e-4214-992f-050a2a0d3316" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8" exitCode=0
Jul 08 19:30:24.814491 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814499    2554 generic.go:356] "Generic (PLEG): container finished" podID="39278e31-d38e-4214-992f-050a2a0d3316" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373" exitCode=0
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814506    2554 generic.go:356] "Generic (PLEG): container finished" podID="39278e31-d38e-4214-992f-050a2a0d3316" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d" exitCode=0
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814514    2554 generic.go:356] "Generic (PLEG): container finished" podID="39278e31-d38e-4214-992f-050a2a0d3316" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da" exitCode=0
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814534    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"}
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814564    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814607    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"}
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814641    2554 scope.go:117] "RemoveContainer" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814648    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"}
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814675    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"}
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814700    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"}
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814724    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"}
Jul 08 19:30:24.814839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.814748    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39278e31-d38e-4214-992f-050a2a0d3316","Type":"ContainerDied","Data":"66759468a283d4ce931945b38373010806e5b7ea0bcd51e10db6eb38696556d1"}
Jul 08 19:30:24.826285 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.826264    2554 scope.go:117] "RemoveContainer" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.833764 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.833743    2554 scope.go:117] "RemoveContainer" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.841205 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.841186    2554 scope.go:117] "RemoveContainer" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.841927 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.841905    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:30:24.848855 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.848830    2554 scope.go:117] "RemoveContainer" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.849146 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.849126    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:30:24.855946 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.855924    2554 scope.go:117] "RemoveContainer" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.863427 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.863405    2554 scope.go:117] "RemoveContainer" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.870527 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.870501    2554 scope.go:117] "RemoveContainer" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.870843 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:30:24.870824    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": container with ID starting with b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef not found: ID does not exist" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.870909 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.870855    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"} err="failed to get container status \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": rpc error: code = NotFound desc = could not find container \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": container with ID starting with b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef not found: ID does not exist"
Jul 08 19:30:24.870909 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.870878    2554 scope.go:117] "RemoveContainer" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.871134 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:30:24.871116    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": container with ID starting with 01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef not found: ID does not exist" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.871200 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.871141    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"} err="failed to get container status \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": rpc error: code = NotFound desc = could not find container \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": container with ID starting with 01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef not found: ID does not exist"
Jul 08 19:30:24.871200 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.871158    2554 scope.go:117] "RemoveContainer" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.871435 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:30:24.871417    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": container with ID starting with 58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8 not found: ID does not exist" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.871511 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.871443    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"} err="failed to get container status \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": rpc error: code = NotFound desc = could not find container \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": container with ID starting with 58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8 not found: ID does not exist"
Jul 08 19:30:24.871511 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.871464    2554 scope.go:117] "RemoveContainer" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.871740 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:30:24.871719    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": container with ID starting with af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373 not found: ID does not exist" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.871820 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.871745    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"} err="failed to get container status \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": rpc error: code = NotFound desc = could not find container \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": container with ID starting with af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373 not found: ID does not exist"
Jul 08 19:30:24.871820 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.871763    2554 scope.go:117] "RemoveContainer" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.871984 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:30:24.871965    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": container with ID starting with b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d not found: ID does not exist" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.872056 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.871992    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"} err="failed to get container status \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": rpc error: code = NotFound desc = could not find container \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": container with ID starting with b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d not found: ID does not exist"
Jul 08 19:30:24.872056 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872011    2554 scope.go:117] "RemoveContainer" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.872224 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:30:24.872208    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": container with ID starting with 09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da not found: ID does not exist" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.872262 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872228    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"} err="failed to get container status \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": rpc error: code = NotFound desc = could not find container \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": container with ID starting with 09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da not found: ID does not exist"
Jul 08 19:30:24.872262 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872242    2554 scope.go:117] "RemoveContainer" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.872472 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:30:24.872455    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": container with ID starting with 8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78 not found: ID does not exist" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.872514 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872475    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"} err="failed to get container status \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": rpc error: code = NotFound desc = could not find container \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": container with ID starting with 8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78 not found: ID does not exist"
Jul 08 19:30:24.872514 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872499    2554 scope.go:117] "RemoveContainer" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.872727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872700    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"} err="failed to get container status \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": rpc error: code = NotFound desc = could not find container \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": container with ID starting with b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef not found: ID does not exist"
Jul 08 19:30:24.872727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872726    2554 scope.go:117] "RemoveContainer" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.872936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872919    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"} err="failed to get container status \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": rpc error: code = NotFound desc = could not find container \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": container with ID starting with 01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef not found: ID does not exist"
Jul 08 19:30:24.872936 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.872938    2554 scope.go:117] "RemoveContainer" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.873196 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873181    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"} err="failed to get container status \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": rpc error: code = NotFound desc = could not find container \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": container with ID starting with 58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8 not found: ID does not exist"
Jul 08 19:30:24.873245 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873197    2554 scope.go:117] "RemoveContainer" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.873388 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873374    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"} err="failed to get container status \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": rpc error: code = NotFound desc = could not find container \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": container with ID starting with af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373 not found: ID does not exist"
Jul 08 19:30:24.873435 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873388    2554 scope.go:117] "RemoveContainer" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.873555 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873541    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"} err="failed to get container status \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": rpc error: code = NotFound desc = could not find container \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": container with ID starting with b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d not found: ID does not exist"
Jul 08 19:30:24.873632 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873555    2554 scope.go:117] "RemoveContainer" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.873733 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873716    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"} err="failed to get container status \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": rpc error: code = NotFound desc = could not find container \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": container with ID starting with 09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da not found: ID does not exist"
Jul 08 19:30:24.873794 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873734    2554 scope.go:117] "RemoveContainer" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.873921 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873904    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"} err="failed to get container status \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": rpc error: code = NotFound desc = could not find container \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": container with ID starting with 8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78 not found: ID does not exist"
Jul 08 19:30:24.873998 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.873923    2554 scope.go:117] "RemoveContainer" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.874187 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874169    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"} err="failed to get container status \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": rpc error: code = NotFound desc = could not find container \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": container with ID starting with b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef not found: ID does not exist"
Jul 08 19:30:24.874223 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874195    2554 scope.go:117] "RemoveContainer" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.874405 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874388    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"} err="failed to get container status \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": rpc error: code = NotFound desc = could not find container \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": container with ID starting with 01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef not found: ID does not exist"
Jul 08 19:30:24.874405 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874404    2554 scope.go:117] "RemoveContainer" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.874604 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874588    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"} err="failed to get container status \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": rpc error: code = NotFound desc = could not find container \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": container with ID starting with 58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8 not found: ID does not exist"
Jul 08 19:30:24.874666 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874605    2554 scope.go:117] "RemoveContainer" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.874864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874846    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"} err="failed to get container status \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": rpc error: code = NotFound desc = could not find container \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": container with ID starting with af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373 not found: ID does not exist"
Jul 08 19:30:24.874902 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.874866    2554 scope.go:117] "RemoveContainer" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.875060 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875041    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"} err="failed to get container status \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": rpc error: code = NotFound desc = could not find container \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": container with ID starting with b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d not found: ID does not exist"
Jul 08 19:30:24.875101 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875060    2554 scope.go:117] "RemoveContainer" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.875288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875268    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"} err="failed to get container status \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": rpc error: code = NotFound desc = could not find container \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": container with ID starting with 09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da not found: ID does not exist"
Jul 08 19:30:24.875288 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875286    2554 scope.go:117] "RemoveContainer" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.875509 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875492    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"} err="failed to get container status \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": rpc error: code = NotFound desc = could not find container \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": container with ID starting with 8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78 not found: ID does not exist"
Jul 08 19:30:24.875509 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875509    2554 scope.go:117] "RemoveContainer" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.875752 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875733    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"} err="failed to get container status \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": rpc error: code = NotFound desc = could not find container \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": container with ID starting with b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef not found: ID does not exist"
Jul 08 19:30:24.875825 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875753    2554 scope.go:117] "RemoveContainer" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.875972 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875956    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"} err="failed to get container status \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": rpc error: code = NotFound desc = could not find container \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": container with ID starting with 01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef not found: ID does not exist"
Jul 08 19:30:24.876022 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.875972    2554 scope.go:117] "RemoveContainer" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.876170 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876150    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"} err="failed to get container status \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": rpc error: code = NotFound desc = could not find container \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": container with ID starting with 58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8 not found: ID does not exist"
Jul 08 19:30:24.876233 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876171    2554 scope.go:117] "RemoveContainer" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.876386 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876369    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"} err="failed to get container status \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": rpc error: code = NotFound desc = could not find container \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": container with ID starting with af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373 not found: ID does not exist"
Jul 08 19:30:24.876429 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876388    2554 scope.go:117] "RemoveContainer" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.876575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876557    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"} err="failed to get container status \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": rpc error: code = NotFound desc = could not find container \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": container with ID starting with b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d not found: ID does not exist"
Jul 08 19:30:24.876655 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876576    2554 scope.go:117] "RemoveContainer" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.876785 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876767    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"} err="failed to get container status \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": rpc error: code = NotFound desc = could not find container \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": container with ID starting with 09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da not found: ID does not exist"
Jul 08 19:30:24.876819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876785    2554 scope.go:117] "RemoveContainer" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.877009 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.876992    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"} err="failed to get container status \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": rpc error: code = NotFound desc = could not find container \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": container with ID starting with 8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78 not found: ID does not exist"
Jul 08 19:30:24.877053 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877010    2554 scope.go:117] "RemoveContainer" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.877217 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877199    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"} err="failed to get container status \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": rpc error: code = NotFound desc = could not find container \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": container with ID starting with b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef not found: ID does not exist"
Jul 08 19:30:24.877257 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877218    2554 scope.go:117] "RemoveContainer" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.877428 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877411    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"} err="failed to get container status \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": rpc error: code = NotFound desc = could not find container \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": container with ID starting with 01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef not found: ID does not exist"
Jul 08 19:30:24.877473 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877428    2554 scope.go:117] "RemoveContainer" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.877659 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877636    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"} err="failed to get container status \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": rpc error: code = NotFound desc = could not find container \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": container with ID starting with 58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8 not found: ID does not exist"
Jul 08 19:30:24.877659 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877658    2554 scope.go:117] "RemoveContainer" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.877895 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877877    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"} err="failed to get container status \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": rpc error: code = NotFound desc = could not find container \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": container with ID starting with af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373 not found: ID does not exist"
Jul 08 19:30:24.877941 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.877895    2554 scope.go:117] "RemoveContainer" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.878111 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878090    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"} err="failed to get container status \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": rpc error: code = NotFound desc = could not find container \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": container with ID starting with b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d not found: ID does not exist"
Jul 08 19:30:24.878154 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878116    2554 scope.go:117] "RemoveContainer" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.878317 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878299    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"} err="failed to get container status \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": rpc error: code = NotFound desc = could not find container \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": container with ID starting with 09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da not found: ID does not exist"
Jul 08 19:30:24.878390 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878319    2554 scope.go:117] "RemoveContainer" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.878537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878520    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"} err="failed to get container status \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": rpc error: code = NotFound desc = could not find container \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": container with ID starting with 8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78 not found: ID does not exist"
Jul 08 19:30:24.878603 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878538    2554 scope.go:117] "RemoveContainer" containerID="b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"
Jul 08 19:30:24.878762 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878745    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef"} err="failed to get container status \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": rpc error: code = NotFound desc = could not find container \"b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef\": container with ID starting with b29168bc2f472419a96bee983b8c0896e0f86116ebb549e60d40578b94d7a0ef not found: ID does not exist"
Jul 08 19:30:24.878807 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878763    2554 scope.go:117] "RemoveContainer" containerID="01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"
Jul 08 19:30:24.878979 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878960    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef"} err="failed to get container status \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": rpc error: code = NotFound desc = could not find container \"01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef\": container with ID starting with 01d878ff6036a43e49cfd925e2dc7d223cf8b281513174b5146cbb66e3e165ef not found: ID does not exist"
Jul 08 19:30:24.879041 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.878979    2554 scope.go:117] "RemoveContainer" containerID="58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"
Jul 08 19:30:24.879200 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879180    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8"} err="failed to get container status \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": rpc error: code = NotFound desc = could not find container \"58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8\": container with ID starting with 58d309c22b182ed18190fa51f04c795932a76c9b4ce746aed759e75e107fcad8 not found: ID does not exist"
Jul 08 19:30:24.879244 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879200    2554 scope.go:117] "RemoveContainer" containerID="af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"
Jul 08 19:30:24.879395 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879379    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373"} err="failed to get container status \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": rpc error: code = NotFound desc = could not find container \"af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373\": container with ID starting with af7fce34b413c814ff6f04e7c4ae2df32a0bcd25cb1b7602be1f4d21f82b1373 not found: ID does not exist"
Jul 08 19:30:24.879436 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879395    2554 scope.go:117] "RemoveContainer" containerID="b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"
Jul 08 19:30:24.879600 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879583    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d"} err="failed to get container status \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": rpc error: code = NotFound desc = could not find container \"b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d\": container with ID starting with b8a329fc4e6cd32af95d510abcf9f3cdb42ac887c96e0f8fc2cc01c1b897155d not found: ID does not exist"
Jul 08 19:30:24.879679 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879601    2554 scope.go:117] "RemoveContainer" containerID="09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"
Jul 08 19:30:24.879797 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879781    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da"} err="failed to get container status \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": rpc error: code = NotFound desc = could not find container \"09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da\": container with ID starting with 09054316f31dc20f82e31107b73ff7e465af4cf257441b8043500e76777fc8da not found: ID does not exist"
Jul 08 19:30:24.879851 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879797    2554 scope.go:117] "RemoveContainer" containerID="8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"
Jul 08 19:30:24.879985 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.879960    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78"} err="failed to get container status \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": rpc error: code = NotFound desc = could not find container \"8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78\": container with ID starting with 8c8c875137b06965b6c227b6c3d15ca24deaf11c25b0409fbc9abc93fd9efe78 not found: ID does not exist"
Jul 08 19:30:24.882233 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882213    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:30:24.882491 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882479    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="prometheus"
Jul 08 19:30:24.882537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882493    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="prometheus"
Jul 08 19:30:24.882537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882507    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-web"
Jul 08 19:30:24.882537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882513    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-web"
Jul 08 19:30:24.882537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882521    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy"
Jul 08 19:30:24.882537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882526    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy"
Jul 08 19:30:24.882537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882533    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-thanos"
Jul 08 19:30:24.882537 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882538    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-thanos"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882548    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="init-config-reloader"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882553    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="init-config-reloader"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882560    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766d57ce-b128-4237-9695-e689778ec75e" containerName="registry"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882565    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="766d57ce-b128-4237-9695-e689778ec75e" containerName="registry"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882575    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="thanos-sidecar"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882580    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="thanos-sidecar"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882586    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="config-reloader"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882591    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="config-reloader"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882657    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="config-reloader"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882666    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="prometheus"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882672    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="thanos-sidecar"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882677    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882683    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-thanos"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882688    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="766d57ce-b128-4237-9695-e689778ec75e" containerName="registry"
Jul 08 19:30:24.882819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.882693    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="39278e31-d38e-4214-992f-050a2a0d3316" containerName="kube-rbac-proxy-web"
Jul 08 19:30:24.888162 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.888142    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.892985 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.892956    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 19:30:24.892985 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.892968    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 19:30:24.892985 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.892968    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 19:30:24.893186 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.893101    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 19:30:24.893186 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.893113    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 19:30:24.893319 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.893305    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 19:30:24.893379 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.893334    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qw89m\""
Jul 08 19:30:24.893589 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.893575    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 19:30:24.893682 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.893588    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5tt7o9t6q7dar\""
Jul 08 19:30:24.894575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.894414    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 19:30:24.894575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.894423    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 19:30:24.894575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.894425    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 19:30:24.894575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.894430    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 19:30:24.895790 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.895612    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 19:30:24.895790 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.895687    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 19:30:24.896934 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.896912    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 19:30:24.901714 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.901694    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 19:30:24.905357 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.905339    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:30:24.979641 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979592    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979651    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979676    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f45f18aa-2fce-490a-b586-0f3c426c55d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979813    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-495rn\" (UniqueName: \"kubernetes.io/projected/f45f18aa-2fce-490a-b586-0f3c426c55d1-kube-api-access-495rn\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979862    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979897    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979945    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.979977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980006    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980054 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980038    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980127    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f45f18aa-2fce-490a-b586-0f3c426c55d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980197    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980222    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980279    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980305    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980320    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-config\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:24.980452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:24.980334    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.081811 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.081708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.081977 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.081809    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.081977 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.081839    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-config\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.081977 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.081857    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082135 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082048    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082135 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082081    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082135 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082114    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f45f18aa-2fce-490a-b586-0f3c426c55d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082282 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082282 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082174    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-495rn\" (UniqueName: \"kubernetes.io/projected/f45f18aa-2fce-490a-b586-0f3c426c55d1-kube-api-access-495rn\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082282 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082211    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082282 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082236    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082282 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082279    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082523 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082314    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082523 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082344    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082523 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082378    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082523 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082411    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082523 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082443    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082523 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082480    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f45f18aa-2fce-490a-b586-0f3c426c55d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082523 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082502    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082529    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082530    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082550    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082653    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.082872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.082812    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.085024 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.084990    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-config\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.085658 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.085609    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.085754 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.085666    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.085754 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.085708    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.085824 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.085753    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.086324 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.086298    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.086324 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.086311    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.086573 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.086550    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.086764 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.086742    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f45f18aa-2fce-490a-b586-0f3c426c55d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.086974 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.086954    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f45f18aa-2fce-490a-b586-0f3c426c55d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.087041 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.086986    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.087728 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.087700    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.087971 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.087955    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.088766 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.088749    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f45f18aa-2fce-490a-b586-0f3c426c55d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.088833 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.088772    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f45f18aa-2fce-490a-b586-0f3c426c55d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.092501 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.092478    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-495rn\" (UniqueName: \"kubernetes.io/projected/f45f18aa-2fce-490a-b586-0f3c426c55d1-kube-api-access-495rn\") pod \"prometheus-k8s-0\" (UID: \"f45f18aa-2fce-490a-b586-0f3c426c55d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.198263 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.198217    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:30:25.344830 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.344803    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 19:30:25.346597 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:30:25.346570    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45f18aa_2fce_490a_b586_0f3c426c55d1.slice/crio-7d25c1cb7421d6201d2328d51ee4d8e7889f6350810b4b2eeef782c63962e869 WatchSource:0}: Error finding container 7d25c1cb7421d6201d2328d51ee4d8e7889f6350810b4b2eeef782c63962e869: Status 404 returned error can't find the container with id 7d25c1cb7421d6201d2328d51ee4d8e7889f6350810b4b2eeef782c63962e869
Jul 08 19:30:25.496853 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.496821    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39278e31-d38e-4214-992f-050a2a0d3316" path="/var/lib/kubelet/pods/39278e31-d38e-4214-992f-050a2a0d3316/volumes"
Jul 08 19:30:25.820033 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.819998    2554 generic.go:356] "Generic (PLEG): container finished" podID="f45f18aa-2fce-490a-b586-0f3c426c55d1" containerID="41a5a3cdba34440a4d67aa811b57f559b5a7e40405424bc773be4b237e51c612" exitCode=0
Jul 08 19:30:25.820199 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.820074    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerDied","Data":"41a5a3cdba34440a4d67aa811b57f559b5a7e40405424bc773be4b237e51c612"}
Jul 08 19:30:25.820199 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:25.820152    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerStarted","Data":"7d25c1cb7421d6201d2328d51ee4d8e7889f6350810b4b2eeef782c63962e869"}
Jul 08 19:30:26.828970 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:26.828935    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerStarted","Data":"7e9a2d73faea5cca5f0037511d66dc9a95ec0d6f2885d2c87744673271f84f87"}
Jul 08 19:30:26.829342 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:26.829043    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerStarted","Data":"eddcc35433ebf9fda2a7f42dae60749b6089357447a481916210bf8bc8e502ea"}
Jul 08 19:30:26.829342 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:26.829072    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerStarted","Data":"a5389a31a83002360e424fa730172f32f5ca8de1e3bb24f4dfc2433b1955a574"}
Jul 08 19:30:26.829342 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:26.829102    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerStarted","Data":"13d4cb185a609b08a7a0fd4d907b0b563919cc6f9631f3a844e88059577d1aba"}
Jul 08 19:30:26.829342 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:26.829138    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerStarted","Data":"90bc2f6b53e0c1cd8a0e34a76ec96f755478eea001f7324642036b8ed1ecf319"}
Jul 08 19:30:26.829342 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:26.829162    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f45f18aa-2fce-490a-b586-0f3c426c55d1","Type":"ContainerStarted","Data":"87ec735f5940867abe68e0ee7dbafae9e3505ba77e9755d28204430654b98861"}
Jul 08 19:30:26.857574 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:26.857505    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.838222095 podStartE2EDuration="2.857481382s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.259287ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:30:26.857176863 +0000 UTC m=+399.940950715" watchObservedRunningTime="2026-07-08 19:30:26.857481382 +0000 UTC m=+399.941255233"
Jul 08 19:30:30.199401 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:30:30.199360    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:31:25.199417 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:25.199378    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:31:25.214758 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:25.214725    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:31:26.075701 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:26.075676    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 19:31:51.123347 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.123308    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"]
Jul 08 19:31:51.126294 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.126278    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.128398 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.128377    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6pwv5\""
Jul 08 19:31:51.128645 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.128611    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 19:31:51.129258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.129245    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 19:31:51.135953 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.135931    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"]
Jul 08 19:31:51.266162 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.266120    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbcch\" (UniqueName: \"kubernetes.io/projected/55aab5b0-8e3f-4074-9c29-d2e3780dec4b-kube-api-access-lbcch\") pod \"cert-manager-cainjector-559cdd8c87-b5vf4\" (UID: \"55aab5b0-8e3f-4074-9c29-d2e3780dec4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.266342 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.266174    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55aab5b0-8e3f-4074-9c29-d2e3780dec4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b5vf4\" (UID: \"55aab5b0-8e3f-4074-9c29-d2e3780dec4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.366815 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.366766    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbcch\" (UniqueName: \"kubernetes.io/projected/55aab5b0-8e3f-4074-9c29-d2e3780dec4b-kube-api-access-lbcch\") pod \"cert-manager-cainjector-559cdd8c87-b5vf4\" (UID: \"55aab5b0-8e3f-4074-9c29-d2e3780dec4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.367007 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.366866    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55aab5b0-8e3f-4074-9c29-d2e3780dec4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b5vf4\" (UID: \"55aab5b0-8e3f-4074-9c29-d2e3780dec4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.375277 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.375213    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55aab5b0-8e3f-4074-9c29-d2e3780dec4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b5vf4\" (UID: \"55aab5b0-8e3f-4074-9c29-d2e3780dec4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.375374 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.375360    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbcch\" (UniqueName: \"kubernetes.io/projected/55aab5b0-8e3f-4074-9c29-d2e3780dec4b-kube-api-access-lbcch\") pod \"cert-manager-cainjector-559cdd8c87-b5vf4\" (UID: \"55aab5b0-8e3f-4074-9c29-d2e3780dec4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.444686 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.444647    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"
Jul 08 19:31:51.574303 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:51.574263    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4"]
Jul 08 19:31:51.577502 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:31:51.577477    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55aab5b0_8e3f_4074_9c29_d2e3780dec4b.slice/crio-22beca9b57179548395d6228a9a716b56715ec57c96da117b6def73d5b35822b WatchSource:0}: Error finding container 22beca9b57179548395d6228a9a716b56715ec57c96da117b6def73d5b35822b: Status 404 returned error can't find the container with id 22beca9b57179548395d6228a9a716b56715ec57c96da117b6def73d5b35822b
Jul 08 19:31:52.162258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:52.162222    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4" event={"ID":"55aab5b0-8e3f-4074-9c29-d2e3780dec4b","Type":"ContainerStarted","Data":"22beca9b57179548395d6228a9a716b56715ec57c96da117b6def73d5b35822b"}
Jul 08 19:31:56.181778 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:56.181740    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4" event={"ID":"55aab5b0-8e3f-4074-9c29-d2e3780dec4b","Type":"ContainerStarted","Data":"1e04d3e2a14e58942b80ceee67d87f22f7dd602d68aa5d6993cb2fc665cadd7e"}
Jul 08 19:31:56.199027 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:31:56.198962    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b5vf4" podStartSLOduration=0.972812948 podStartE2EDuration="5.198940238s" totalImagesPullingTime="4.22612729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:31:56.196681566 +0000 UTC m=+489.280455418" watchObservedRunningTime="2026-07-08 19:31:56.198940238 +0000 UTC m=+489.282714091"
Jul 08 19:32:23.467152 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.467108    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"]
Jul 08 19:32:23.469551 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.469529    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.472094 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.472075    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 19:32:23.473032 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.473008    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 19:32:23.473032 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.473022    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 19:32:23.473205 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.473022    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l7l9z\""
Jul 08 19:32:23.473205 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.473061    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:32:23.473205 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.473065    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 19:32:23.485899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.485873    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"]
Jul 08 19:32:23.531954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.531922    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2217414d-a20a-4f26-a1db-be0d0b18f59e-metrics-cert\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.531954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.531961    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29wzp\" (UniqueName: \"kubernetes.io/projected/2217414d-a20a-4f26-a1db-be0d0b18f59e-kube-api-access-29wzp\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.532191 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.532008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2217414d-a20a-4f26-a1db-be0d0b18f59e-cert\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.532191 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.532094    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2217414d-a20a-4f26-a1db-be0d0b18f59e-manager-config\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.633271 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.633238    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29wzp\" (UniqueName: \"kubernetes.io/projected/2217414d-a20a-4f26-a1db-be0d0b18f59e-kube-api-access-29wzp\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.633432 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.633284    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2217414d-a20a-4f26-a1db-be0d0b18f59e-cert\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.633432 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.633332    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2217414d-a20a-4f26-a1db-be0d0b18f59e-manager-config\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.633432 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.633357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2217414d-a20a-4f26-a1db-be0d0b18f59e-metrics-cert\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.634141 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.634117    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2217414d-a20a-4f26-a1db-be0d0b18f59e-manager-config\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.635969 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.635948    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2217414d-a20a-4f26-a1db-be0d0b18f59e-metrics-cert\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.636061 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.635994    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2217414d-a20a-4f26-a1db-be0d0b18f59e-cert\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.644492 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.644459    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29wzp\" (UniqueName: \"kubernetes.io/projected/2217414d-a20a-4f26-a1db-be0d0b18f59e-kube-api-access-29wzp\") pod \"lws-controller-manager-6bb9464976-q92rv\" (UID: \"2217414d-a20a-4f26-a1db-be0d0b18f59e\") " pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.778952 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.778853    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:23.962543 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:23.962519    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"]
Jul 08 19:32:23.964402 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:32:23.964375    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2217414d_a20a_4f26_a1db_be0d0b18f59e.slice/crio-0734169867f41daff0bec24a53083be7ea3fa983f21b12d97b82f37e60129200 WatchSource:0}: Error finding container 0734169867f41daff0bec24a53083be7ea3fa983f21b12d97b82f37e60129200: Status 404 returned error can't find the container with id 0734169867f41daff0bec24a53083be7ea3fa983f21b12d97b82f37e60129200
Jul 08 19:32:24.293046 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:24.293011    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv" event={"ID":"2217414d-a20a-4f26-a1db-be0d0b18f59e","Type":"ContainerStarted","Data":"0734169867f41daff0bec24a53083be7ea3fa983f21b12d97b82f37e60129200"}
Jul 08 19:32:25.384888 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.384854    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"]
Jul 08 19:32:25.392376 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.392338    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.395223 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.395058    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 19:32:25.395394 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.395277    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 19:32:25.395932 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.395567    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 19:32:25.395932 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.395576    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g9lls\""
Jul 08 19:32:25.395932 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.395843    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 19:32:25.403756 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.403660    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"]
Jul 08 19:32:25.549367 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.549310    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/682ba84f-8e44-4b36-9622-7d2ff746246e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.549367 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.549363    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wnvb\" (UniqueName: \"kubernetes.io/projected/682ba84f-8e44-4b36-9622-7d2ff746246e-kube-api-access-2wnvb\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.549594 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.549403    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/682ba84f-8e44-4b36-9622-7d2ff746246e-webhook-cert\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.549594 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.549485    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682ba84f-8e44-4b36-9622-7d2ff746246e-tmp\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.549594 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.549520    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/682ba84f-8e44-4b36-9622-7d2ff746246e-manifests\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.650298 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.650218    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682ba84f-8e44-4b36-9622-7d2ff746246e-tmp\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.650298 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.650273    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/682ba84f-8e44-4b36-9622-7d2ff746246e-manifests\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.650525 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.650325    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/682ba84f-8e44-4b36-9622-7d2ff746246e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.650525 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.650341    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wnvb\" (UniqueName: \"kubernetes.io/projected/682ba84f-8e44-4b36-9622-7d2ff746246e-kube-api-access-2wnvb\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.650525 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.650360    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/682ba84f-8e44-4b36-9622-7d2ff746246e-webhook-cert\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.650821 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.650790    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/682ba84f-8e44-4b36-9622-7d2ff746246e-manifests\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.652901 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.652868    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682ba84f-8e44-4b36-9622-7d2ff746246e-tmp\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.653347 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.653323    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/682ba84f-8e44-4b36-9622-7d2ff746246e-webhook-cert\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.653409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.653351    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/682ba84f-8e44-4b36-9622-7d2ff746246e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.665828 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.665801    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wnvb\" (UniqueName: \"kubernetes.io/projected/682ba84f-8e44-4b36-9622-7d2ff746246e-kube-api-access-2wnvb\") pod \"opendatahub-operator-controller-manager-77ddc6fd87-cb29r\" (UID: \"682ba84f-8e44-4b36-9622-7d2ff746246e\") " pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:25.708788 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:25.708752    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:26.483791 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:26.483761    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"]
Jul 08 19:32:26.484270 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:32:26.484245    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682ba84f_8e44_4b36_9622_7d2ff746246e.slice/crio-45d1ac064c20fd75ae81db8af9c9f53cf6f8a10789029d64e40215ee44541d1e WatchSource:0}: Error finding container 45d1ac064c20fd75ae81db8af9c9f53cf6f8a10789029d64e40215ee44541d1e: Status 404 returned error can't find the container with id 45d1ac064c20fd75ae81db8af9c9f53cf6f8a10789029d64e40215ee44541d1e
Jul 08 19:32:27.310396 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:27.310355    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv" event={"ID":"2217414d-a20a-4f26-a1db-be0d0b18f59e","Type":"ContainerStarted","Data":"b4fafea5c75a58f03d2761a13896b974472908579cb66b4e6c586b0451c1fb56"}
Jul 08 19:32:27.310583 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:27.310566    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:27.312153 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:27.312095    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r" event={"ID":"682ba84f-8e44-4b36-9622-7d2ff746246e","Type":"ContainerStarted","Data":"45d1ac064c20fd75ae81db8af9c9f53cf6f8a10789029d64e40215ee44541d1e"}
Jul 08 19:32:27.329280 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:27.328447    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv" podStartSLOduration=1.90790865 podStartE2EDuration="4.328425407s" totalImagesPullingTime="2.420516757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:32:27.327583693 +0000 UTC m=+520.411357546" watchObservedRunningTime="2026-07-08 19:32:27.328425407 +0000 UTC m=+520.412199259"
Jul 08 19:32:29.322714 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:29.322678    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r" event={"ID":"682ba84f-8e44-4b36-9622-7d2ff746246e","Type":"ContainerStarted","Data":"291c6f9737083ec055901fd9e75dc7721bca13f3f9ec5d844eef2c142e85fb88"}
Jul 08 19:32:31.333177 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:31.333146    2554 generic.go:356] "Generic (PLEG): container finished" podID="682ba84f-8e44-4b36-9622-7d2ff746246e" containerID="291c6f9737083ec055901fd9e75dc7721bca13f3f9ec5d844eef2c142e85fb88" exitCode=0
Jul 08 19:32:31.333609 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:31.333192    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r" event={"ID":"682ba84f-8e44-4b36-9622-7d2ff746246e","Type":"ContainerDied","Data":"291c6f9737083ec055901fd9e75dc7721bca13f3f9ec5d844eef2c142e85fb88"}
Jul 08 19:32:32.339447 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:32.339414    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r" event={"ID":"682ba84f-8e44-4b36-9622-7d2ff746246e","Type":"ContainerStarted","Data":"f53d3c57bb956d57cb0ed2c479df05b873698508be05fc7a43bf480fb8135b66"}
Jul 08 19:32:32.339893 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:32.339639    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:32.362640 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:32.362572    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r" podStartSLOduration=3.083179763 podStartE2EDuration="7.362558105s" totalImagesPullingTime="3.226542736s" totalInitContainerRuntime="1.052835606s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:32:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:32:32.360460548 +0000 UTC m=+525.444234398" watchObservedRunningTime="2026-07-08 19:32:32.362558105 +0000 UTC m=+525.446331955"
Jul 08 19:32:38.319818 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:38.319730    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bb9464976-q92rv"
Jul 08 19:32:43.345795 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:43.345765    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77ddc6fd87-cb29r"
Jul 08 19:32:45.519255 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.519214    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"]
Jul 08 19:32:45.542201 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.542169    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.542782 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.542757    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"]
Jul 08 19:32:45.544521 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.544497    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 19:32:45.545464 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.545437    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 19:32:45.545578 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.545556    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 19:32:45.545656 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.545645    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 19:32:45.545734 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.545707    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9gk5k\""
Jul 08 19:32:45.628955 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.628922    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6288b026-90a2-472b-806f-70fc0486a8b9-tls-certs\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.628955 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.628958    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6288b026-90a2-472b-806f-70fc0486a8b9-tmp\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.629167 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.629027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbcc\" (UniqueName: \"kubernetes.io/projected/6288b026-90a2-472b-806f-70fc0486a8b9-kube-api-access-2pbcc\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.729758 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.729722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6288b026-90a2-472b-806f-70fc0486a8b9-tls-certs\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.729758 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.729762    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6288b026-90a2-472b-806f-70fc0486a8b9-tmp\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.729983 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.729796    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbcc\" (UniqueName: \"kubernetes.io/projected/6288b026-90a2-472b-806f-70fc0486a8b9-kube-api-access-2pbcc\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.732022 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.731996    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6288b026-90a2-472b-806f-70fc0486a8b9-tmp\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.732204 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.732187    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6288b026-90a2-472b-806f-70fc0486a8b9-tls-certs\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.738495 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.738468    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbcc\" (UniqueName: \"kubernetes.io/projected/6288b026-90a2-472b-806f-70fc0486a8b9-kube-api-access-2pbcc\") pod \"kube-auth-proxy-b84bffb4-v5fg9\" (UID: \"6288b026-90a2-472b-806f-70fc0486a8b9\") " pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:45.854195 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:45.854122    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"
Jul 08 19:32:46.046847 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:46.046813    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9"]
Jul 08 19:32:46.050260 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:32:46.050233    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6288b026_90a2_472b_806f_70fc0486a8b9.slice/crio-0d5d9d445076c3d03413780210384103593ff8fc46d75d8ed71f33d323bdc13b WatchSource:0}: Error finding container 0d5d9d445076c3d03413780210384103593ff8fc46d75d8ed71f33d323bdc13b: Status 404 returned error can't find the container with id 0d5d9d445076c3d03413780210384103593ff8fc46d75d8ed71f33d323bdc13b
Jul 08 19:32:46.403792 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:46.403755    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9" event={"ID":"6288b026-90a2-472b-806f-70fc0486a8b9","Type":"ContainerStarted","Data":"0d5d9d445076c3d03413780210384103593ff8fc46d75d8ed71f33d323bdc13b"}
Jul 08 19:32:49.068723 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:49.068702    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 19:32:49.418517 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:49.418483    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9" event={"ID":"6288b026-90a2-472b-806f-70fc0486a8b9","Type":"ContainerStarted","Data":"93332debefcbc40d0572f6685d05995a25546738ac5cffd61dbcb42a123d4818"}
Jul 08 19:32:49.435828 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:32:49.435776    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b84bffb4-v5fg9" podStartSLOduration=1.421971449 podStartE2EDuration="4.435759552s" totalImagesPullingTime="3.013788103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:32:49.434742289 +0000 UTC m=+542.518516142" watchObservedRunningTime="2026-07-08 19:32:49.435759552 +0000 UTC m=+542.519533402"
Jul 08 19:33:47.396444 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:33:47.396408    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:33:47.397525 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:33:47.397501    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:34:43.066504 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.066462    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"]
Jul 08 19:34:43.070282 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.070259    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.072163 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.072135    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 08 19:34:43.072490 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.072472    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 08 19:34:43.072886 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.072870    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 19:34:43.073052 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.073036    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-78nk4\""
Jul 08 19:34:43.073109 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.073066    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 19:34:43.079362 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.078252    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"]
Jul 08 19:34:43.087916 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.087871    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7f2d1eb-872c-4c0b-95f0-520d937cf230-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.088081 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.087961    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zhs4\" (UniqueName: \"kubernetes.io/projected/e7f2d1eb-872c-4c0b-95f0-520d937cf230-kube-api-access-8zhs4\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.088081 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.088031    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7f2d1eb-872c-4c0b-95f0-520d937cf230-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.188645 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.188591    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7f2d1eb-872c-4c0b-95f0-520d937cf230-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.188837 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.188690    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7f2d1eb-872c-4c0b-95f0-520d937cf230-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.188837 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.188729    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zhs4\" (UniqueName: \"kubernetes.io/projected/e7f2d1eb-872c-4c0b-95f0-520d937cf230-kube-api-access-8zhs4\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.188837 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:34:43.188732    2554 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 08 19:34:43.188837 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:34:43.188819    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f2d1eb-872c-4c0b-95f0-520d937cf230-plugin-serving-cert podName:e7f2d1eb-872c-4c0b-95f0-520d937cf230 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:43.688796501 +0000 UTC m=+656.772570332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e7f2d1eb-872c-4c0b-95f0-520d937cf230-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-445r8" (UID: "e7f2d1eb-872c-4c0b-95f0-520d937cf230") : secret "plugin-serving-cert" not found
Jul 08 19:34:43.189409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.189388    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7f2d1eb-872c-4c0b-95f0-520d937cf230-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.199181 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.199156    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zhs4\" (UniqueName: \"kubernetes.io/projected/e7f2d1eb-872c-4c0b-95f0-520d937cf230-kube-api-access-8zhs4\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.691703 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.691670    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7f2d1eb-872c-4c0b-95f0-520d937cf230-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.694075 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.694043    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7f2d1eb-872c-4c0b-95f0-520d937cf230-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-445r8\" (UID: \"e7f2d1eb-872c-4c0b-95f0-520d937cf230\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:43.982357 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:43.982254    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"
Jul 08 19:34:44.112403 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:44.112375    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-445r8"]
Jul 08 19:34:44.115169 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:34:44.115134    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7f2d1eb_872c_4c0b_95f0_520d937cf230.slice/crio-0365a52bc907b055e39d80f1ef952acf9865522fceca6aec8d22f432288fcd6e WatchSource:0}: Error finding container 0365a52bc907b055e39d80f1ef952acf9865522fceca6aec8d22f432288fcd6e: Status 404 returned error can't find the container with id 0365a52bc907b055e39d80f1ef952acf9865522fceca6aec8d22f432288fcd6e
Jul 08 19:34:44.116983 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:44.116962    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 19:34:44.909842 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:44.909808    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8" event={"ID":"e7f2d1eb-872c-4c0b-95f0-520d937cf230","Type":"ContainerStarted","Data":"0365a52bc907b055e39d80f1ef952acf9865522fceca6aec8d22f432288fcd6e"}
Jul 08 19:34:53.147910 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.147869    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"]
Jul 08 19:34:53.151250 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.151232    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.153511 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.153486    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jx8qd\""
Jul 08 19:34:53.164401 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.164375    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"]
Jul 08 19:34:53.166572 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.166548    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34431447-72a6-484e-a77e-406ca4b146e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.166696 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.166583    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmd54\" (UniqueName: \"kubernetes.io/projected/34431447-72a6-484e-a77e-406ca4b146e2-kube-api-access-zmd54\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.267572 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.267522    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34431447-72a6-484e-a77e-406ca4b146e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.267748 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.267582    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmd54\" (UniqueName: \"kubernetes.io/projected/34431447-72a6-484e-a77e-406ca4b146e2-kube-api-access-zmd54\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.268008 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.267984    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34431447-72a6-484e-a77e-406ca4b146e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.276666 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.276635    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmd54\" (UniqueName: \"kubernetes.io/projected/34431447-72a6-484e-a77e-406ca4b146e2-kube-api-access-zmd54\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.461260 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.461172    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:34:53.904756 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.904719    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"]
Jul 08 19:34:53.910879 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.910845    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"]
Jul 08 19:34:53.932463 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.932431    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"]
Jul 08 19:34:53.938123 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.937992    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:34:53.953401 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.953012    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"]
Jul 08 19:34:53.974901 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.974862    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2qq\" (UniqueName: \"kubernetes.io/projected/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-kube-api-access-kj2qq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p5dc5\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:34:53.975085 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:53.974940    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p5dc5\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:34:54.075635 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:54.075582    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2qq\" (UniqueName: \"kubernetes.io/projected/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-kube-api-access-kj2qq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p5dc5\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:34:54.075819 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:54.075679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p5dc5\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:34:54.076095 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:54.076073    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p5dc5\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:34:54.094241 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:54.094209    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2qq\" (UniqueName: \"kubernetes.io/projected/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-kube-api-access-kj2qq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p5dc5\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:34:54.252445 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:34:54.252350    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:35:07.474805 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:07.474777    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"]
Jul 08 19:35:07.475642 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:35:07.475600    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf4a776_6da7_41f9_82b8_f7a98cb3d0ba.slice/crio-7a24eddaf9c4596cfa9c3c2ed44fe277c3addbdd47281e79debb7e28b28fcc66 WatchSource:0}: Error finding container 7a24eddaf9c4596cfa9c3c2ed44fe277c3addbdd47281e79debb7e28b28fcc66: Status 404 returned error can't find the container with id 7a24eddaf9c4596cfa9c3c2ed44fe277c3addbdd47281e79debb7e28b28fcc66
Jul 08 19:35:08.024497 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:08.024458    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8" event={"ID":"e7f2d1eb-872c-4c0b-95f0-520d937cf230","Type":"ContainerStarted","Data":"ca4abc1e5d7bb0f9bc520a82c75d8daa268010d0ac35dea61784ec0f54aa801a"}
Jul 08 19:35:08.025676 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:08.025649    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5" event={"ID":"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba","Type":"ContainerStarted","Data":"7a24eddaf9c4596cfa9c3c2ed44fe277c3addbdd47281e79debb7e28b28fcc66"}
Jul 08 19:35:08.041292 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:08.041243    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-445r8" podStartSLOduration=1.753100871 podStartE2EDuration="25.041228916s" totalImagesPullingTime="23.288128045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:08.039782287 +0000 UTC m=+681.123556139" watchObservedRunningTime="2026-07-08 19:35:08.041228916 +0000 UTC m=+681.125002766"
Jul 08 19:35:09.858205 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:35:09.858158    2554 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-2zp8n_kuadrant-system_34431447-72a6-484e-a77e-406ca4b146e2_0(2c478d96fb45b3aa71321a9e6ba5896358bc4403d314b08499d0e4be452b17ca): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-2zp8n to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 08 19:35:09.858572 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:35:09.858227    2554 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-2zp8n_kuadrant-system_34431447-72a6-484e-a77e-406ca4b146e2_0(2c478d96fb45b3aa71321a9e6ba5896358bc4403d314b08499d0e4be452b17ca): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-2zp8n to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:10.039824 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.039788    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:10.042330 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:35:10.042296    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" is forbidden: User \"system:node:ip-10-0-136-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-213.ec2.internal' and this object" podUID="34431447-72a6-484e-a77e-406ca4b146e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:10.050745 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.050723    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:10.052732 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:35:10.052701    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" is forbidden: User \"system:node:ip-10-0-136-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-213.ec2.internal' and this object" podUID="34431447-72a6-484e-a77e-406ca4b146e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:10.119258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.119169    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmd54\" (UniqueName: \"kubernetes.io/projected/34431447-72a6-484e-a77e-406ca4b146e2-kube-api-access-zmd54\") pod \"34431447-72a6-484e-a77e-406ca4b146e2\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") "
Jul 08 19:35:10.119258 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.119235    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34431447-72a6-484e-a77e-406ca4b146e2-extensions-socket-volume\") pod \"34431447-72a6-484e-a77e-406ca4b146e2\" (UID: \"34431447-72a6-484e-a77e-406ca4b146e2\") "
Jul 08 19:35:10.119570 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.119543    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34431447-72a6-484e-a77e-406ca4b146e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "34431447-72a6-484e-a77e-406ca4b146e2" (UID: "34431447-72a6-484e-a77e-406ca4b146e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:35:10.121418 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.121386    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34431447-72a6-484e-a77e-406ca4b146e2-kube-api-access-zmd54" (OuterVolumeSpecName: "kube-api-access-zmd54") pod "34431447-72a6-484e-a77e-406ca4b146e2" (UID: "34431447-72a6-484e-a77e-406ca4b146e2"). InnerVolumeSpecName "kube-api-access-zmd54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:35:10.220673 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.220645    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmd54\" (UniqueName: \"kubernetes.io/projected/34431447-72a6-484e-a77e-406ca4b146e2-kube-api-access-zmd54\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:35:10.220673 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:10.220670    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34431447-72a6-484e-a77e-406ca4b146e2-extensions-socket-volume\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:35:11.045271 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:11.045238    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:11.047850 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:35:11.047812    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" is forbidden: User \"system:node:ip-10-0-136-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-213.ec2.internal' and this object" podUID="34431447-72a6-484e-a77e-406ca4b146e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:11.054964 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:35:11.054919    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2zp8n\" is forbidden: User \"system:node:ip-10-0-136-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-213.ec2.internal' and this object" podUID="34431447-72a6-484e-a77e-406ca4b146e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2zp8n"
Jul 08 19:35:11.499005 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:11.498967    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34431447-72a6-484e-a77e-406ca4b146e2" path="/var/lib/kubelet/pods/34431447-72a6-484e-a77e-406ca4b146e2/volumes"
Jul 08 19:35:13.056636 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:13.056590    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5" event={"ID":"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba","Type":"ContainerStarted","Data":"74819eb76de63e299fcfdf8ff0e812e29ac4a461c135cf124647770d0c3b0328"}
Jul 08 19:35:13.057037 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:13.056756    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:35:13.080383 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:13.080339    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5" podStartSLOduration=14.93865787 podStartE2EDuration="20.080323084s" totalImagesPullingTime="5.141665214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:13.079546876 +0000 UTC m=+686.163320728" watchObservedRunningTime="2026-07-08 19:35:13.080323084 +0000 UTC m=+686.164096935"
Jul 08 19:35:24.064427 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:24.064400    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:35:36.428129 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:36.428094    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"]
Jul 08 19:35:36.428717 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:36.428343    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5" podUID="caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" containerName="manager" containerID="cri-o://74819eb76de63e299fcfdf8ff0e812e29ac4a461c135cf124647770d0c3b0328" gracePeriod=10
Jul 08 19:35:37.170841 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.170814    2554 generic.go:356] "Generic (PLEG): container finished" podID="caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" containerID="74819eb76de63e299fcfdf8ff0e812e29ac4a461c135cf124647770d0c3b0328" exitCode=0
Jul 08 19:35:37.170954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.170883    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5" event={"ID":"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba","Type":"ContainerDied","Data":"74819eb76de63e299fcfdf8ff0e812e29ac4a461c135cf124647770d0c3b0328"}
Jul 08 19:35:37.170954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.170931    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5" event={"ID":"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba","Type":"ContainerDied","Data":"7a24eddaf9c4596cfa9c3c2ed44fe277c3addbdd47281e79debb7e28b28fcc66"}
Jul 08 19:35:37.170954 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.170946    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a24eddaf9c4596cfa9c3c2ed44fe277c3addbdd47281e79debb7e28b28fcc66"
Jul 08 19:35:37.174531 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.174513    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:35:37.362702 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.362600    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-extensions-socket-volume\") pod \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") "
Jul 08 19:35:37.362845 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.362701    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj2qq\" (UniqueName: \"kubernetes.io/projected/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-kube-api-access-kj2qq\") pod \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\" (UID: \"caf4a776-6da7-41f9-82b8-f7a98cb3d0ba\") "
Jul 08 19:35:37.363225 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.363196    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" (UID: "caf4a776-6da7-41f9-82b8-f7a98cb3d0ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 19:35:37.364922 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.364893    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-kube-api-access-kj2qq" (OuterVolumeSpecName: "kube-api-access-kj2qq") pod "caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" (UID: "caf4a776-6da7-41f9-82b8-f7a98cb3d0ba"). InnerVolumeSpecName "kube-api-access-kj2qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:35:37.463592 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.463545    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj2qq\" (UniqueName: \"kubernetes.io/projected/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-kube-api-access-kj2qq\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:35:37.463592 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:37.463585    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba-extensions-socket-volume\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:35:38.175271 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:38.175239    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"
Jul 08 19:35:38.193388 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:38.193360    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"]
Jul 08 19:35:38.197125 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:38.197104    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p5dc5"]
Jul 08 19:35:39.497460 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:39.497427    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" path="/var/lib/kubelet/pods/caf4a776-6da7-41f9-82b8-f7a98cb3d0ba/volumes"
Jul 08 19:35:42.599702 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.599672    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"]
Jul 08 19:35:42.600340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.600051    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" containerName="manager"
Jul 08 19:35:42.600340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.600066    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" containerName="manager"
Jul 08 19:35:42.600340 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.600132    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf4a776-6da7-41f9-82b8-f7a98cb3d0ba" containerName="manager"
Jul 08 19:35:42.608946 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.608924    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:42.609476 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.609452    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gdl\" (UniqueName: \"kubernetes.io/projected/80140bff-517a-492f-9118-bc9d0b345f3c-kube-api-access-59gdl\") pod \"limitador-limitador-64c94fd64f-rx6qv\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:42.609568 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.609496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80140bff-517a-492f-9118-bc9d0b345f3c-config-file\") pod \"limitador-limitador-64c94fd64f-rx6qv\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:42.611292 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.611271    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 19:35:42.612914 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.612893    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"]
Jul 08 19:35:42.696088 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.696058    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"]
Jul 08 19:35:42.710627 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.710580    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59gdl\" (UniqueName: \"kubernetes.io/projected/80140bff-517a-492f-9118-bc9d0b345f3c-kube-api-access-59gdl\") pod \"limitador-limitador-64c94fd64f-rx6qv\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:42.710795 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.710649    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80140bff-517a-492f-9118-bc9d0b345f3c-config-file\") pod \"limitador-limitador-64c94fd64f-rx6qv\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:42.711275 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.711251    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80140bff-517a-492f-9118-bc9d0b345f3c-config-file\") pod \"limitador-limitador-64c94fd64f-rx6qv\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:42.718352 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.718324    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gdl\" (UniqueName: \"kubernetes.io/projected/80140bff-517a-492f-9118-bc9d0b345f3c-kube-api-access-59gdl\") pod \"limitador-limitador-64c94fd64f-rx6qv\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:42.919739 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:42.919704    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:43.066137 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.066102    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"]
Jul 08 19:35:43.069126 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:35:43.069092    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80140bff_517a_492f_9118_bc9d0b345f3c.slice/crio-9cdf73b87bf263fd6b8991cb483fcf84cdb85b36fa6e56634f7d356905f8d850 WatchSource:0}: Error finding container 9cdf73b87bf263fd6b8991cb483fcf84cdb85b36fa6e56634f7d356905f8d850: Status 404 returned error can't find the container with id 9cdf73b87bf263fd6b8991cb483fcf84cdb85b36fa6e56634f7d356905f8d850
Jul 08 19:35:43.198095 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.198009    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv" event={"ID":"80140bff-517a-492f-9118-bc9d0b345f3c","Type":"ContainerStarted","Data":"9cdf73b87bf263fd6b8991cb483fcf84cdb85b36fa6e56634f7d356905f8d850"}
Jul 08 19:35:43.688088 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.688055    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hvscd"]
Jul 08 19:35:43.690399 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.690378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hvscd"
Jul 08 19:35:43.693139 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.693120    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4v8tn\""
Jul 08 19:35:43.698845 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.698824    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hvscd"]
Jul 08 19:35:43.717117 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.717087    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqctc\" (UniqueName: \"kubernetes.io/projected/0e6b8286-172d-4ac5-8ece-06a6bf409e82-kube-api-access-qqctc\") pod \"authorino-75d556bd77-hvscd\" (UID: \"0e6b8286-172d-4ac5-8ece-06a6bf409e82\") " pod="kuadrant-system/authorino-75d556bd77-hvscd"
Jul 08 19:35:43.818007 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.817965    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqctc\" (UniqueName: \"kubernetes.io/projected/0e6b8286-172d-4ac5-8ece-06a6bf409e82-kube-api-access-qqctc\") pod \"authorino-75d556bd77-hvscd\" (UID: \"0e6b8286-172d-4ac5-8ece-06a6bf409e82\") " pod="kuadrant-system/authorino-75d556bd77-hvscd"
Jul 08 19:35:43.826675 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:43.826606    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqctc\" (UniqueName: \"kubernetes.io/projected/0e6b8286-172d-4ac5-8ece-06a6bf409e82-kube-api-access-qqctc\") pod \"authorino-75d556bd77-hvscd\" (UID: \"0e6b8286-172d-4ac5-8ece-06a6bf409e82\") " pod="kuadrant-system/authorino-75d556bd77-hvscd"
Jul 08 19:35:44.000704 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:44.000418    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hvscd"
Jul 08 19:35:44.163655 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:44.163604    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hvscd"]
Jul 08 19:35:44.166395 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:35:44.166362    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e6b8286_172d_4ac5_8ece_06a6bf409e82.slice/crio-dd37502f43f7cca1af5a36abdff616b9beac77d0b0f883e6698289fb0b7a60fc WatchSource:0}: Error finding container dd37502f43f7cca1af5a36abdff616b9beac77d0b0f883e6698289fb0b7a60fc: Status 404 returned error can't find the container with id dd37502f43f7cca1af5a36abdff616b9beac77d0b0f883e6698289fb0b7a60fc
Jul 08 19:35:44.211942 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:44.211845    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hvscd" event={"ID":"0e6b8286-172d-4ac5-8ece-06a6bf409e82","Type":"ContainerStarted","Data":"dd37502f43f7cca1af5a36abdff616b9beac77d0b0f883e6698289fb0b7a60fc"}
Jul 08 19:35:46.224286 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:46.224197    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv" event={"ID":"80140bff-517a-492f-9118-bc9d0b345f3c","Type":"ContainerStarted","Data":"57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9"}
Jul 08 19:35:46.224286 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:46.224278    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:46.240959 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:46.240897    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv" podStartSLOduration=1.378948433 podStartE2EDuration="4.240878085s" totalImagesPullingTime="2.861929652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:46.239858941 +0000 UTC m=+719.323632792" watchObservedRunningTime="2026-07-08 19:35:46.240878085 +0000 UTC m=+719.324651939"
Jul 08 19:35:49.242514 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:49.242472    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hvscd" event={"ID":"0e6b8286-172d-4ac5-8ece-06a6bf409e82","Type":"ContainerStarted","Data":"6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11"}
Jul 08 19:35:49.258372 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:49.258306    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hvscd" podStartSLOduration=2.136921585 podStartE2EDuration="6.258292885s" totalImagesPullingTime="4.1213713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:49.257540544 +0000 UTC m=+722.341314394" watchObservedRunningTime="2026-07-08 19:35:49.258292885 +0000 UTC m=+722.342066736"
Jul 08 19:35:57.230940 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.230908    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:57.320348 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.320316    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"]
Jul 08 19:35:57.320546 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.320519    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv" podUID="80140bff-517a-492f-9118-bc9d0b345f3c" containerName="limitador" containerID="cri-o://57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9" gracePeriod=30
Jul 08 19:35:57.862951 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.862928    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:57.931754 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.931712    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80140bff-517a-492f-9118-bc9d0b345f3c-config-file\") pod \"80140bff-517a-492f-9118-bc9d0b345f3c\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") "
Jul 08 19:35:57.931987 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.931799    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59gdl\" (UniqueName: \"kubernetes.io/projected/80140bff-517a-492f-9118-bc9d0b345f3c-kube-api-access-59gdl\") pod \"80140bff-517a-492f-9118-bc9d0b345f3c\" (UID: \"80140bff-517a-492f-9118-bc9d0b345f3c\") "
Jul 08 19:35:57.932109 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.932085    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80140bff-517a-492f-9118-bc9d0b345f3c-config-file" (OuterVolumeSpecName: "config-file") pod "80140bff-517a-492f-9118-bc9d0b345f3c" (UID: "80140bff-517a-492f-9118-bc9d0b345f3c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 19:35:57.933906 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:57.933880    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80140bff-517a-492f-9118-bc9d0b345f3c-kube-api-access-59gdl" (OuterVolumeSpecName: "kube-api-access-59gdl") pod "80140bff-517a-492f-9118-bc9d0b345f3c" (UID: "80140bff-517a-492f-9118-bc9d0b345f3c"). InnerVolumeSpecName "kube-api-access-59gdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:35:58.032401 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.032368    2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80140bff-517a-492f-9118-bc9d0b345f3c-config-file\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:35:58.032401 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.032398    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59gdl\" (UniqueName: \"kubernetes.io/projected/80140bff-517a-492f-9118-bc9d0b345f3c-kube-api-access-59gdl\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:35:58.285028 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.284936    2554 generic.go:356] "Generic (PLEG): container finished" podID="80140bff-517a-492f-9118-bc9d0b345f3c" containerID="57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9" exitCode=0
Jul 08 19:35:58.285028 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.284980    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"
Jul 08 19:35:58.285028 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.284988    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv" event={"ID":"80140bff-517a-492f-9118-bc9d0b345f3c","Type":"ContainerDied","Data":"57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9"}
Jul 08 19:35:58.285028 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.285031    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx6qv" event={"ID":"80140bff-517a-492f-9118-bc9d0b345f3c","Type":"ContainerDied","Data":"9cdf73b87bf263fd6b8991cb483fcf84cdb85b36fa6e56634f7d356905f8d850"}
Jul 08 19:35:58.285598 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.285050    2554 scope.go:117] "RemoveContainer" containerID="57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9"
Jul 08 19:35:58.293927 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.293912    2554 scope.go:117] "RemoveContainer" containerID="57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9"
Jul 08 19:35:58.294193 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:35:58.294174    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9\": container with ID starting with 57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9 not found: ID does not exist" containerID="57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9"
Jul 08 19:35:58.294254 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.294200    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9"} err="failed to get container status \"57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9\": rpc error: code = NotFound desc = could not find container \"57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9\": container with ID starting with 57da1aad2f501a78897865f523bdcefacc1cd2fb13002c8872dfb64f068d5df9 not found: ID does not exist"
Jul 08 19:35:58.308474 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.308448    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"]
Jul 08 19:35:58.313666 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:58.313637    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx6qv"]
Jul 08 19:35:59.053499 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.053461    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-wscn6"]
Jul 08 19:35:59.054005 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.053984    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80140bff-517a-492f-9118-bc9d0b345f3c" containerName="limitador"
Jul 08 19:35:59.054061 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.054010    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="80140bff-517a-492f-9118-bc9d0b345f3c" containerName="limitador"
Jul 08 19:35:59.054134 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.054123    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="80140bff-517a-492f-9118-bc9d0b345f3c" containerName="limitador"
Jul 08 19:35:59.057071 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.057052    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.059345 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.059322    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 08 19:35:59.059440 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.059400    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m9ssz\""
Jul 08 19:35:59.063158 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.063129    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wscn6"]
Jul 08 19:35:59.141752 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.141719    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3fddfe98-5eef-4112-b4db-f95713dfc78f-data\") pod \"postgres-69fb4594cf-wscn6\" (UID: \"3fddfe98-5eef-4112-b4db-f95713dfc78f\") " pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.141913 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.141776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd4rr\" (UniqueName: \"kubernetes.io/projected/3fddfe98-5eef-4112-b4db-f95713dfc78f-kube-api-access-cd4rr\") pod \"postgres-69fb4594cf-wscn6\" (UID: \"3fddfe98-5eef-4112-b4db-f95713dfc78f\") " pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.242697 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.242666    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd4rr\" (UniqueName: \"kubernetes.io/projected/3fddfe98-5eef-4112-b4db-f95713dfc78f-kube-api-access-cd4rr\") pod \"postgres-69fb4594cf-wscn6\" (UID: \"3fddfe98-5eef-4112-b4db-f95713dfc78f\") " pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.242859 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.242741    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3fddfe98-5eef-4112-b4db-f95713dfc78f-data\") pod \"postgres-69fb4594cf-wscn6\" (UID: \"3fddfe98-5eef-4112-b4db-f95713dfc78f\") " pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.243076 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.243062    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3fddfe98-5eef-4112-b4db-f95713dfc78f-data\") pod \"postgres-69fb4594cf-wscn6\" (UID: \"3fddfe98-5eef-4112-b4db-f95713dfc78f\") " pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.250732 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.250706    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd4rr\" (UniqueName: \"kubernetes.io/projected/3fddfe98-5eef-4112-b4db-f95713dfc78f-kube-api-access-cd4rr\") pod \"postgres-69fb4594cf-wscn6\" (UID: \"3fddfe98-5eef-4112-b4db-f95713dfc78f\") " pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.368669 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.368555    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:35:59.497688 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.497653    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80140bff-517a-492f-9118-bc9d0b345f3c" path="/var/lib/kubelet/pods/80140bff-517a-492f-9118-bc9d0b345f3c/volumes"
Jul 08 19:35:59.501082 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:35:59.501063    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wscn6"]
Jul 08 19:35:59.503611 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:35:59.503582    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fddfe98_5eef_4112_b4db_f95713dfc78f.slice/crio-f2f5761c9dce58b76d296f971088cd2e6494fd7b8d2f3e39a9dea240c1286007 WatchSource:0}: Error finding container f2f5761c9dce58b76d296f971088cd2e6494fd7b8d2f3e39a9dea240c1286007: Status 404 returned error can't find the container with id f2f5761c9dce58b76d296f971088cd2e6494fd7b8d2f3e39a9dea240c1286007
Jul 08 19:36:00.299120 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:00.299031    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wscn6" event={"ID":"3fddfe98-5eef-4112-b4db-f95713dfc78f","Type":"ContainerStarted","Data":"f2f5761c9dce58b76d296f971088cd2e6494fd7b8d2f3e39a9dea240c1286007"}
Jul 08 19:36:04.322121 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:04.322088    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wscn6" event={"ID":"3fddfe98-5eef-4112-b4db-f95713dfc78f","Type":"ContainerStarted","Data":"e4376efc4ac0d146d963e9eda64e7f783cb9b92b3d5fe0de73644179587d8105"}
Jul 08 19:36:04.322529 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:04.322189    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:36:04.343747 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:04.343700    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-wscn6" podStartSLOduration=0.670566179 podStartE2EDuration="5.343685273s" totalImagesPullingTime="4.673119094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:36:04.341885499 +0000 UTC m=+737.425659353" watchObservedRunningTime="2026-07-08 19:36:04.343685273 +0000 UTC m=+737.427459123"
Jul 08 19:36:10.356544 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:10.356515    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-wscn6"
Jul 08 19:36:12.681069 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:12.681039    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hvscd"]
Jul 08 19:36:12.681450 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:12.681211    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hvscd" podUID="0e6b8286-172d-4ac5-8ece-06a6bf409e82" containerName="authorino" containerID="cri-o://6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11" gracePeriod=30
Jul 08 19:36:12.930946 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:12.930924    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hvscd"
Jul 08 19:36:13.067161 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.067050    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqctc\" (UniqueName: \"kubernetes.io/projected/0e6b8286-172d-4ac5-8ece-06a6bf409e82-kube-api-access-qqctc\") pod \"0e6b8286-172d-4ac5-8ece-06a6bf409e82\" (UID: \"0e6b8286-172d-4ac5-8ece-06a6bf409e82\") "
Jul 08 19:36:13.069148 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.069096    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6b8286-172d-4ac5-8ece-06a6bf409e82-kube-api-access-qqctc" (OuterVolumeSpecName: "kube-api-access-qqctc") pod "0e6b8286-172d-4ac5-8ece-06a6bf409e82" (UID: "0e6b8286-172d-4ac5-8ece-06a6bf409e82"). InnerVolumeSpecName "kube-api-access-qqctc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:36:13.167856 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.167819    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqctc\" (UniqueName: \"kubernetes.io/projected/0e6b8286-172d-4ac5-8ece-06a6bf409e82-kube-api-access-qqctc\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:36:13.363128 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.363038    2554 generic.go:356] "Generic (PLEG): container finished" podID="0e6b8286-172d-4ac5-8ece-06a6bf409e82" containerID="6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11" exitCode=0
Jul 08 19:36:13.363128 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.363086    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hvscd"
Jul 08 19:36:13.363346 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.363127    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hvscd" event={"ID":"0e6b8286-172d-4ac5-8ece-06a6bf409e82","Type":"ContainerDied","Data":"6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11"}
Jul 08 19:36:13.363346 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.363180    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hvscd" event={"ID":"0e6b8286-172d-4ac5-8ece-06a6bf409e82","Type":"ContainerDied","Data":"dd37502f43f7cca1af5a36abdff616b9beac77d0b0f883e6698289fb0b7a60fc"}
Jul 08 19:36:13.363346 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.363197    2554 scope.go:117] "RemoveContainer" containerID="6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11"
Jul 08 19:36:13.372318 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.372299    2554 scope.go:117] "RemoveContainer" containerID="6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11"
Jul 08 19:36:13.372593 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:13.372571    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11\": container with ID starting with 6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11 not found: ID does not exist" containerID="6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11"
Jul 08 19:36:13.372685 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.372605    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11"} err="failed to get container status \"6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11\": rpc error: code = NotFound desc = could not find container \"6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11\": container with ID starting with 6fe9bf67514490d59beb20d936163f7d3022aa3859121d21381c3142df7f5e11 not found: ID does not exist"
Jul 08 19:36:13.391633 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.391598    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hvscd"]
Jul 08 19:36:13.394942 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.394919    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hvscd"]
Jul 08 19:36:13.497347 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:13.497312    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6b8286-172d-4ac5-8ece-06a6bf409e82" path="/var/lib/kubelet/pods/0e6b8286-172d-4ac5-8ece-06a6bf409e82/volumes"
Jul 08 19:36:17.200574 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.200544    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65d58c4d74-69fw2"]
Jul 08 19:36:17.200993 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.200938    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6b8286-172d-4ac5-8ece-06a6bf409e82" containerName="authorino"
Jul 08 19:36:17.200993 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.200952    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6b8286-172d-4ac5-8ece-06a6bf409e82" containerName="authorino"
Jul 08 19:36:17.201063 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.201006    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6b8286-172d-4ac5-8ece-06a6bf409e82" containerName="authorino"
Jul 08 19:36:17.317709 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.317671    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65d58c4d74-69fw2"]
Jul 08 19:36:17.317894 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.317783    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:17.320432 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.320407    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7phh8\""
Jul 08 19:36:17.320432 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.320421    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 19:36:17.320643 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.320459    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 19:36:17.377682 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.377608    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c6fb9585-tgn78"]
Jul 08 19:36:17.403653 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.403598    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert\") pod \"maas-controller-65d58c4d74-69fw2\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") " pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:17.403841 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.403725    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbs8l\" (UniqueName: \"kubernetes.io/projected/9c85f3ca-55ea-458e-97da-3aea6617998d-kube-api-access-cbs8l\") pod \"maas-controller-65d58c4d74-69fw2\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") " pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:17.423840 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.423802    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6fb9585-tgn78"]
Jul 08 19:36:17.424007 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.423921    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:17.504907 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.504827    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert\") pod \"maas-controller-65d58c4d74-69fw2\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") " pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:17.504907 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.504865    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert\") pod \"maas-controller-9c6fb9585-tgn78\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") " pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:17.504907 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.504889    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w74xm\" (UniqueName: \"kubernetes.io/projected/cb6b4509-42f8-4dc7-a948-706694f58e64-kube-api-access-w74xm\") pod \"maas-controller-9c6fb9585-tgn78\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") " pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:17.505170 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:17.504976    2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 19:36:17.505170 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.504988    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbs8l\" (UniqueName: \"kubernetes.io/projected/9c85f3ca-55ea-458e-97da-3aea6617998d-kube-api-access-cbs8l\") pod \"maas-controller-65d58c4d74-69fw2\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") " pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:17.505170 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:17.505047    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert podName:9c85f3ca-55ea-458e-97da-3aea6617998d nodeName:}" failed. No retries permitted until 2026-07-08 19:36:18.005025685 +0000 UTC m=+751.088799515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert") pod "maas-controller-65d58c4d74-69fw2" (UID: "9c85f3ca-55ea-458e-97da-3aea6617998d") : secret "maas-controller-webhook-cert" not found
Jul 08 19:36:17.514199 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.514174    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbs8l\" (UniqueName: \"kubernetes.io/projected/9c85f3ca-55ea-458e-97da-3aea6617998d-kube-api-access-cbs8l\") pod \"maas-controller-65d58c4d74-69fw2\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") " pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:17.605793 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.605752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert\") pod \"maas-controller-9c6fb9585-tgn78\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") " pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:17.605793 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.605796    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w74xm\" (UniqueName: \"kubernetes.io/projected/cb6b4509-42f8-4dc7-a948-706694f58e64-kube-api-access-w74xm\") pod \"maas-controller-9c6fb9585-tgn78\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") " pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:17.606047 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:17.605908    2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 19:36:17.606047 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:17.605978    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert podName:cb6b4509-42f8-4dc7-a948-706694f58e64 nodeName:}" failed. No retries permitted until 2026-07-08 19:36:18.105964121 +0000 UTC m=+751.189737951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert") pod "maas-controller-9c6fb9585-tgn78" (UID: "cb6b4509-42f8-4dc7-a948-706694f58e64") : secret "maas-controller-webhook-cert" not found
Jul 08 19:36:17.614375 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:17.614350    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w74xm\" (UniqueName: \"kubernetes.io/projected/cb6b4509-42f8-4dc7-a948-706694f58e64-kube-api-access-w74xm\") pod \"maas-controller-9c6fb9585-tgn78\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") " pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:18.009872 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.009836    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert\") pod \"maas-controller-65d58c4d74-69fw2\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") " pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:18.012245 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.012222    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert\") pod \"maas-controller-65d58c4d74-69fw2\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") " pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:18.110672 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.110612    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert\") pod \"maas-controller-9c6fb9585-tgn78\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") " pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:18.113052 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.113021    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert\") pod \"maas-controller-9c6fb9585-tgn78\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") " pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:18.229893 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.229857    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:18.334174 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.334144    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:18.414115 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.414081    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65d58c4d74-69fw2"]
Jul 08 19:36:18.415538 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:36:18.415514    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c85f3ca_55ea_458e_97da_3aea6617998d.slice/crio-7dce84767b9538ae40a4133189e16e1de0e83749f21eeb414d977284f49aba3c WatchSource:0}: Error finding container 7dce84767b9538ae40a4133189e16e1de0e83749f21eeb414d977284f49aba3c: Status 404 returned error can't find the container with id 7dce84767b9538ae40a4133189e16e1de0e83749f21eeb414d977284f49aba3c
Jul 08 19:36:18.483583 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:18.483549    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6fb9585-tgn78"]
Jul 08 19:36:18.486763 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:36:18.486722    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6b4509_42f8_4dc7_a948_706694f58e64.slice/crio-a259f1c9efd5daed04c4d84f3ed57ddc596d5fdacd0dd6524d0f2fbe0c1321a6 WatchSource:0}: Error finding container a259f1c9efd5daed04c4d84f3ed57ddc596d5fdacd0dd6524d0f2fbe0c1321a6: Status 404 returned error can't find the container with id a259f1c9efd5daed04c4d84f3ed57ddc596d5fdacd0dd6524d0f2fbe0c1321a6
Jul 08 19:36:19.399107 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:19.399019    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65d58c4d74-69fw2" event={"ID":"9c85f3ca-55ea-458e-97da-3aea6617998d","Type":"ContainerStarted","Data":"7dce84767b9538ae40a4133189e16e1de0e83749f21eeb414d977284f49aba3c"}
Jul 08 19:36:19.401106 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:19.401036    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6fb9585-tgn78" event={"ID":"cb6b4509-42f8-4dc7-a948-706694f58e64","Type":"ContainerStarted","Data":"a259f1c9efd5daed04c4d84f3ed57ddc596d5fdacd0dd6524d0f2fbe0c1321a6"}
Jul 08 19:36:21.420249 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:21.420209    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65d58c4d74-69fw2" event={"ID":"9c85f3ca-55ea-458e-97da-3aea6617998d","Type":"ContainerStarted","Data":"cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0"}
Jul 08 19:36:21.420732 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:21.420301    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:21.422092 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:21.422059    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6fb9585-tgn78" event={"ID":"cb6b4509-42f8-4dc7-a948-706694f58e64","Type":"ContainerStarted","Data":"dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b"}
Jul 08 19:36:21.422227 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:21.422112    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:21.438743 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:21.437398    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65d58c4d74-69fw2" podStartSLOduration=2.197950604 podStartE2EDuration="4.437381021s" totalImagesPullingTime="2.239430417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:36:21.436782732 +0000 UTC m=+754.520556596" watchObservedRunningTime="2026-07-08 19:36:21.437381021 +0000 UTC m=+754.521154872"
Jul 08 19:36:21.455343 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:21.455298    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c6fb9585-tgn78" podStartSLOduration=2.296952439 podStartE2EDuration="4.455284335s" totalImagesPullingTime="2.158331896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:36:21.454685966 +0000 UTC m=+754.538459820" watchObservedRunningTime="2026-07-08 19:36:21.455284335 +0000 UTC m=+754.539058186"
Jul 08 19:36:32.433267 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.433233    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:32.433861 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.433454    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:36:32.492638 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.492584    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65d58c4d74-69fw2"]
Jul 08 19:36:32.492861 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.492833    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-65d58c4d74-69fw2" podUID="9c85f3ca-55ea-458e-97da-3aea6617998d" containerName="manager" containerID="cri-o://cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0" gracePeriod=30
Jul 08 19:36:32.743247 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.743225    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:32.838335 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.838303    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbs8l\" (UniqueName: \"kubernetes.io/projected/9c85f3ca-55ea-458e-97da-3aea6617998d-kube-api-access-cbs8l\") pod \"9c85f3ca-55ea-458e-97da-3aea6617998d\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") "
Jul 08 19:36:32.838510 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.838357    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert\") pod \"9c85f3ca-55ea-458e-97da-3aea6617998d\" (UID: \"9c85f3ca-55ea-458e-97da-3aea6617998d\") "
Jul 08 19:36:32.840683 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.840657    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9c85f3ca-55ea-458e-97da-3aea6617998d" (UID: "9c85f3ca-55ea-458e-97da-3aea6617998d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:36:32.840811 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.840651    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c85f3ca-55ea-458e-97da-3aea6617998d-kube-api-access-cbs8l" (OuterVolumeSpecName: "kube-api-access-cbs8l") pod "9c85f3ca-55ea-458e-97da-3aea6617998d" (UID: "9c85f3ca-55ea-458e-97da-3aea6617998d"). InnerVolumeSpecName "kube-api-access-cbs8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:36:32.939877 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.939837    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbs8l\" (UniqueName: \"kubernetes.io/projected/9c85f3ca-55ea-458e-97da-3aea6617998d-kube-api-access-cbs8l\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:36:32.939877 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:32.939868    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c85f3ca-55ea-458e-97da-3aea6617998d-webhook-cert\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:36:33.479156 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.479119    2554 generic.go:356] "Generic (PLEG): container finished" podID="9c85f3ca-55ea-458e-97da-3aea6617998d" containerID="cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0" exitCode=0
Jul 08 19:36:33.479743 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.479178    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65d58c4d74-69fw2"
Jul 08 19:36:33.479743 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.479198    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65d58c4d74-69fw2" event={"ID":"9c85f3ca-55ea-458e-97da-3aea6617998d","Type":"ContainerDied","Data":"cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0"}
Jul 08 19:36:33.479743 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.479252    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65d58c4d74-69fw2" event={"ID":"9c85f3ca-55ea-458e-97da-3aea6617998d","Type":"ContainerDied","Data":"7dce84767b9538ae40a4133189e16e1de0e83749f21eeb414d977284f49aba3c"}
Jul 08 19:36:33.479743 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.479274    2554 scope.go:117] "RemoveContainer" containerID="cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0"
Jul 08 19:36:33.488132 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.488119    2554 scope.go:117] "RemoveContainer" containerID="cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0"
Jul 08 19:36:33.488367 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:33.488350    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0\": container with ID starting with cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0 not found: ID does not exist" containerID="cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0"
Jul 08 19:36:33.488415 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.488375    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0"} err="failed to get container status \"cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0\": rpc error: code = NotFound desc = could not find container \"cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0\": container with ID starting with cfbcaa1f4d82accdf9a7750a31f952dfadc1b09b47ff2cb253a3258b497b23f0 not found: ID does not exist"
Jul 08 19:36:33.501220 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.501190    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65d58c4d74-69fw2"]
Jul 08 19:36:33.502787 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:33.502766    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65d58c4d74-69fw2"]
Jul 08 19:36:35.496635 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:35.496589    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c85f3ca-55ea-458e-97da-3aea6617998d" path="/var/lib/kubelet/pods/9c85f3ca-55ea-458e-97da-3aea6617998d/volumes"
Jul 08 19:36:52.699017 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.698980    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-565c796c8c-gz2v9"]
Jul 08 19:36:52.699478 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.699462    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c85f3ca-55ea-458e-97da-3aea6617998d" containerName="manager"
Jul 08 19:36:52.699521 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.699481    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c85f3ca-55ea-458e-97da-3aea6617998d" containerName="manager"
Jul 08 19:36:52.699590 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.699579    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c85f3ca-55ea-458e-97da-3aea6617998d" containerName="manager"
Jul 08 19:36:52.705544 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.705520    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.708228 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.708200    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 08 19:36:52.708364 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.708202    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7kmg8\""
Jul 08 19:36:52.713843 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.713505    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-565c796c8c-gz2v9"]
Jul 08 19:36:52.809730 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.809691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb201995-7ab1-4f4b-88fa-93db49cc488f-maas-api-tls\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.809730 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.809724    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb201995-7ab1-4f4b-88fa-93db49cc488f-openshift-service-ca\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.809993 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.809753    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qbmf\" (UniqueName: \"kubernetes.io/projected/cb201995-7ab1-4f4b-88fa-93db49cc488f-kube-api-access-5qbmf\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.910410 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.910377    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb201995-7ab1-4f4b-88fa-93db49cc488f-maas-api-tls\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.910410 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.910412    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb201995-7ab1-4f4b-88fa-93db49cc488f-openshift-service-ca\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.910599 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.910444    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qbmf\" (UniqueName: \"kubernetes.io/projected/cb201995-7ab1-4f4b-88fa-93db49cc488f-kube-api-access-5qbmf\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.910599 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:52.910538    2554 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 19:36:52.910706 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:36:52.910640    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb201995-7ab1-4f4b-88fa-93db49cc488f-maas-api-tls podName:cb201995-7ab1-4f4b-88fa-93db49cc488f nodeName:}" failed. No retries permitted until 2026-07-08 19:36:53.41059712 +0000 UTC m=+786.494370953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb201995-7ab1-4f4b-88fa-93db49cc488f-maas-api-tls") pod "maas-api-565c796c8c-gz2v9" (UID: "cb201995-7ab1-4f4b-88fa-93db49cc488f") : secret "maas-api-serving-cert" not found
Jul 08 19:36:52.911077 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.911056    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb201995-7ab1-4f4b-88fa-93db49cc488f-openshift-service-ca\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:52.922649 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:52.922593    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qbmf\" (UniqueName: \"kubernetes.io/projected/cb201995-7ab1-4f4b-88fa-93db49cc488f-kube-api-access-5qbmf\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:53.163507 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.163471    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rnwvv"]
Jul 08 19:36:53.166983 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.166962    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.169498 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.169475    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 19:36:53.169921 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.169906    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jr8tk\""
Jul 08 19:36:53.179208 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.179188    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rnwvv"]
Jul 08 19:36:53.213050 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.213020    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x45sg\" (UniqueName: \"kubernetes.io/projected/b4985978-e8dc-43db-b79f-59e225c71e19-kube-api-access-x45sg\") pod \"payload-pre-processing-7964457696-rnwvv\" (UID: \"b4985978-e8dc-43db-b79f-59e225c71e19\") " pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.213202 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.213062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4985978-e8dc-43db-b79f-59e225c71e19-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rnwvv\" (UID: \"b4985978-e8dc-43db-b79f-59e225c71e19\") " pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.221353 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.221323    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-fkxhk"]
Jul 08 19:36:53.224673 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.224651    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.234574 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.234546    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-fkxhk"]
Jul 08 19:36:53.314301 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.314264    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c09f5e0-865c-4745-a6b0-cfe8c831e31b-plugins-config-volume\") pod \"payload-processing-58f86c7798-fkxhk\" (UID: \"8c09f5e0-865c-4745-a6b0-cfe8c831e31b\") " pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.314301 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.314300    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8fss\" (UniqueName: \"kubernetes.io/projected/8c09f5e0-865c-4745-a6b0-cfe8c831e31b-kube-api-access-m8fss\") pod \"payload-processing-58f86c7798-fkxhk\" (UID: \"8c09f5e0-865c-4745-a6b0-cfe8c831e31b\") " pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.314544 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.314337    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x45sg\" (UniqueName: \"kubernetes.io/projected/b4985978-e8dc-43db-b79f-59e225c71e19-kube-api-access-x45sg\") pod \"payload-pre-processing-7964457696-rnwvv\" (UID: \"b4985978-e8dc-43db-b79f-59e225c71e19\") " pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.314544 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.314417    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4985978-e8dc-43db-b79f-59e225c71e19-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rnwvv\" (UID: \"b4985978-e8dc-43db-b79f-59e225c71e19\") " pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.315127 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.315110    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4985978-e8dc-43db-b79f-59e225c71e19-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rnwvv\" (UID: \"b4985978-e8dc-43db-b79f-59e225c71e19\") " pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.322498 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.322467    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x45sg\" (UniqueName: \"kubernetes.io/projected/b4985978-e8dc-43db-b79f-59e225c71e19-kube-api-access-x45sg\") pod \"payload-pre-processing-7964457696-rnwvv\" (UID: \"b4985978-e8dc-43db-b79f-59e225c71e19\") " pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.415929 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.415831    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8fss\" (UniqueName: \"kubernetes.io/projected/8c09f5e0-865c-4745-a6b0-cfe8c831e31b-kube-api-access-m8fss\") pod \"payload-processing-58f86c7798-fkxhk\" (UID: \"8c09f5e0-865c-4745-a6b0-cfe8c831e31b\") " pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.416113 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.415954    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb201995-7ab1-4f4b-88fa-93db49cc488f-maas-api-tls\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:53.416113 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.416008    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c09f5e0-865c-4745-a6b0-cfe8c831e31b-plugins-config-volume\") pod \"payload-processing-58f86c7798-fkxhk\" (UID: \"8c09f5e0-865c-4745-a6b0-cfe8c831e31b\") " pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.416724 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.416701    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c09f5e0-865c-4745-a6b0-cfe8c831e31b-plugins-config-volume\") pod \"payload-processing-58f86c7798-fkxhk\" (UID: \"8c09f5e0-865c-4745-a6b0-cfe8c831e31b\") " pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.418454 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.418431    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb201995-7ab1-4f4b-88fa-93db49cc488f-maas-api-tls\") pod \"maas-api-565c796c8c-gz2v9\" (UID: \"cb201995-7ab1-4f4b-88fa-93db49cc488f\") " pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:53.429703 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.429672    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8fss\" (UniqueName: \"kubernetes.io/projected/8c09f5e0-865c-4745-a6b0-cfe8c831e31b-kube-api-access-m8fss\") pod \"payload-processing-58f86c7798-fkxhk\" (UID: \"8c09f5e0-865c-4745-a6b0-cfe8c831e31b\") " pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.477753 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.477723    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:53.535409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.535235    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:53.617743 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.616663    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:53.646427 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.646389    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rnwvv"]
Jul 08 19:36:53.648366 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:36:53.648309    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4985978_e8dc_43db_b79f_59e225c71e19.slice/crio-4fbcf46913d4ed016e080aabe4541f1af5ff62af8a3850a0aecdac6a5afbd2a7 WatchSource:0}: Error finding container 4fbcf46913d4ed016e080aabe4541f1af5ff62af8a3850a0aecdac6a5afbd2a7: Status 404 returned error can't find the container with id 4fbcf46913d4ed016e080aabe4541f1af5ff62af8a3850a0aecdac6a5afbd2a7
Jul 08 19:36:53.698133 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.698063    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-fkxhk"]
Jul 08 19:36:53.700281 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:36:53.700256    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c09f5e0_865c_4745_a6b0_cfe8c831e31b.slice/crio-4d1866de04fa9c4bfac673042595c37e9cf5438c4daf5dfc1f81c60b6d384a41 WatchSource:0}: Error finding container 4d1866de04fa9c4bfac673042595c37e9cf5438c4daf5dfc1f81c60b6d384a41: Status 404 returned error can't find the container with id 4d1866de04fa9c4bfac673042595c37e9cf5438c4daf5dfc1f81c60b6d384a41
Jul 08 19:36:53.763336 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:53.763310    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-565c796c8c-gz2v9"]
Jul 08 19:36:53.765893 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:36:53.765864    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb201995_7ab1_4f4b_88fa_93db49cc488f.slice/crio-a70d49039def1145e32501cdbd3f22eab7d3e0448681dddcb536b90cfec68ad9 WatchSource:0}: Error finding container a70d49039def1145e32501cdbd3f22eab7d3e0448681dddcb536b90cfec68ad9: Status 404 returned error can't find the container with id a70d49039def1145e32501cdbd3f22eab7d3e0448681dddcb536b90cfec68ad9
Jul 08 19:36:54.583341 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:54.583268    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-565c796c8c-gz2v9" event={"ID":"cb201995-7ab1-4f4b-88fa-93db49cc488f","Type":"ContainerStarted","Data":"a70d49039def1145e32501cdbd3f22eab7d3e0448681dddcb536b90cfec68ad9"}
Jul 08 19:36:54.584839 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:54.584782    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv" event={"ID":"b4985978-e8dc-43db-b79f-59e225c71e19","Type":"ContainerStarted","Data":"4fbcf46913d4ed016e080aabe4541f1af5ff62af8a3850a0aecdac6a5afbd2a7"}
Jul 08 19:36:54.586281 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:54.586251    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-fkxhk" event={"ID":"8c09f5e0-865c-4745-a6b0-cfe8c831e31b","Type":"ContainerStarted","Data":"4d1866de04fa9c4bfac673042595c37e9cf5438c4daf5dfc1f81c60b6d384a41"}
Jul 08 19:36:56.596979 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.596945    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-fkxhk" event={"ID":"8c09f5e0-865c-4745-a6b0-cfe8c831e31b","Type":"ContainerStarted","Data":"656e3171bfb857d9725152cb2a663d89fd192e554b6d705f4d2f1198f3d15c64"}
Jul 08 19:36:56.597449 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.597036    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:36:56.598512 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.598487    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-565c796c8c-gz2v9" event={"ID":"cb201995-7ab1-4f4b-88fa-93db49cc488f","Type":"ContainerStarted","Data":"4db8fe4fde91c7926d5bce4bc8e01bd4f42d9fc281aec1520aa0a32a88dd508b"}
Jul 08 19:36:56.598659 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.598542    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:36:56.599899 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.599877    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv" event={"ID":"b4985978-e8dc-43db-b79f-59e225c71e19","Type":"ContainerStarted","Data":"d6aa35e6be087ed6152d6d1cff12f503494ca37e22568f329c807641b598b87f"}
Jul 08 19:36:56.600018 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.600004    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:36:56.613452 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.613411    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-fkxhk" podStartSLOduration=1.763963719 podStartE2EDuration="3.613397823s" totalImagesPullingTime="1.849434104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:36:56.611855423 +0000 UTC m=+789.695629275" watchObservedRunningTime="2026-07-08 19:36:56.613397823 +0000 UTC m=+789.697171651"
Jul 08 19:36:56.626171 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.626127    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv" podStartSLOduration=1.723196103 podStartE2EDuration="3.626113775s" totalImagesPullingTime="1.902917672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:36:56.625653486 +0000 UTC m=+789.709427340" watchObservedRunningTime="2026-07-08 19:36:56.626113775 +0000 UTC m=+789.709887626"
Jul 08 19:36:56.640559 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:36:56.640519    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-565c796c8c-gz2v9" podStartSLOduration=2.855984692 podStartE2EDuration="4.640507728s" totalImagesPullingTime="1.784523036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:36:56.640046834 +0000 UTC m=+789.723820686" watchObservedRunningTime="2026-07-08 19:36:56.640507728 +0000 UTC m=+789.724281578"
Jul 08 19:37:02.609920 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:02.609893    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-565c796c8c-gz2v9"
Jul 08 19:37:07.606073 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:07.605995    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-rnwvv"
Jul 08 19:37:07.606073 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:07.606058    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-fkxhk"
Jul 08 19:37:17.900409 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:17.900379    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"]
Jul 08 19:37:17.903976 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:17.903958    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:17.906580 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:17.906559    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 19:37:17.907343 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:17.907329    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 19:37:17.907398 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:17.907363    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 19:37:17.907443 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:17.907370    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m5fhc\""
Jul 08 19:37:17.912226 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:17.912204    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"]
Jul 08 19:37:18.032363 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.032331    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.032575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.032390    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.032575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.032438    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1908213f-188f-402c-a463-a5afe5fb3cbd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.032575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.032455    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c28nn\" (UniqueName: \"kubernetes.io/projected/1908213f-188f-402c-a463-a5afe5fb3cbd-kube-api-access-c28nn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.032575 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.032551    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.032804 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.032610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133132 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133096    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133132 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133147    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1908213f-188f-402c-a463-a5afe5fb3cbd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133406 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133165    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28nn\" (UniqueName: \"kubernetes.io/projected/1908213f-188f-402c-a463-a5afe5fb3cbd-kube-api-access-c28nn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133406 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133192    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133406 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133221    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133406 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133259    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133658 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133601    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133725 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133688    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.133767 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.133716    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.135510 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.135488    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1908213f-188f-402c-a463-a5afe5fb3cbd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.135798 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.135781    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1908213f-188f-402c-a463-a5afe5fb3cbd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.140962 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.140938    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c28nn\" (UniqueName: \"kubernetes.io/projected/1908213f-188f-402c-a463-a5afe5fb3cbd-kube-api-access-c28nn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42\" (UID: \"1908213f-188f-402c-a463-a5afe5fb3cbd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.215549 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.215460    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:18.349519 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.349495    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"]
Jul 08 19:37:18.352153 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:37:18.352130    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1908213f_188f_402c_a463_a5afe5fb3cbd.slice/crio-b96897db77656b3e98e6ce5a66d5cd1561ff86d26797a2416ba114668ecb2fed WatchSource:0}: Error finding container b96897db77656b3e98e6ce5a66d5cd1561ff86d26797a2416ba114668ecb2fed: Status 404 returned error can't find the container with id b96897db77656b3e98e6ce5a66d5cd1561ff86d26797a2416ba114668ecb2fed
Jul 08 19:37:18.707939 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:18.707895    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42" event={"ID":"1908213f-188f-402c-a463-a5afe5fb3cbd","Type":"ContainerStarted","Data":"b96897db77656b3e98e6ce5a66d5cd1561ff86d26797a2416ba114668ecb2fed"}
Jul 08 19:37:19.714828 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:19.714796    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42" event={"ID":"1908213f-188f-402c-a463-a5afe5fb3cbd","Type":"ContainerStarted","Data":"d430f6824be92bc10574b9f8806e54c170c36deff2106deb1e979bbf995453a6"}
Jul 08 19:37:19.742973 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:19.742912    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42" podStartSLOduration=1.579414956 podStartE2EDuration="2.742895082s" totalImagesPullingTime="1.163480126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:37:19.740784106 +0000 UTC m=+812.824557957" watchObservedRunningTime="2026-07-08 19:37:19.742895082 +0000 UTC m=+812.826668946"
Jul 08 19:37:28.216230 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:28.216186    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:28.216751 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:28.216262    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:28.228987 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:28.228960    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:28.766803 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:28.766776    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42"
Jul 08 19:37:33.987384 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:33.987348    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"]
Jul 08 19:37:33.991091 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:33.991063    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:33.993957 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:33.993939    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 19:37:34.004115 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.004091    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"]
Jul 08 19:37:34.069921 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.069888    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e90836-5a75-457e-8625-7a20aa4f37a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.070086 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.069930    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.070086 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.069979    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj28x\" (UniqueName: \"kubernetes.io/projected/81e90836-5a75-457e-8625-7a20aa4f37a1-kube-api-access-dj28x\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.070086 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.070004    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.070192 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.070097    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.070192 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.070139    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171077 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171044    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171227 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171107    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171227 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e90836-5a75-457e-8625-7a20aa4f37a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171227 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171181    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171227 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171212    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj28x\" (UniqueName: \"kubernetes.io/projected/81e90836-5a75-457e-8625-7a20aa4f37a1-kube-api-access-dj28x\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171379 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171246    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171653 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171598    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171774 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171654    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.171774 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.171752    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.173503 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.173485    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e90836-5a75-457e-8625-7a20aa4f37a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.173792 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.173774    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e90836-5a75-457e-8625-7a20aa4f37a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.179401 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.179377    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj28x\" (UniqueName: \"kubernetes.io/projected/81e90836-5a75-457e-8625-7a20aa4f37a1-kube-api-access-dj28x\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bwpsq\" (UID: \"81e90836-5a75-457e-8625-7a20aa4f37a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.301423 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.301329    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:34.435717 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.435689    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"]
Jul 08 19:37:34.437553 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:37:34.437526    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e90836_5a75_457e_8625_7a20aa4f37a1.slice/crio-1914bb7669b67ee788a938e5b8f85bcd5e082f5cd185875215564db4ab7ec800 WatchSource:0}: Error finding container 1914bb7669b67ee788a938e5b8f85bcd5e082f5cd185875215564db4ab7ec800: Status 404 returned error can't find the container with id 1914bb7669b67ee788a938e5b8f85bcd5e082f5cd185875215564db4ab7ec800
Jul 08 19:37:34.786001 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.785970    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq" event={"ID":"81e90836-5a75-457e-8625-7a20aa4f37a1","Type":"ContainerStarted","Data":"29017a170b363729e30b53159eb067787f3f452e5a8ed6ca1828098e1119fe8a"}
Jul 08 19:37:34.786192 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.786026    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq" event={"ID":"81e90836-5a75-457e-8625-7a20aa4f37a1","Type":"ContainerStarted","Data":"1914bb7669b67ee788a938e5b8f85bcd5e082f5cd185875215564db4ab7ec800"}
Jul 08 19:37:34.803305 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:34.803247    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq" podStartSLOduration=1.563864729 podStartE2EDuration="1.803231121s" totalImagesPullingTime="239.366392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:37:34.802563766 +0000 UTC m=+827.886337621" watchObservedRunningTime="2026-07-08 19:37:34.803231121 +0000 UTC m=+827.887004972"
Jul 08 19:37:44.301896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:44.301862    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:44.302323 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:44.302170    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:44.314651 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:44.314606    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:37:44.843517 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:37:44.843481    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bwpsq"
Jul 08 19:38:20.787254 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.787222    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"]
Jul 08 19:38:20.789864 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.789842    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.792471 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.792451    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 19:38:20.802301 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.802276    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"]
Jul 08 19:38:20.887934 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.887902    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eccd20fa-f599-4ff6-a60b-12dee0698fcb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.887934 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.887939    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.888146 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.887971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.888146 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.888048    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.888146 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.888078    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.888146 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.888095    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz7r6\" (UniqueName: \"kubernetes.io/projected/eccd20fa-f599-4ff6-a60b-12dee0698fcb-kube-api-access-vz7r6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.989461 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989420    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.989608 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989492    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.989608 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.989608 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989537    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz7r6\" (UniqueName: \"kubernetes.io/projected/eccd20fa-f599-4ff6-a60b-12dee0698fcb-kube-api-access-vz7r6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.989608 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989581    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eccd20fa-f599-4ff6-a60b-12dee0698fcb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.989869 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989680    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.989981 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989963    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.990042 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.989997    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.990082 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.990051    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.991719 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.991697    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eccd20fa-f599-4ff6-a60b-12dee0698fcb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.991992 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.991974    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eccd20fa-f599-4ff6-a60b-12dee0698fcb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:20.997555 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:20.997528    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz7r6\" (UniqueName: \"kubernetes.io/projected/eccd20fa-f599-4ff6-a60b-12dee0698fcb-kube-api-access-vz7r6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw\" (UID: \"eccd20fa-f599-4ff6-a60b-12dee0698fcb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:21.100097 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:21.100011    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:21.232436 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:21.232413    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"]
Jul 08 19:38:21.234710 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:38:21.234670    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeccd20fa_f599_4ff6_a60b_12dee0698fcb.slice/crio-cc071497e0fe62698be95ded67388f644287a017e24ca87f89188cc4e1092783 WatchSource:0}: Error finding container cc071497e0fe62698be95ded67388f644287a017e24ca87f89188cc4e1092783: Status 404 returned error can't find the container with id cc071497e0fe62698be95ded67388f644287a017e24ca87f89188cc4e1092783
Jul 08 19:38:22.006549 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:22.006516    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw" event={"ID":"eccd20fa-f599-4ff6-a60b-12dee0698fcb","Type":"ContainerStarted","Data":"3de38991fc0dd1e724683d00beac61d8df728e9a69e19e1e6eae80af3c0a568b"}
Jul 08 19:38:22.007032 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:22.006561    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw" event={"ID":"eccd20fa-f599-4ff6-a60b-12dee0698fcb","Type":"ContainerStarted","Data":"cc071497e0fe62698be95ded67388f644287a017e24ca87f89188cc4e1092783"}
Jul 08 19:38:22.024925 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:22.024815    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw" podStartSLOduration=1.8479441049999998 podStartE2EDuration="2.024796083s" totalImagesPullingTime="176.851978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:22.024070068 +0000 UTC m=+875.107843920" watchObservedRunningTime="2026-07-08 19:38:22.024796083 +0000 UTC m=+875.108569935"
Jul 08 19:38:31.100653 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:31.100598    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:31.100653 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:31.100662    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:31.113455 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:31.113429    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:32.065727 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:32.065698    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw"
Jul 08 19:38:47.427670 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:47.427585    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:38:47.429233 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:38:47.429211    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:40:09.746825 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:09.746740    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c6fb9585-tgn78"]
Jul 08 19:40:09.747389 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:09.747016    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-9c6fb9585-tgn78" podUID="cb6b4509-42f8-4dc7-a948-706694f58e64" containerName="manager" containerID="cri-o://dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b" gracePeriod=30
Jul 08 19:40:09.997652 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:09.997563    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:40:10.060079 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.060045    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w74xm\" (UniqueName: \"kubernetes.io/projected/cb6b4509-42f8-4dc7-a948-706694f58e64-kube-api-access-w74xm\") pod \"cb6b4509-42f8-4dc7-a948-706694f58e64\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") "
Jul 08 19:40:10.060240 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.060106    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert\") pod \"cb6b4509-42f8-4dc7-a948-706694f58e64\" (UID: \"cb6b4509-42f8-4dc7-a948-706694f58e64\") "
Jul 08 19:40:10.062114 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.062075    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6b4509-42f8-4dc7-a948-706694f58e64-kube-api-access-w74xm" (OuterVolumeSpecName: "kube-api-access-w74xm") pod "cb6b4509-42f8-4dc7-a948-706694f58e64" (UID: "cb6b4509-42f8-4dc7-a948-706694f58e64"). InnerVolumeSpecName "kube-api-access-w74xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:40:10.062231 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.062212    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cb6b4509-42f8-4dc7-a948-706694f58e64" (UID: "cb6b4509-42f8-4dc7-a948-706694f58e64"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 19:40:10.161021 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.160982    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w74xm\" (UniqueName: \"kubernetes.io/projected/cb6b4509-42f8-4dc7-a948-706694f58e64-kube-api-access-w74xm\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:40:10.161021 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.161013    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb6b4509-42f8-4dc7-a948-706694f58e64-webhook-cert\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:40:10.534448 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.534413    2554 generic.go:356] "Generic (PLEG): container finished" podID="cb6b4509-42f8-4dc7-a948-706694f58e64" containerID="dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b" exitCode=0
Jul 08 19:40:10.534632 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.534470    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6fb9585-tgn78"
Jul 08 19:40:10.534632 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.534476    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6fb9585-tgn78" event={"ID":"cb6b4509-42f8-4dc7-a948-706694f58e64","Type":"ContainerDied","Data":"dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b"}
Jul 08 19:40:10.534632 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.534522    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6fb9585-tgn78" event={"ID":"cb6b4509-42f8-4dc7-a948-706694f58e64","Type":"ContainerDied","Data":"a259f1c9efd5daed04c4d84f3ed57ddc596d5fdacd0dd6524d0f2fbe0c1321a6"}
Jul 08 19:40:10.534632 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.534546    2554 scope.go:117] "RemoveContainer" containerID="dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b"
Jul 08 19:40:10.543862 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.543842    2554 scope.go:117] "RemoveContainer" containerID="dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b"
Jul 08 19:40:10.544153 ip-10-0-136-213 kubenswrapper[2554]: E0708 19:40:10.544134    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b\": container with ID starting with dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b not found: ID does not exist" containerID="dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b"
Jul 08 19:40:10.544219 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.544160    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b"} err="failed to get container status \"dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b\": rpc error: code = NotFound desc = could not find container \"dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b\": container with ID starting with dbefcb7a274d51f44ee85656c24040318737be316275e23c756ada9064dab30b not found: ID does not exist"
Jul 08 19:40:10.556761 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.556729    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c6fb9585-tgn78"]
Jul 08 19:40:10.560151 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:10.560111    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9c6fb9585-tgn78"]
Jul 08 19:40:11.449798 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.449763    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c6fb9585-hqb84"]
Jul 08 19:40:11.450172 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.450150    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6b4509-42f8-4dc7-a948-706694f58e64" containerName="manager"
Jul 08 19:40:11.450172 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.450161    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6b4509-42f8-4dc7-a948-706694f58e64" containerName="manager"
Jul 08 19:40:11.450246 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.450226    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6b4509-42f8-4dc7-a948-706694f58e64" containerName="manager"
Jul 08 19:40:11.454572 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.454552    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.457726 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.457702    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 19:40:11.457726 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.457719    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 19:40:11.457896 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.457701    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7phh8\""
Jul 08 19:40:11.463957 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.463931    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6fb9585-hqb84"]
Jul 08 19:40:11.472381 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.472349    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3911c8-7910-461b-bf55-d26249934403-webhook-cert\") pod \"maas-controller-9c6fb9585-hqb84\" (UID: \"4b3911c8-7910-461b-bf55-d26249934403\") " pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.472585 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.472457    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzkx2\" (UniqueName: \"kubernetes.io/projected/4b3911c8-7910-461b-bf55-d26249934403-kube-api-access-rzkx2\") pod \"maas-controller-9c6fb9585-hqb84\" (UID: \"4b3911c8-7910-461b-bf55-d26249934403\") " pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.498479 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.498445    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb6b4509-42f8-4dc7-a948-706694f58e64" path="/var/lib/kubelet/pods/cb6b4509-42f8-4dc7-a948-706694f58e64/volumes"
Jul 08 19:40:11.573518 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.573472    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzkx2\" (UniqueName: \"kubernetes.io/projected/4b3911c8-7910-461b-bf55-d26249934403-kube-api-access-rzkx2\") pod \"maas-controller-9c6fb9585-hqb84\" (UID: \"4b3911c8-7910-461b-bf55-d26249934403\") " pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.573739 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.573554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3911c8-7910-461b-bf55-d26249934403-webhook-cert\") pod \"maas-controller-9c6fb9585-hqb84\" (UID: \"4b3911c8-7910-461b-bf55-d26249934403\") " pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.576129 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.576105    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b3911c8-7910-461b-bf55-d26249934403-webhook-cert\") pod \"maas-controller-9c6fb9585-hqb84\" (UID: \"4b3911c8-7910-461b-bf55-d26249934403\") " pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.581919 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.581888    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzkx2\" (UniqueName: \"kubernetes.io/projected/4b3911c8-7910-461b-bf55-d26249934403-kube-api-access-rzkx2\") pod \"maas-controller-9c6fb9585-hqb84\" (UID: \"4b3911c8-7910-461b-bf55-d26249934403\") " pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.766752 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.766642    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:11.901109 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.901082    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c6fb9585-hqb84"]
Jul 08 19:40:11.903091 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:40:11.903067    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3911c8_7910_461b_bf55_d26249934403.slice/crio-dbf1e171db8519e487650cd213e2403e57322f75e6e9168a2a47b7753031f0cc WatchSource:0}: Error finding container dbf1e171db8519e487650cd213e2403e57322f75e6e9168a2a47b7753031f0cc: Status 404 returned error can't find the container with id dbf1e171db8519e487650cd213e2403e57322f75e6e9168a2a47b7753031f0cc
Jul 08 19:40:11.904807 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:11.904793    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 19:40:12.547256 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:12.547212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6fb9585-hqb84" event={"ID":"4b3911c8-7910-461b-bf55-d26249934403","Type":"ContainerStarted","Data":"06a4ee1e26cd2d88f68d886b014f204a2198acdda62a5e981593bec135838703"}
Jul 08 19:40:12.547693 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:12.547268    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c6fb9585-hqb84" event={"ID":"4b3911c8-7910-461b-bf55-d26249934403","Type":"ContainerStarted","Data":"dbf1e171db8519e487650cd213e2403e57322f75e6e9168a2a47b7753031f0cc"}
Jul 08 19:40:12.547693 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:12.547307    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:40:12.566442 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:12.566386    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c6fb9585-hqb84" podStartSLOduration=1.029825577 podStartE2EDuration="1.566367996s" totalImagesPullingTime="536.542419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:40:12.563664008 +0000 UTC m=+985.647437858" watchObservedRunningTime="2026-07-08 19:40:12.566367996 +0000 UTC m=+985.650141846"
Jul 08 19:40:23.558161 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:40:23.558125    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c6fb9585-hqb84"
Jul 08 19:41:47.474250 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:41:47.474168    2554 scope.go:117] "RemoveContainer" containerID="74819eb76de63e299fcfdf8ff0e812e29ac4a461c135cf124647770d0c3b0328"
Jul 08 19:43:47.457027 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:43:47.457000    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:43:47.461552 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:43:47.461531    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:45:00.153237 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.153152    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29725665-dlqnv"]
Jul 08 19:45:00.156738 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.156722    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv"
Jul 08 19:45:00.179175 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.179146    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29725665-dlqnv"]
Jul 08 19:45:00.313016 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.312980    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpp9n\" (UniqueName: \"kubernetes.io/projected/eae6b3b4-2c9e-45cf-963f-766873a159d5-kube-api-access-xpp9n\") pod \"maas-api-key-cleanup-29725665-dlqnv\" (UID: \"eae6b3b4-2c9e-45cf-963f-766873a159d5\") " pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv"
Jul 08 19:45:00.414240 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.414141    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpp9n\" (UniqueName: \"kubernetes.io/projected/eae6b3b4-2c9e-45cf-963f-766873a159d5-kube-api-access-xpp9n\") pod \"maas-api-key-cleanup-29725665-dlqnv\" (UID: \"eae6b3b4-2c9e-45cf-963f-766873a159d5\") " pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv"
Jul 08 19:45:00.423567 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.423532    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpp9n\" (UniqueName: \"kubernetes.io/projected/eae6b3b4-2c9e-45cf-963f-766873a159d5-kube-api-access-xpp9n\") pod \"maas-api-key-cleanup-29725665-dlqnv\" (UID: \"eae6b3b4-2c9e-45cf-963f-766873a159d5\") " pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv"
Jul 08 19:45:00.466441 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.466406    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv"
Jul 08 19:45:00.602248 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.602224    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29725665-dlqnv"]
Jul 08 19:45:00.604413 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:45:00.604379    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae6b3b4_2c9e_45cf_963f_766873a159d5.slice/crio-9b6eb3f0bdf395640a77d06104c57e0976b4f1ba88baa0a7c8366cf9d6e39921 WatchSource:0}: Error finding container 9b6eb3f0bdf395640a77d06104c57e0976b4f1ba88baa0a7c8366cf9d6e39921: Status 404 returned error can't find the container with id 9b6eb3f0bdf395640a77d06104c57e0976b4f1ba88baa0a7c8366cf9d6e39921
Jul 08 19:45:00.916642 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:00.916593    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv" event={"ID":"eae6b3b4-2c9e-45cf-963f-766873a159d5","Type":"ContainerStarted","Data":"9b6eb3f0bdf395640a77d06104c57e0976b4f1ba88baa0a7c8366cf9d6e39921"}
Jul 08 19:45:03.933879 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:03.933778    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv" event={"ID":"eae6b3b4-2c9e-45cf-963f-766873a159d5","Type":"ContainerStarted","Data":"618dfa6dc8d08969010d1f1453d93ba1ecfa68cf31a77bffb5662a773938939d"}
Jul 08 19:45:03.961281 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:03.961228    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv" podStartSLOduration=1.216500095 podStartE2EDuration="3.961213923s" totalImagesPullingTime="2.744713828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:03.960440958 +0000 UTC m=+1277.044214808" watchObservedRunningTime="2026-07-08 19:45:03.961213923 +0000 UTC m=+1277.044987773"
Jul 08 19:45:04.940315 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:04.940278    2554 generic.go:356] "Generic (PLEG): container finished" podID="eae6b3b4-2c9e-45cf-963f-766873a159d5" containerID="618dfa6dc8d08969010d1f1453d93ba1ecfa68cf31a77bffb5662a773938939d" exitCode=0
Jul 08 19:45:04.940712 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:04.940365    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv" event={"ID":"eae6b3b4-2c9e-45cf-963f-766873a159d5","Type":"ContainerDied","Data":"618dfa6dc8d08969010d1f1453d93ba1ecfa68cf31a77bffb5662a773938939d"}
Jul 08 19:45:06.076464 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:06.076438    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv"
Jul 08 19:45:06.168078 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:06.168042    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpp9n\" (UniqueName: \"kubernetes.io/projected/eae6b3b4-2c9e-45cf-963f-766873a159d5-kube-api-access-xpp9n\") pod \"eae6b3b4-2c9e-45cf-963f-766873a159d5\" (UID: \"eae6b3b4-2c9e-45cf-963f-766873a159d5\") "
Jul 08 19:45:06.170047 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:06.170023    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae6b3b4-2c9e-45cf-963f-766873a159d5-kube-api-access-xpp9n" (OuterVolumeSpecName: "kube-api-access-xpp9n") pod "eae6b3b4-2c9e-45cf-963f-766873a159d5" (UID: "eae6b3b4-2c9e-45cf-963f-766873a159d5"). InnerVolumeSpecName "kube-api-access-xpp9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 19:45:06.269791 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:06.269703    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpp9n\" (UniqueName: \"kubernetes.io/projected/eae6b3b4-2c9e-45cf-963f-766873a159d5-kube-api-access-xpp9n\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 19:45:06.952015 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:06.951983    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv"
Jul 08 19:45:06.952015 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:06.951992    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725665-dlqnv" event={"ID":"eae6b3b4-2c9e-45cf-963f-766873a159d5","Type":"ContainerDied","Data":"9b6eb3f0bdf395640a77d06104c57e0976b4f1ba88baa0a7c8366cf9d6e39921"}
Jul 08 19:45:06.952228 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:45:06.952043    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b6eb3f0bdf395640a77d06104c57e0976b4f1ba88baa0a7c8366cf9d6e39921"
Jul 08 19:48:47.488446 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:48:47.488420    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:48:47.494406 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:48:47.494379    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:53:47.518925 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:53:47.518897    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:53:47.527052 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:53:47.527027    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:58:47.550181 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:58:47.550148    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:58:47.559976 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:58:47.559951    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 19:59:24.202466 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.202432    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"]
Jul 08 19:59:24.203085 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.202996    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae6b3b4-2c9e-45cf-963f-766873a159d5" containerName="cleanup"
Jul 08 19:59:24.203085 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.203011    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae6b3b4-2c9e-45cf-963f-766873a159d5" containerName="cleanup"
Jul 08 19:59:24.203085 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.203087    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae6b3b4-2c9e-45cf-963f-766873a159d5" containerName="cleanup"
Jul 08 19:59:24.206124 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.206103    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.209353 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.209332    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d7248b\"/\"openshift-service-ca.crt\""
Jul 08 19:59:24.209501 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.209349    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d7248b\"/\"test-model-d7248b-kserve-self-signed-certs\""
Jul 08 19:59:24.209501 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.209336    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d7248b\"/\"default-dockercfg-nh4kp\""
Jul 08 19:59:24.209501 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.209335    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d7248b\"/\"kube-root-ca.crt\""
Jul 08 19:59:24.216801 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.216778    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"]
Jul 08 19:59:24.352775 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.352740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-model-cache\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.352980 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.352782    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-home\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.352980 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.352819    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffvr\" (UniqueName: \"kubernetes.io/projected/3e20c02f-dc81-4008-aba1-0f19f231cefe-kube-api-access-cffvr\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.352980 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.352910    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-tmp-dir\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.352980 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.352957    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-dshm\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.353147 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.352981    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e20c02f-dc81-4008-aba1-0f19f231cefe-tls-certs\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454391 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454303    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-model-cache\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454391 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454342    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-home\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454391 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454369    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffvr\" (UniqueName: \"kubernetes.io/projected/3e20c02f-dc81-4008-aba1-0f19f231cefe-kube-api-access-cffvr\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454688 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454417    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-tmp-dir\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454688 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454453    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-dshm\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454688 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e20c02f-dc81-4008-aba1-0f19f231cefe-tls-certs\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454856 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454813    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-model-cache\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454917 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454864    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-home\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.454917 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.454903    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-tmp-dir\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.456707 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.456687    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-dshm\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.456878 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.456862    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e20c02f-dc81-4008-aba1-0f19f231cefe-tls-certs\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.462494 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.462469    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffvr\" (UniqueName: \"kubernetes.io/projected/3e20c02f-dc81-4008-aba1-0f19f231cefe-kube-api-access-cffvr\") pod \"test-model-d7248b-kserve-795d4d59f-fz2h7\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") " pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.515734 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.515693    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:24.649809 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:24.649779    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"]
Jul 08 19:59:24.652231 ip-10-0-136-213 kubenswrapper[2554]: W0708 19:59:24.652203    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e20c02f_dc81_4008_aba1_0f19f231cefe.slice/crio-8dc89e42bbd0c00339e57797d3144f6212102d4be80d02413d82919638076614 WatchSource:0}: Error finding container 8dc89e42bbd0c00339e57797d3144f6212102d4be80d02413d82919638076614: Status 404 returned error can't find the container with id 8dc89e42bbd0c00339e57797d3144f6212102d4be80d02413d82919638076614
Jul 08 19:59:25.052097 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:25.052052    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7" event={"ID":"3e20c02f-dc81-4008-aba1-0f19f231cefe","Type":"ContainerStarted","Data":"e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2"}
Jul 08 19:59:25.052097 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:25.052105    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7" event={"ID":"3e20c02f-dc81-4008-aba1-0f19f231cefe","Type":"ContainerStarted","Data":"8dc89e42bbd0c00339e57797d3144f6212102d4be80d02413d82919638076614"}
Jul 08 19:59:25.069817 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:25.069755    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7" podStartSLOduration=1.069734882 podStartE2EDuration="1.069734882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:59:25.069230117 +0000 UTC m=+2138.153003968" watchObservedRunningTime="2026-07-08 19:59:25.069734882 +0000 UTC m=+2138.153508734"
Jul 08 19:59:34.516544 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:34.516510    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:34.516964 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:34.516595    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:34.529315 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:34.529292    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 19:59:35.109866 ip-10-0-136-213 kubenswrapper[2554]: I0708 19:59:35.109837    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 20:00:00.135703 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.135603    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"]
Jul 08 20:00:00.139129 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.139103    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29725680-xx8wq"]
Jul 08 20:00:00.139237 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.139218    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"
Jul 08 20:00:00.142456 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.142437    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq"
Jul 08 20:00:00.146896 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.146872    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"]
Jul 08 20:00:00.149817 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.149784    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29725680-xx8wq"]
Jul 08 20:00:00.194000 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.193964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgrg\" (UniqueName: \"kubernetes.io/projected/375cbf5e-eec1-434c-ac7e-ecef5e86838e-kube-api-access-zrgrg\") pod \"maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9\" (UID: \"375cbf5e-eec1-434c-ac7e-ecef5e86838e\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"
Jul 08 20:00:00.194000 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.194015    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlcw\" (UniqueName: \"kubernetes.io/projected/24805e88-d085-41ac-a28a-872118a55b44-kube-api-access-twlcw\") pod \"maas-api-key-cleanup-29725680-xx8wq\" (UID: \"24805e88-d085-41ac-a28a-872118a55b44\") " pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq"
Jul 08 20:00:00.294753 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.294714    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgrg\" (UniqueName: \"kubernetes.io/projected/375cbf5e-eec1-434c-ac7e-ecef5e86838e-kube-api-access-zrgrg\") pod \"maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9\" (UID: \"375cbf5e-eec1-434c-ac7e-ecef5e86838e\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"
Jul 08 20:00:00.294958 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.294769    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlcw\" (UniqueName: \"kubernetes.io/projected/24805e88-d085-41ac-a28a-872118a55b44-kube-api-access-twlcw\") pod \"maas-api-key-cleanup-29725680-xx8wq\" (UID: \"24805e88-d085-41ac-a28a-872118a55b44\") " pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq"
Jul 08 20:00:00.304237 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.304201    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgrg\" (UniqueName: \"kubernetes.io/projected/375cbf5e-eec1-434c-ac7e-ecef5e86838e-kube-api-access-zrgrg\") pod \"maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9\" (UID: \"375cbf5e-eec1-434c-ac7e-ecef5e86838e\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"
Jul 08 20:00:00.304364 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.304264    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlcw\" (UniqueName: \"kubernetes.io/projected/24805e88-d085-41ac-a28a-872118a55b44-kube-api-access-twlcw\") pod \"maas-api-key-cleanup-29725680-xx8wq\" (UID: \"24805e88-d085-41ac-a28a-872118a55b44\") " pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq"
Jul 08 20:00:00.452284 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.452204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"
Jul 08 20:00:00.458726 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.458706    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq"
Jul 08 20:00:00.601486 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.601456    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"]
Jul 08 20:00:00.604009 ip-10-0-136-213 kubenswrapper[2554]: W0708 20:00:00.603983    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375cbf5e_eec1_434c_ac7e_ecef5e86838e.slice/crio-7e29275fa4db8610dfa60dd625aa85adace017f594d646e81997a249dc6ea8a6 WatchSource:0}: Error finding container 7e29275fa4db8610dfa60dd625aa85adace017f594d646e81997a249dc6ea8a6: Status 404 returned error can't find the container with id 7e29275fa4db8610dfa60dd625aa85adace017f594d646e81997a249dc6ea8a6
Jul 08 20:00:00.618513 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:00.618491    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29725680-xx8wq"]
Jul 08 20:00:00.620138 ip-10-0-136-213 kubenswrapper[2554]: W0708 20:00:00.620110    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24805e88_d085_41ac_a28a_872118a55b44.slice/crio-6363831b7d4e69ac5f86a3e63bffac1a2829628fb6d955aa33ea80f94b585cdf WatchSource:0}: Error finding container 6363831b7d4e69ac5f86a3e63bffac1a2829628fb6d955aa33ea80f94b585cdf: Status 404 returned error can't find the container with id 6363831b7d4e69ac5f86a3e63bffac1a2829628fb6d955aa33ea80f94b585cdf
Jul 08 20:00:01.224606 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:01.224568    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9" event={"ID":"375cbf5e-eec1-434c-ac7e-ecef5e86838e","Type":"ContainerStarted","Data":"e4ac659d04cd043e4b9488686b8ea3e39b2f421ff12b71e16dcd00acae2724dc"}
Jul 08 20:00:01.225099 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:01.224654    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9" event={"ID":"375cbf5e-eec1-434c-ac7e-ecef5e86838e","Type":"ContainerStarted","Data":"7e29275fa4db8610dfa60dd625aa85adace017f594d646e81997a249dc6ea8a6"}
Jul 08 20:00:01.226266 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:01.226239    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq" event={"ID":"24805e88-d085-41ac-a28a-872118a55b44","Type":"ContainerStarted","Data":"478306db0260bf952234f8a5f71859aa9c4d84e5aafd9852e6c18095c37c37f1"}
Jul 08 20:00:01.226373 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:01.226286    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq" event={"ID":"24805e88-d085-41ac-a28a-872118a55b44","Type":"ContainerStarted","Data":"6363831b7d4e69ac5f86a3e63bffac1a2829628fb6d955aa33ea80f94b585cdf"}
Jul 08 20:00:01.244802 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:01.244751    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9" podStartSLOduration=1.244734583 podStartE2EDuration="1.244734583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:01.242667479 +0000 UTC m=+2174.326441335" watchObservedRunningTime="2026-07-08 20:00:01.244734583 +0000 UTC m=+2174.328508434"
Jul 08 20:00:01.263132 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:01.263065    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq" podStartSLOduration=1.26304535 podStartE2EDuration="1.26304535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:01.262993189 +0000 UTC m=+2174.346767041" watchObservedRunningTime="2026-07-08 20:00:01.26304535 +0000 UTC m=+2174.346819201"
Jul 08 20:00:02.232633 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:02.232585    2554 generic.go:356] "Generic (PLEG): container finished" podID="375cbf5e-eec1-434c-ac7e-ecef5e86838e" containerID="e4ac659d04cd043e4b9488686b8ea3e39b2f421ff12b71e16dcd00acae2724dc" exitCode=0
Jul 08 20:00:02.233116 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:02.232657    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9" event={"ID":"375cbf5e-eec1-434c-ac7e-ecef5e86838e","Type":"ContainerDied","Data":"e4ac659d04cd043e4b9488686b8ea3e39b2f421ff12b71e16dcd00acae2724dc"}
Jul 08 20:00:02.234215 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:02.234191    2554 generic.go:356] "Generic (PLEG): container finished" podID="24805e88-d085-41ac-a28a-872118a55b44" containerID="478306db0260bf952234f8a5f71859aa9c4d84e5aafd9852e6c18095c37c37f1" exitCode=0
Jul 08 20:00:02.234343 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:02.234273    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq" event={"ID":"24805e88-d085-41ac-a28a-872118a55b44","Type":"ContainerDied","Data":"478306db0260bf952234f8a5f71859aa9c4d84e5aafd9852e6c18095c37c37f1"}
Jul 08 20:00:03.386163 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.386141    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq"
Jul 08 20:00:03.408194 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.408167    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"
Jul 08 20:00:03.526355 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.526265    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrgrg\" (UniqueName: \"kubernetes.io/projected/375cbf5e-eec1-434c-ac7e-ecef5e86838e-kube-api-access-zrgrg\") pod \"375cbf5e-eec1-434c-ac7e-ecef5e86838e\" (UID: \"375cbf5e-eec1-434c-ac7e-ecef5e86838e\") "
Jul 08 20:00:03.526506 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.526381    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twlcw\" (UniqueName: \"kubernetes.io/projected/24805e88-d085-41ac-a28a-872118a55b44-kube-api-access-twlcw\") pod \"24805e88-d085-41ac-a28a-872118a55b44\" (UID: \"24805e88-d085-41ac-a28a-872118a55b44\") "
Jul 08 20:00:03.528415 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.528391    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24805e88-d085-41ac-a28a-872118a55b44-kube-api-access-twlcw" (OuterVolumeSpecName: "kube-api-access-twlcw") pod "24805e88-d085-41ac-a28a-872118a55b44" (UID: "24805e88-d085-41ac-a28a-872118a55b44"). InnerVolumeSpecName "kube-api-access-twlcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:00:03.528500 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.528443    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375cbf5e-eec1-434c-ac7e-ecef5e86838e-kube-api-access-zrgrg" (OuterVolumeSpecName: "kube-api-access-zrgrg") pod "375cbf5e-eec1-434c-ac7e-ecef5e86838e" (UID: "375cbf5e-eec1-434c-ac7e-ecef5e86838e"). InnerVolumeSpecName "kube-api-access-zrgrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:00:03.626945 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.626916    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrgrg\" (UniqueName: \"kubernetes.io/projected/375cbf5e-eec1-434c-ac7e-ecef5e86838e-kube-api-access-zrgrg\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:03.626945 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:03.626940    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twlcw\" (UniqueName: \"kubernetes.io/projected/24805e88-d085-41ac-a28a-872118a55b44-kube-api-access-twlcw\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:04.246182 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:04.246151    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"
Jul 08 20:00:04.246182 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:04.246162    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9" event={"ID":"375cbf5e-eec1-434c-ac7e-ecef5e86838e","Type":"ContainerDied","Data":"7e29275fa4db8610dfa60dd625aa85adace017f594d646e81997a249dc6ea8a6"}
Jul 08 20:00:04.246443 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:04.246202    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e29275fa4db8610dfa60dd625aa85adace017f594d646e81997a249dc6ea8a6"
Jul 08 20:00:04.247418 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:04.247400    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq"
Jul 08 20:00:04.247418 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:04.247415    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29725680-xx8wq" event={"ID":"24805e88-d085-41ac-a28a-872118a55b44","Type":"ContainerDied","Data":"6363831b7d4e69ac5f86a3e63bffac1a2829628fb6d955aa33ea80f94b585cdf"}
Jul 08 20:00:04.247652 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:04.247447    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6363831b7d4e69ac5f86a3e63bffac1a2829628fb6d955aa33ea80f94b585cdf"
Jul 08 20:00:12.929871 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:12.929838    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"]
Jul 08 20:00:27.949797 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:27.949752    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7" podUID="3e20c02f-dc81-4008-aba1-0f19f231cefe" containerName="main" containerID="cri-o://e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2" gracePeriod=45
Jul 08 20:00:28.206558 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.206500    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 20:00:28.254289 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254255    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-tmp-dir\") pod \"3e20c02f-dc81-4008-aba1-0f19f231cefe\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") "
Jul 08 20:00:28.254481 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254304    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cffvr\" (UniqueName: \"kubernetes.io/projected/3e20c02f-dc81-4008-aba1-0f19f231cefe-kube-api-access-cffvr\") pod \"3e20c02f-dc81-4008-aba1-0f19f231cefe\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") "
Jul 08 20:00:28.254481 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254328    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-dshm\") pod \"3e20c02f-dc81-4008-aba1-0f19f231cefe\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") "
Jul 08 20:00:28.254481 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254378    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e20c02f-dc81-4008-aba1-0f19f231cefe-tls-certs\") pod \"3e20c02f-dc81-4008-aba1-0f19f231cefe\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") "
Jul 08 20:00:28.254677 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254485    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-model-cache\") pod \"3e20c02f-dc81-4008-aba1-0f19f231cefe\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") "
Jul 08 20:00:28.254677 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254539    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-home\") pod \"3e20c02f-dc81-4008-aba1-0f19f231cefe\" (UID: \"3e20c02f-dc81-4008-aba1-0f19f231cefe\") "
Jul 08 20:00:28.254677 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254558    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e20c02f-dc81-4008-aba1-0f19f231cefe" (UID: "3e20c02f-dc81-4008-aba1-0f19f231cefe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:00:28.254933 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254792    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-home" (OuterVolumeSpecName: "home") pod "3e20c02f-dc81-4008-aba1-0f19f231cefe" (UID: "3e20c02f-dc81-4008-aba1-0f19f231cefe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:00:28.254933 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254886    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e20c02f-dc81-4008-aba1-0f19f231cefe" (UID: "3e20c02f-dc81-4008-aba1-0f19f231cefe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:00:28.255039 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254931    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-tmp-dir\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:28.255039 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.254949    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-home\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:28.256756 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.256726    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-dshm" (OuterVolumeSpecName: "dshm") pod "3e20c02f-dc81-4008-aba1-0f19f231cefe" (UID: "3e20c02f-dc81-4008-aba1-0f19f231cefe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:00:28.256864 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.256791    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e20c02f-dc81-4008-aba1-0f19f231cefe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e20c02f-dc81-4008-aba1-0f19f231cefe" (UID: "3e20c02f-dc81-4008-aba1-0f19f231cefe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:00:28.256864 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.256827    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e20c02f-dc81-4008-aba1-0f19f231cefe-kube-api-access-cffvr" (OuterVolumeSpecName: "kube-api-access-cffvr") pod "3e20c02f-dc81-4008-aba1-0f19f231cefe" (UID: "3e20c02f-dc81-4008-aba1-0f19f231cefe"). InnerVolumeSpecName "kube-api-access-cffvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:00:28.355487 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.355450    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cffvr\" (UniqueName: \"kubernetes.io/projected/3e20c02f-dc81-4008-aba1-0f19f231cefe-kube-api-access-cffvr\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:28.355487 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.355482    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-dshm\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:28.355487 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.355493    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e20c02f-dc81-4008-aba1-0f19f231cefe-tls-certs\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:28.355765 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.355502    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e20c02f-dc81-4008-aba1-0f19f231cefe-model-cache\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:00:28.366815 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.366788    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e20c02f-dc81-4008-aba1-0f19f231cefe" containerID="e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2" exitCode=0
Jul 08 20:00:28.366957 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.366833    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"
Jul 08 20:00:28.366957 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.366867    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7" event={"ID":"3e20c02f-dc81-4008-aba1-0f19f231cefe","Type":"ContainerDied","Data":"e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2"}
Jul 08 20:00:28.366957 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.366908    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7" event={"ID":"3e20c02f-dc81-4008-aba1-0f19f231cefe","Type":"ContainerDied","Data":"8dc89e42bbd0c00339e57797d3144f6212102d4be80d02413d82919638076614"}
Jul 08 20:00:28.366957 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.366925    2554 scope.go:117] "RemoveContainer" containerID="e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2"
Jul 08 20:00:28.378702 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.378683    2554 scope.go:117] "RemoveContainer" containerID="e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2"
Jul 08 20:00:28.378974 ip-10-0-136-213 kubenswrapper[2554]: E0708 20:00:28.378956    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2\": container with ID starting with e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2 not found: ID does not exist" containerID="e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2"
Jul 08 20:00:28.379028 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.378982    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2"} err="failed to get container status \"e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2\": rpc error: code = NotFound desc = could not find container \"e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2\": container with ID starting with e751769a518104a934c5f6162b69b6cfda5ff138986052c39cc300017885b7a2 not found: ID does not exist"
Jul 08 20:00:28.389872 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.389853    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"]
Jul 08 20:00:28.392065 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:28.392045    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d7248b/test-model-d7248b-kserve-795d4d59f-fz2h7"]
Jul 08 20:00:29.497855 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:29.497823    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e20c02f-dc81-4008-aba1-0f19f231cefe" path="/var/lib/kubelet/pods/3e20c02f-dc81-4008-aba1-0f19f231cefe/volumes"
Jul 08 20:00:58.111653 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:58.111600    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"]
Jul 08 20:00:58.117189 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:58.117158    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-deba89-29725680-n6zq9"]
Jul 08 20:00:59.497994 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:00:59.497962    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="375cbf5e-eec1-434c-ac7e-ecef5e86838e" path="/var/lib/kubelet/pods/375cbf5e-eec1-434c-ac7e-ecef5e86838e/volumes"
Jul 08 20:03:47.581391 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:03:47.581360    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 20:03:47.592348 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:03:47.592323    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 20:05:38.781249 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781166    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"]
Jul 08 20:05:38.781836 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781772    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375cbf5e-eec1-434c-ac7e-ecef5e86838e" containerName="cleanup"
Jul 08 20:05:38.781836 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781792    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="375cbf5e-eec1-434c-ac7e-ecef5e86838e" containerName="cleanup"
Jul 08 20:05:38.781836 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781825    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24805e88-d085-41ac-a28a-872118a55b44" containerName="cleanup"
Jul 08 20:05:38.781836 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781833    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="24805e88-d085-41ac-a28a-872118a55b44" containerName="cleanup"
Jul 08 20:05:38.782064 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781849    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e20c02f-dc81-4008-aba1-0f19f231cefe" containerName="main"
Jul 08 20:05:38.782064 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781858    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e20c02f-dc81-4008-aba1-0f19f231cefe" containerName="main"
Jul 08 20:05:38.782064 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781944    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="375cbf5e-eec1-434c-ac7e-ecef5e86838e" containerName="cleanup"
Jul 08 20:05:38.782064 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781959    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="24805e88-d085-41ac-a28a-872118a55b44" containerName="cleanup"
Jul 08 20:05:38.782064 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.781968    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e20c02f-dc81-4008-aba1-0f19f231cefe" containerName="main"
Jul 08 20:05:38.785117 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.785096    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.788361 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.788339    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"sub-test-model-ceba08-kserve-self-signed-certs\""
Jul 08 20:05:38.788361 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.788351    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"openshift-service-ca.crt\""
Jul 08 20:05:38.788523 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.788443    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"kube-root-ca.crt\""
Jul 08 20:05:38.788523 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.788457    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"default-dockercfg-w2tsr\""
Jul 08 20:05:38.796416 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.796391    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"]
Jul 08 20:05:38.861447 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.861406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-home\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.861447 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.861451    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm4x4\" (UniqueName: \"kubernetes.io/projected/e4e7a75a-4814-4cab-8457-f4982f0e7489-kube-api-access-hm4x4\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.861712 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.861481    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e7a75a-4814-4cab-8457-f4982f0e7489-tls-certs\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.861712 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.861571    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-tmp-dir\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.861712 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.861614    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-model-cache\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.861824 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.861719    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-dshm\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962158 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962120    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-dshm\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962359 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962174    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-home\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962359 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm4x4\" (UniqueName: \"kubernetes.io/projected/e4e7a75a-4814-4cab-8457-f4982f0e7489-kube-api-access-hm4x4\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962359 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962304    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e7a75a-4814-4cab-8457-f4982f0e7489-tls-certs\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962359 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962341    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-tmp-dir\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962583 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-model-cache\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962733 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962711    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-home\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962800 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962732    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-tmp-dir\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.962800 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.962788    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-model-cache\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.964422 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.964398    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-dshm\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.964710 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.964695    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e7a75a-4814-4cab-8457-f4982f0e7489-tls-certs\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:38.969480 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:38.969456    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm4x4\" (UniqueName: \"kubernetes.io/projected/e4e7a75a-4814-4cab-8457-f4982f0e7489-kube-api-access-hm4x4\") pod \"sub-test-model-ceba08-kserve-7d4f5bd845-d9q28\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") " pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:39.094598 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:39.094506    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:39.228102 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:39.228075    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"]
Jul 08 20:05:39.230141 ip-10-0-136-213 kubenswrapper[2554]: W0708 20:05:39.230113    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4e7a75a_4814_4cab_8457_f4982f0e7489.slice/crio-002e085ed7b1eddc39bbed9b2a166770847dc8074f181d1b457935a93a3a9433 WatchSource:0}: Error finding container 002e085ed7b1eddc39bbed9b2a166770847dc8074f181d1b457935a93a3a9433: Status 404 returned error can't find the container with id 002e085ed7b1eddc39bbed9b2a166770847dc8074f181d1b457935a93a3a9433
Jul 08 20:05:39.874557 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:39.874513    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28" event={"ID":"e4e7a75a-4814-4cab-8457-f4982f0e7489","Type":"ContainerStarted","Data":"721cfd6dab37603b753bbd8ade12fef103e187d733e6db7336e0bd50b2fe63e9"}
Jul 08 20:05:39.874557 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:39.874564    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28" event={"ID":"e4e7a75a-4814-4cab-8457-f4982f0e7489","Type":"ContainerStarted","Data":"002e085ed7b1eddc39bbed9b2a166770847dc8074f181d1b457935a93a3a9433"}
Jul 08 20:05:39.891665 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:39.891592    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28" podStartSLOduration=1.891574334 podStartE2EDuration="1.891574334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:05:39.890610509 +0000 UTC m=+2512.974384361" watchObservedRunningTime="2026-07-08 20:05:39.891574334 +0000 UTC m=+2512.975348185"
Jul 08 20:05:49.095377 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:49.095340    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:49.095807 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:49.095670    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:49.107933 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:49.107909    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:05:49.943610 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:05:49.943578    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:06:28.991139 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:28.991098    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"]
Jul 08 20:06:38.786561 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.786523    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"]
Jul 08 20:06:38.790392 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.790371    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:38.792603 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.792577    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-960620\"/\"openshift-service-ca.crt\""
Jul 08 20:06:38.792727 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.792577    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-960620\"/\"default-dockercfg-v27lv\""
Jul 08 20:06:38.793362 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.793337    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-960620\"/\"rate-test-model-960620-kserve-self-signed-certs\""
Jul 08 20:06:38.793362 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.793351    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-960620\"/\"kube-root-ca.crt\""
Jul 08 20:06:38.800634 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.800586    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"]
Jul 08 20:06:38.918201 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.918149    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe489e96-2961-4893-a7b6-5131dd86ed66-tls-certs\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:38.918201 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.918212    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-dshm\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:38.918491 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.918252    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-home\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:38.918491 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.918378    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvgvt\" (UniqueName: \"kubernetes.io/projected/fe489e96-2961-4893-a7b6-5131dd86ed66-kube-api-access-vvgvt\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:38.918491 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.918419    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-tmp-dir\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:38.918491 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:38.918465    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-model-cache\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.019599 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.019563    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-model-cache\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.019599 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.019600    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe489e96-2961-4893-a7b6-5131dd86ed66-tls-certs\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.019881 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.019643    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-dshm\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.019881 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.019671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-home\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.019881 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.019782    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvgvt\" (UniqueName: \"kubernetes.io/projected/fe489e96-2961-4893-a7b6-5131dd86ed66-kube-api-access-vvgvt\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.019881 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.019805    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-tmp-dir\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.020086 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.020027    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-model-cache\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.020145 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.020095    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-home\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.020184 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.020144    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-tmp-dir\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.021991 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.021969    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-dshm\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.022239 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.022223    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe489e96-2961-4893-a7b6-5131dd86ed66-tls-certs\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.027978 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.027954    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvgvt\" (UniqueName: \"kubernetes.io/projected/fe489e96-2961-4893-a7b6-5131dd86ed66-kube-api-access-vvgvt\") pod \"rate-test-model-960620-kserve-85cdf96675-rf4b8\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") " pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.102027 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.101935    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:39.238041 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:39.238010    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"]
Jul 08 20:06:39.241820 ip-10-0-136-213 kubenswrapper[2554]: W0708 20:06:39.241788    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe489e96_2961_4893_a7b6_5131dd86ed66.slice/crio-205a1e456762081915e38124f3e25620c949063a39fe08b61e545cd6ba14588a WatchSource:0}: Error finding container 205a1e456762081915e38124f3e25620c949063a39fe08b61e545cd6ba14588a: Status 404 returned error can't find the container with id 205a1e456762081915e38124f3e25620c949063a39fe08b61e545cd6ba14588a
Jul 08 20:06:40.181463 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:40.181426    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8" event={"ID":"fe489e96-2961-4893-a7b6-5131dd86ed66","Type":"ContainerStarted","Data":"5bb9d544f74e4299ae6d12bbe10c3b492e756350859a408b81262c101afda770"}
Jul 08 20:06:40.181463 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:40.181474    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8" event={"ID":"fe489e96-2961-4893-a7b6-5131dd86ed66","Type":"ContainerStarted","Data":"205a1e456762081915e38124f3e25620c949063a39fe08b61e545cd6ba14588a"}
Jul 08 20:06:40.218832 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:40.218781    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8" podStartSLOduration=2.218764948 podStartE2EDuration="2.218764948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:40.217548299 +0000 UTC m=+2573.301322151" watchObservedRunningTime="2026-07-08 20:06:40.218764948 +0000 UTC m=+2573.302538798"
Jul 08 20:06:44.011242 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.011183    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28" podUID="e4e7a75a-4814-4cab-8457-f4982f0e7489" containerName="main" containerID="cri-o://721cfd6dab37603b753bbd8ade12fef103e187d733e6db7336e0bd50b2fe63e9" gracePeriod=45
Jul 08 20:06:44.208205 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.208173    2554 generic.go:356] "Generic (PLEG): container finished" podID="e4e7a75a-4814-4cab-8457-f4982f0e7489" containerID="721cfd6dab37603b753bbd8ade12fef103e187d733e6db7336e0bd50b2fe63e9" exitCode=0
Jul 08 20:06:44.208352 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.208222    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28" event={"ID":"e4e7a75a-4814-4cab-8457-f4982f0e7489","Type":"ContainerDied","Data":"721cfd6dab37603b753bbd8ade12fef103e187d733e6db7336e0bd50b2fe63e9"}
Jul 08 20:06:44.258125 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.258101    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:06:44.368366 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368268    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm4x4\" (UniqueName: \"kubernetes.io/projected/e4e7a75a-4814-4cab-8457-f4982f0e7489-kube-api-access-hm4x4\") pod \"e4e7a75a-4814-4cab-8457-f4982f0e7489\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") "
Jul 08 20:06:44.368529 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368369    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e7a75a-4814-4cab-8457-f4982f0e7489-tls-certs\") pod \"e4e7a75a-4814-4cab-8457-f4982f0e7489\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") "
Jul 08 20:06:44.368529 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368397    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-model-cache\") pod \"e4e7a75a-4814-4cab-8457-f4982f0e7489\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") "
Jul 08 20:06:44.368529 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368428    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-dshm\") pod \"e4e7a75a-4814-4cab-8457-f4982f0e7489\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") "
Jul 08 20:06:44.368529 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368493    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-home\") pod \"e4e7a75a-4814-4cab-8457-f4982f0e7489\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") "
Jul 08 20:06:44.368529 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368517    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-tmp-dir\") pod \"e4e7a75a-4814-4cab-8457-f4982f0e7489\" (UID: \"e4e7a75a-4814-4cab-8457-f4982f0e7489\") "
Jul 08 20:06:44.368816 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368702    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4e7a75a-4814-4cab-8457-f4982f0e7489" (UID: "e4e7a75a-4814-4cab-8457-f4982f0e7489"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:06:44.368886 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368818    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-home" (OuterVolumeSpecName: "home") pod "e4e7a75a-4814-4cab-8457-f4982f0e7489" (UID: "e4e7a75a-4814-4cab-8457-f4982f0e7489"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:06:44.368886 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368854    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4e7a75a-4814-4cab-8457-f4982f0e7489" (UID: "e4e7a75a-4814-4cab-8457-f4982f0e7489"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:06:44.368999 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368934    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-model-cache\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:06:44.368999 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.368955    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-home\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:06:44.370641 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.370592    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e7a75a-4814-4cab-8457-f4982f0e7489-kube-api-access-hm4x4" (OuterVolumeSpecName: "kube-api-access-hm4x4") pod "e4e7a75a-4814-4cab-8457-f4982f0e7489" (UID: "e4e7a75a-4814-4cab-8457-f4982f0e7489"). InnerVolumeSpecName "kube-api-access-hm4x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:06:44.370641 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.370592    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-dshm" (OuterVolumeSpecName: "dshm") pod "e4e7a75a-4814-4cab-8457-f4982f0e7489" (UID: "e4e7a75a-4814-4cab-8457-f4982f0e7489"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:06:44.370797 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.370659    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4e7a75a-4814-4cab-8457-f4982f0e7489-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4e7a75a-4814-4cab-8457-f4982f0e7489" (UID: "e4e7a75a-4814-4cab-8457-f4982f0e7489"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:06:44.470259 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.470207    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e7a75a-4814-4cab-8457-f4982f0e7489-tls-certs\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:06:44.470259 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.470250    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-dshm\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:06:44.470259 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.470263    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e7a75a-4814-4cab-8457-f4982f0e7489-tmp-dir\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:06:44.470259 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:44.470274    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm4x4\" (UniqueName: \"kubernetes.io/projected/e4e7a75a-4814-4cab-8457-f4982f0e7489-kube-api-access-hm4x4\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:06:45.214120 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:45.214090    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28" event={"ID":"e4e7a75a-4814-4cab-8457-f4982f0e7489","Type":"ContainerDied","Data":"002e085ed7b1eddc39bbed9b2a166770847dc8074f181d1b457935a93a3a9433"}
Jul 08 20:06:45.214532 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:45.214138    2554 scope.go:117] "RemoveContainer" containerID="721cfd6dab37603b753bbd8ade12fef103e187d733e6db7336e0bd50b2fe63e9"
Jul 08 20:06:45.214532 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:45.214138    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"
Jul 08 20:06:45.235781 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:45.235740    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"]
Jul 08 20:06:45.237947 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:45.237927    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/sub-test-model-ceba08-kserve-7d4f5bd845-d9q28"]
Jul 08 20:06:45.498378 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:45.498299    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4e7a75a-4814-4cab-8457-f4982f0e7489" path="/var/lib/kubelet/pods/e4e7a75a-4814-4cab-8457-f4982f0e7489/volumes"
Jul 08 20:06:47.702666 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:47.702631    2554 scope.go:117] "RemoveContainer" containerID="e4ac659d04cd043e4b9488686b8ea3e39b2f421ff12b71e16dcd00acae2724dc"
Jul 08 20:06:49.102062 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:49.102033    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:49.102488 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:49.102102    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:49.114558 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:49.114530    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:06:49.244795 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:06:49.244766    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:07:00.391755 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.391721    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"]
Jul 08 20:07:00.392223 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.392208    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e7a75a-4814-4cab-8457-f4982f0e7489" containerName="main"
Jul 08 20:07:00.392223 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.392222    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e7a75a-4814-4cab-8457-f4982f0e7489" containerName="main"
Jul 08 20:07:00.392308 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.392293    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4e7a75a-4814-4cab-8457-f4982f0e7489" containerName="main"
Jul 08 20:07:00.395036 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.395021    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.396996 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.396971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvbn\" (UniqueName: \"kubernetes.io/projected/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-kube-api-access-2vvbn\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.397088 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.397033    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-dshm\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.397088 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.397064    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tls-certs\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.397088 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.397082    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-home\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.397206 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.397154    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-model-cache\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.397279 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.397236    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tmp-dir\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.398280 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.398264    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"kube-root-ca.crt\""
Jul 08 20:07:00.398399 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.398383    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"default-dockercfg-w2tsr\""
Jul 08 20:07:00.398456 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.398443    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"rate-test-model-ceba08-kserve-self-signed-certs\""
Jul 08 20:07:00.398503 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.398471    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ceba08\"/\"openshift-service-ca.crt\""
Jul 08 20:07:00.403749 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.403729    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"]
Jul 08 20:07:00.497642 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.497588    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-model-cache\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.497642 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.497641    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tmp-dir\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.497904 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.497680    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvbn\" (UniqueName: \"kubernetes.io/projected/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-kube-api-access-2vvbn\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.497904 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.497712    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-dshm\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.497904 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.497731    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tls-certs\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.497904 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.497747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-home\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.498147 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.498038    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-model-cache\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.498147 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.498054    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-home\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.498147 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.498100    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tmp-dir\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.500020 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.499991    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-dshm\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.500262 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.500246    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tls-certs\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.506650 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.506613    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvbn\" (UniqueName: \"kubernetes.io/projected/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-kube-api-access-2vvbn\") pod \"rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") " pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.704860 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.704762    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:00.846290 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:00.846224    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"]
Jul 08 20:07:00.849309 ip-10-0-136-213 kubenswrapper[2554]: W0708 20:07:00.849281    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc03b72b6_7bcb_4c16_8e9b_6b72e0e28bdc.slice/crio-7490d6b156ef380dc74da35699f39ef599e3d0818d23f50b92ae7d225041b605 WatchSource:0}: Error finding container 7490d6b156ef380dc74da35699f39ef599e3d0818d23f50b92ae7d225041b605: Status 404 returned error can't find the container with id 7490d6b156ef380dc74da35699f39ef599e3d0818d23f50b92ae7d225041b605
Jul 08 20:07:01.296429 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:01.296390    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2" event={"ID":"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc","Type":"ContainerStarted","Data":"5bf697293ac0d6d579536e9a1d2bd93885c63726dbde396fa05aab23e4204fdc"}
Jul 08 20:07:01.296602 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:01.296440    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2" event={"ID":"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc","Type":"ContainerStarted","Data":"7490d6b156ef380dc74da35699f39ef599e3d0818d23f50b92ae7d225041b605"}
Jul 08 20:07:01.315003 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:01.314949    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2" podStartSLOduration=1.314933907 podStartE2EDuration="1.314933907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:07:01.313888875 +0000 UTC m=+2594.397662727" watchObservedRunningTime="2026-07-08 20:07:01.314933907 +0000 UTC m=+2594.398707758"
Jul 08 20:07:10.705567 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:10.705480    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:10.707981 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:10.705785    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:10.717987 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:10.717968    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:11.358389 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:11.358359    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:07:45.430250 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:45.430215    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"]
Jul 08 20:07:46.395512 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:07:46.395479    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"]
Jul 08 20:08:00.450855 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.450809    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8" podUID="fe489e96-2961-4893-a7b6-5131dd86ed66" containerName="main" containerID="cri-o://5bb9d544f74e4299ae6d12bbe10c3b492e756350859a408b81262c101afda770" gracePeriod=45
Jul 08 20:08:00.587051 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.587021    2554 generic.go:356] "Generic (PLEG): container finished" podID="fe489e96-2961-4893-a7b6-5131dd86ed66" containerID="5bb9d544f74e4299ae6d12bbe10c3b492e756350859a408b81262c101afda770" exitCode=0
Jul 08 20:08:00.587212 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.587094    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8" event={"ID":"fe489e96-2961-4893-a7b6-5131dd86ed66","Type":"ContainerDied","Data":"5bb9d544f74e4299ae6d12bbe10c3b492e756350859a408b81262c101afda770"}
Jul 08 20:08:00.700503 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.700480    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:08:00.744490 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744402    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-model-cache\") pod \"fe489e96-2961-4893-a7b6-5131dd86ed66\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") "
Jul 08 20:08:00.744490 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744449    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-home\") pod \"fe489e96-2961-4893-a7b6-5131dd86ed66\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") "
Jul 08 20:08:00.744729 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744523    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe489e96-2961-4893-a7b6-5131dd86ed66-tls-certs\") pod \"fe489e96-2961-4893-a7b6-5131dd86ed66\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") "
Jul 08 20:08:00.744729 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744544    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-dshm\") pod \"fe489e96-2961-4893-a7b6-5131dd86ed66\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") "
Jul 08 20:08:00.744729 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744573    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-tmp-dir\") pod \"fe489e96-2961-4893-a7b6-5131dd86ed66\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") "
Jul 08 20:08:00.744879 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744732    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvgvt\" (UniqueName: \"kubernetes.io/projected/fe489e96-2961-4893-a7b6-5131dd86ed66-kube-api-access-vvgvt\") pod \"fe489e96-2961-4893-a7b6-5131dd86ed66\" (UID: \"fe489e96-2961-4893-a7b6-5131dd86ed66\") "
Jul 08 20:08:00.744879 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744757    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe489e96-2961-4893-a7b6-5131dd86ed66" (UID: "fe489e96-2961-4893-a7b6-5131dd86ed66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:00.744879 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744825    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-home" (OuterVolumeSpecName: "home") pod "fe489e96-2961-4893-a7b6-5131dd86ed66" (UID: "fe489e96-2961-4893-a7b6-5131dd86ed66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:00.744879 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.744831    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe489e96-2961-4893-a7b6-5131dd86ed66" (UID: "fe489e96-2961-4893-a7b6-5131dd86ed66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:00.745125 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.745108    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-model-cache\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:00.745182 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.745131    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-home\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:00.745182 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.745145    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-tmp-dir\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:00.746974 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.746946    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe489e96-2961-4893-a7b6-5131dd86ed66-kube-api-access-vvgvt" (OuterVolumeSpecName: "kube-api-access-vvgvt") pod "fe489e96-2961-4893-a7b6-5131dd86ed66" (UID: "fe489e96-2961-4893-a7b6-5131dd86ed66"). InnerVolumeSpecName "kube-api-access-vvgvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:08:00.747227 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.747204    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe489e96-2961-4893-a7b6-5131dd86ed66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe489e96-2961-4893-a7b6-5131dd86ed66" (UID: "fe489e96-2961-4893-a7b6-5131dd86ed66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:08:00.747333 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.747313    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-dshm" (OuterVolumeSpecName: "dshm") pod "fe489e96-2961-4893-a7b6-5131dd86ed66" (UID: "fe489e96-2961-4893-a7b6-5131dd86ed66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:00.846446 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.846407    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe489e96-2961-4893-a7b6-5131dd86ed66-tls-certs\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:00.846446 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.846438    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe489e96-2961-4893-a7b6-5131dd86ed66-dshm\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:00.846446 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:00.846447    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvgvt\" (UniqueName: \"kubernetes.io/projected/fe489e96-2961-4893-a7b6-5131dd86ed66-kube-api-access-vvgvt\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:01.415922 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.415865    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2" podUID="c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" containerName="main" containerID="cri-o://5bf697293ac0d6d579536e9a1d2bd93885c63726dbde396fa05aab23e4204fdc" gracePeriod=45
Jul 08 20:08:01.593504 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.593476    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"
Jul 08 20:08:01.593504 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.593490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8" event={"ID":"fe489e96-2961-4893-a7b6-5131dd86ed66","Type":"ContainerDied","Data":"205a1e456762081915e38124f3e25620c949063a39fe08b61e545cd6ba14588a"}
Jul 08 20:08:01.593981 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.593548    2554 scope.go:117] "RemoveContainer" containerID="5bb9d544f74e4299ae6d12bbe10c3b492e756350859a408b81262c101afda770"
Jul 08 20:08:01.595392 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.595368    2554 generic.go:356] "Generic (PLEG): container finished" podID="c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" containerID="5bf697293ac0d6d579536e9a1d2bd93885c63726dbde396fa05aab23e4204fdc" exitCode=0
Jul 08 20:08:01.595643 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.595458    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2" event={"ID":"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc","Type":"ContainerDied","Data":"5bf697293ac0d6d579536e9a1d2bd93885c63726dbde396fa05aab23e4204fdc"}
Jul 08 20:08:01.631584 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.631552    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"]
Jul 08 20:08:01.637086 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.637048    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-960620/rate-test-model-960620-kserve-85cdf96675-rf4b8"]
Jul 08 20:08:01.680964 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.680892    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:08:01.756831 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.756800    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-home\") pod \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") "
Jul 08 20:08:01.757003 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.756887    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tmp-dir\") pod \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") "
Jul 08 20:08:01.757003 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.756922    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tls-certs\") pod \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") "
Jul 08 20:08:01.757003 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.756937    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-model-cache\") pod \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") "
Jul 08 20:08:01.757003 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.756987    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vvbn\" (UniqueName: \"kubernetes.io/projected/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-kube-api-access-2vvbn\") pod \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") "
Jul 08 20:08:01.757228 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.757010    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-dshm\") pod \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\" (UID: \"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc\") "
Jul 08 20:08:01.757228 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.757091    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-home" (OuterVolumeSpecName: "home") pod "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" (UID: "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:01.757228 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.757151    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" (UID: "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:01.757379 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.757273    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-model-cache" (OuterVolumeSpecName: "model-cache") pod "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" (UID: "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:01.757440 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.757410    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-home\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:01.757440 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.757424    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tmp-dir\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:01.757440 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.757434    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-model-cache\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:01.759203 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.759171    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-dshm" (OuterVolumeSpecName: "dshm") pod "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" (UID: "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:01.759313 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.759211    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" (UID: "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:08:01.759313 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.759208    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-kube-api-access-2vvbn" (OuterVolumeSpecName: "kube-api-access-2vvbn") pod "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" (UID: "c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc"). InnerVolumeSpecName "kube-api-access-2vvbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:08:01.858311 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.858274    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-tls-certs\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:01.858311 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.858304    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vvbn\" (UniqueName: \"kubernetes.io/projected/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-kube-api-access-2vvbn\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:01.858311 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:01.858314    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc-dshm\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\""
Jul 08 20:08:02.602794 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:02.602767    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"
Jul 08 20:08:02.603249 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:02.602766    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2" event={"ID":"c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc","Type":"ContainerDied","Data":"7490d6b156ef380dc74da35699f39ef599e3d0818d23f50b92ae7d225041b605"}
Jul 08 20:08:02.603249 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:02.602914    2554 scope.go:117] "RemoveContainer" containerID="5bf697293ac0d6d579536e9a1d2bd93885c63726dbde396fa05aab23e4204fdc"
Jul 08 20:08:02.625461 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:02.625434    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"]
Jul 08 20:08:02.629355 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:02.629331    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ceba08/rate-test-model-ceba08-kserve-ddbbcb9b7-wbsz2"]
Jul 08 20:08:03.497897 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:03.497867    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" path="/var/lib/kubelet/pods/c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc/volumes"
Jul 08 20:08:03.498273 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:03.498254    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe489e96-2961-4893-a7b6-5131dd86ed66" path="/var/lib/kubelet/pods/fe489e96-2961-4893-a7b6-5131dd86ed66/volumes"
Jul 08 20:08:43.370280 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:43.370199    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-565c796c8c-gz2v9_cb201995-7ab1-4f4b-88fa-93db49cc488f/maas-api/0.log"
Jul 08 20:08:43.480352 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:43.480321    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29725665-dlqnv_eae6b3b4-2c9e-45cf-963f-766873a159d5/cleanup/0.log"
Jul 08 20:08:43.600943 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:43.600916    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29725680-xx8wq_24805e88-d085-41ac-a28a-872118a55b44/cleanup/0.log"
Jul 08 20:08:43.730860 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:43.730833    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9c6fb9585-hqb84_4b3911c8-7910-461b-bf55-d26249934403/manager/0.log"
Jul 08 20:08:44.093911 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:44.093822    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ddc6fd87-cb29r_682ba84f-8e44-4b36-9622-7d2ff746246e/manager/0.log"
Jul 08 20:08:44.099972 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:44.099952    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ddc6fd87-cb29r_682ba84f-8e44-4b36-9622-7d2ff746246e/copy-manifests/0.log"
Jul 08 20:08:44.502260 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:44.502232    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wscn6_3fddfe98-5eef-4112-b4db-f95713dfc78f/postgres/0.log"
Jul 08 20:08:46.199931 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:46.199901    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-445r8_e7f2d1eb-872c-4c0b-95f0-520d937cf230/kuadrant-console-plugin/0.log"
Jul 08 20:08:47.429026 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:47.428993    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b84bffb4-v5fg9_6288b026-90a2-472b-806f-70fc0486a8b9/kube-auth-proxy/0.log"
Jul 08 20:08:47.611684 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:47.611651    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 20:08:47.622981 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:47.622956    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 20:08:47.689585 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:47.689506    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rnwvv_b4985978-e8dc-43db-b79f-59e225c71e19/payload-pre-processing/0.log"
Jul 08 20:08:47.822019 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:47.821976    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fkxhk_8c09f5e0-865c-4745-a6b0-cfe8c831e31b/payload-processing/0.log"
Jul 08 20:08:48.304960 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:48.304904    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rwc42_1908213f-188f-402c-a463-a5afe5fb3cbd/main/0.log"
Jul 08 20:08:48.543551 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:48.543517    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bwpsq_81e90836-5a75-457e-8625-7a20aa4f37a1/main/0.log"
Jul 08 20:08:48.906955 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:48.906925    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-625qw_eccd20fa-f599-4ff6-a60b-12dee0698fcb/main/0.log"
Jul 08 20:08:56.882082 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:56.882052    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dkd8x_a7920a1e-1707-4ea8-b643-bc41f37ae37c/global-pull-secret-syncer/0.log"
Jul 08 20:08:57.043404 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:57.043375    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nrcb5_691d9e19-0679-47a8-8740-143a58393343/konnectivity-agent/0.log"
Jul 08 20:08:57.068993 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:08:57.068968    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-213.ec2.internal_8afef05007b8d8fcc1b2b5da41446350/haproxy/0.log"
Jul 08 20:09:02.314589 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:02.314563    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-445r8_e7f2d1eb-872c-4c0b-95f0-520d937cf230/kuadrant-console-plugin/0.log"
Jul 08 20:09:04.576681 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:04.576595    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fz9jr_174a7b71-da8c-477b-bdb5-2f8ddd9cf2db/node-exporter/0.log"
Jul 08 20:09:04.609851 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:04.609820    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fz9jr_174a7b71-da8c-477b-bdb5-2f8ddd9cf2db/kube-rbac-proxy/0.log"
Jul 08 20:09:04.666430 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:04.666363    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fz9jr_174a7b71-da8c-477b-bdb5-2f8ddd9cf2db/init-textfile/0.log"
Jul 08 20:09:04.904667 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:04.904635    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j6v2q_09e163ed-dd6c-47aa-a0ef-1876e9a2189c/kube-rbac-proxy-main/0.log"
Jul 08 20:09:04.926963 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:04.926936    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j6v2q_09e163ed-dd6c-47aa-a0ef-1876e9a2189c/kube-rbac-proxy-self/0.log"
Jul 08 20:09:04.948450 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:04.948424    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j6v2q_09e163ed-dd6c-47aa-a0ef-1876e9a2189c/openshift-state-metrics/0.log"
Jul 08 20:09:04.987473 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:04.987430    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f45f18aa-2fce-490a-b586-0f3c426c55d1/prometheus/0.log"
Jul 08 20:09:05.009719 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.009693    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f45f18aa-2fce-490a-b586-0f3c426c55d1/config-reloader/0.log"
Jul 08 20:09:05.034365 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.034331    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f45f18aa-2fce-490a-b586-0f3c426c55d1/thanos-sidecar/0.log"
Jul 08 20:09:05.057716 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.057683    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f45f18aa-2fce-490a-b586-0f3c426c55d1/kube-rbac-proxy-web/0.log"
Jul 08 20:09:05.082285 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.082249    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f45f18aa-2fce-490a-b586-0f3c426c55d1/kube-rbac-proxy/0.log"
Jul 08 20:09:05.115258 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.115234    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f45f18aa-2fce-490a-b586-0f3c426c55d1/kube-rbac-proxy-thanos/0.log"
Jul 08 20:09:05.136567 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.136542    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f45f18aa-2fce-490a-b586-0f3c426c55d1/init-config-reloader/0.log"
Jul 08 20:09:05.166937 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.166856    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-6nf5c_533d4f16-4619-46b0-b490-9e9ad53d3386/prometheus-operator/0.log"
Jul 08 20:09:05.190393 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.190361    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-6nf5c_533d4f16-4619-46b0-b490-9e9ad53d3386/kube-rbac-proxy/0.log"
Jul 08 20:09:05.218966 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:05.218940    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-ccq55_869e903f-dcb9-4785-aafc-db70c9728fc8/prometheus-operator-admission-webhook/0.log"
Jul 08 20:09:06.660291 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:06.660257    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-7x4g8_c2df2a6f-8d63-40ba-b8a6-c5431d00edf4/networking-console-plugin/0.log"
Jul 08 20:09:07.265231 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.265192    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/2.log"
Jul 08 20:09:07.273539 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.273514    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8zj64_33ad7dc8-4317-4678-9b61-f9c7dfec68da/console-operator/3.log"
Jul 08 20:09:07.506964 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.506932    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"]
Jul 08 20:09:07.507310 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.507297    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe489e96-2961-4893-a7b6-5131dd86ed66" containerName="main"
Jul 08 20:09:07.507356 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.507312    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe489e96-2961-4893-a7b6-5131dd86ed66" containerName="main"
Jul 08 20:09:07.507356 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.507321    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" containerName="main"
Jul 08 20:09:07.507356 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.507326    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" containerName="main"
Jul 08 20:09:07.507452 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.507393    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe489e96-2961-4893-a7b6-5131dd86ed66" containerName="main"
Jul 08 20:09:07.507452 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.507402    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03b72b6-7bcb-4c16-8e9b-6b72e0e28bdc" containerName="main"
Jul 08 20:09:07.510434 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.510414    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.512691 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.512669    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4cwpq\"/\"default-dockercfg-jzmnh\""
Jul 08 20:09:07.512793 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.512735    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4cwpq\"/\"openshift-service-ca.crt\""
Jul 08 20:09:07.513426 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.513410    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4cwpq\"/\"kube-root-ca.crt\""
Jul 08 20:09:07.517736 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.517713    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"]
Jul 08 20:09:07.638459 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.638430    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-lib-modules\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.638613 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.638555    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-proc\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.638681 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.638610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-podres\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.638681 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.638674    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-sys\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.638749 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.638690    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2d6x\" (UniqueName: \"kubernetes.io/projected/2437ea4c-978b-4969-bfa8-4af3a77e55e2-kube-api-access-j2d6x\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740020 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.739982    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-lib-modules\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740086    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-proc\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740122    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-podres\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740178    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-lib-modules\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740208    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-proc\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740220    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-podres\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-sys\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740313    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2437ea4c-978b-4969-bfa8-4af3a77e55e2-sys\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.740449 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.740320    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2d6x\" (UniqueName: \"kubernetes.io/projected/2437ea4c-978b-4969-bfa8-4af3a77e55e2-kube-api-access-j2d6x\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.748812 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.748793    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2d6x\" (UniqueName: \"kubernetes.io/projected/2437ea4c-978b-4969-bfa8-4af3a77e55e2-kube-api-access-j2d6x\") pod \"perf-node-gather-daemonset-rvhqr\" (UID: \"2437ea4c-978b-4969-bfa8-4af3a77e55e2\") " pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.821843 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.821763    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:07.952957 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:07.952928    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"]
Jul 08 20:09:07.954772 ip-10-0-136-213 kubenswrapper[2554]: W0708 20:09:07.954739    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2437ea4c_978b_4969_bfa8_4af3a77e55e2.slice/crio-7f57d06642fdc781c55d3aaaf46f757cb3d996ec2cc8a136dbd2e70c97cefe0e WatchSource:0}: Error finding container 7f57d06642fdc781c55d3aaaf46f757cb3d996ec2cc8a136dbd2e70c97cefe0e: Status 404 returned error can't find the container with id 7f57d06642fdc781c55d3aaaf46f757cb3d996ec2cc8a136dbd2e70c97cefe0e
Jul 08 20:09:08.458947 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:08.458914    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-t8ftt_0d0ebf99-4dd5-40a7-8dae-1c7472a0eaef/volume-data-source-validator/0.log"
Jul 08 20:09:08.928298 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:08.928266    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr" event={"ID":"2437ea4c-978b-4969-bfa8-4af3a77e55e2","Type":"ContainerStarted","Data":"c6784fdb30699bdeb331662d3933dcb1e77f72771c8d711c176dd6ef47334452"}
Jul 08 20:09:08.928722 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:08.928318    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr" event={"ID":"2437ea4c-978b-4969-bfa8-4af3a77e55e2","Type":"ContainerStarted","Data":"7f57d06642fdc781c55d3aaaf46f757cb3d996ec2cc8a136dbd2e70c97cefe0e"}
Jul 08 20:09:08.928722 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:08.928416    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:08.944980 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:08.944929    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr" podStartSLOduration=1.944914815 podStartE2EDuration="1.944914815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 20:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:09:08.943122486 +0000 UTC m=+2722.026896336" watchObservedRunningTime="2026-07-08 20:09:08.944914815 +0000 UTC m=+2722.028688665"
Jul 08 20:09:09.483872 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:09.483840    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5lvw7_15c94254-c8e2-401c-a617-d9233c41e47c/dns/0.log"
Jul 08 20:09:09.505873 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:09.505818    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5lvw7_15c94254-c8e2-401c-a617-d9233c41e47c/kube-rbac-proxy/0.log"
Jul 08 20:09:09.643806 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:09.643779    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rmxfc_442201d0-2162-400c-914b-a9e257242a4b/dns-node-resolver/0.log"
Jul 08 20:09:10.281977 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:10.281919    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wchgt_7bd296cb-0758-49ec-86bd-cec21f806e35/node-ca/0.log"
Jul 08 20:09:11.477820 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:11.477788    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b84bffb4-v5fg9_6288b026-90a2-472b-806f-70fc0486a8b9/kube-auth-proxy/0.log"
Jul 08 20:09:11.587980 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:11.587953    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rnwvv_b4985978-e8dc-43db-b79f-59e225c71e19/payload-pre-processing/0.log"
Jul 08 20:09:11.673868 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:11.673843    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fkxhk_8c09f5e0-865c-4745-a6b0-cfe8c831e31b/payload-processing/0.log"
Jul 08 20:09:12.440491 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:12.440465    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkkt7_f686f053-5871-4fb2-a166-bf03f11ac95a/serve-healthcheck-canary/0.log"
Jul 08 20:09:12.990826 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:12.990800    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-42m9g_642c9980-ddef-4e85-843c-3f3d99d28e01/kube-rbac-proxy/0.log"
Jul 08 20:09:13.011479 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:13.011456    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-42m9g_642c9980-ddef-4e85-843c-3f3d99d28e01/exporter/0.log"
Jul 08 20:09:13.031765 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:13.031737    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-42m9g_642c9980-ddef-4e85-843c-3f3d99d28e01/extractor/0.log"
Jul 08 20:09:14.944038 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:14.944003    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4cwpq/perf-node-gather-daemonset-rvhqr"
Jul 08 20:09:15.407567 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:15.407534    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-565c796c8c-gz2v9_cb201995-7ab1-4f4b-88fa-93db49cc488f/maas-api/0.log"
Jul 08 20:09:15.424863 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:15.424833    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29725665-dlqnv_eae6b3b4-2c9e-45cf-963f-766873a159d5/cleanup/0.log"
Jul 08 20:09:15.448246 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:15.448224    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29725680-xx8wq_24805e88-d085-41ac-a28a-872118a55b44/cleanup/0.log"
Jul 08 20:09:15.607030 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:15.607003    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9c6fb9585-hqb84_4b3911c8-7910-461b-bf55-d26249934403/manager/0.log"
Jul 08 20:09:15.731251 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:15.731165    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ddc6fd87-cb29r_682ba84f-8e44-4b36-9622-7d2ff746246e/manager/0.log"
Jul 08 20:09:15.750558 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:15.750536    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ddc6fd87-cb29r_682ba84f-8e44-4b36-9622-7d2ff746246e/copy-manifests/0.log"
Jul 08 20:09:15.934556 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:15.934532    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wscn6_3fddfe98-5eef-4112-b4db-f95713dfc78f/postgres/0.log"
Jul 08 20:09:17.297527 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:17.297492    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bb9464976-q92rv_2217414d-a20a-4f26-a1db-be0d0b18f59e/manager/0.log"
Jul 08 20:09:17.966228 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:17.966188    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b84bffb4-v5fg9_6288b026-90a2-472b-806f-70fc0486a8b9/kube-auth-proxy/0.log"
Jul 08 20:09:18.076703 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:18.076669    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rnwvv_b4985978-e8dc-43db-b79f-59e225c71e19/payload-pre-processing/0.log"
Jul 08 20:09:18.145043 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:18.145014    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fkxhk_8c09f5e0-865c-4745-a6b0-cfe8c831e31b/payload-processing/0.log"
Jul 08 20:09:19.559171 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:19.559128    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b84bffb4-v5fg9_6288b026-90a2-472b-806f-70fc0486a8b9/kube-auth-proxy/0.log"
Jul 08 20:09:19.653071 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:19.653044    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rnwvv_b4985978-e8dc-43db-b79f-59e225c71e19/payload-pre-processing/0.log"
Jul 08 20:09:19.717980 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:19.717946    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fkxhk_8c09f5e0-865c-4745-a6b0-cfe8c831e31b/payload-processing/0.log"
Jul 08 20:09:22.698236 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:22.698200    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4wbtk_aaf3de34-9622-4caa-8d13-66ae822f36c5/migrator/0.log"
Jul 08 20:09:22.717905 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:22.717872    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4wbtk_aaf3de34-9622-4caa-8d13-66ae822f36c5/graceful-termination/0.log"
Jul 08 20:09:23.091995 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:23.091909    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-qsvrc_7c1b3c09-ea56-4b29-9394-130c9b0594eb/kube-storage-version-migrator-operator/1.log"
Jul 08 20:09:23.093545 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:23.093521    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-qsvrc_7c1b3c09-ea56-4b29-9394-130c9b0594eb/kube-storage-version-migrator-operator/0.log"
Jul 08 20:09:24.125422 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.125393    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l7k5q_9ef6dda8-01b0-4d0f-b3fb-0524145ba196/kube-multus-additional-cni-plugins/0.log"
Jul 08 20:09:24.146338 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.146312    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l7k5q_9ef6dda8-01b0-4d0f-b3fb-0524145ba196/egress-router-binary-copy/0.log"
Jul 08 20:09:24.173111 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.173084    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l7k5q_9ef6dda8-01b0-4d0f-b3fb-0524145ba196/cni-plugins/0.log"
Jul 08 20:09:24.192513 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.192485    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l7k5q_9ef6dda8-01b0-4d0f-b3fb-0524145ba196/bond-cni-plugin/0.log"
Jul 08 20:09:24.211793 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.211770    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l7k5q_9ef6dda8-01b0-4d0f-b3fb-0524145ba196/routeoverride-cni/0.log"
Jul 08 20:09:24.231332 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.231308    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l7k5q_9ef6dda8-01b0-4d0f-b3fb-0524145ba196/whereabouts-cni-bincopy/0.log"
Jul 08 20:09:24.251755 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.251732    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l7k5q_9ef6dda8-01b0-4d0f-b3fb-0524145ba196/whereabouts-cni/0.log"
Jul 08 20:09:24.664909 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.664882    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qr5fs_c68a9266-bb64-4c55-8d31-09cc84852974/kube-multus/0.log"
Jul 08 20:09:24.788250 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.788175    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-svtnq_e715f486-90f1-47dd-84e1-b11d8ea3f690/network-metrics-daemon/0.log"
Jul 08 20:09:24.805436 ip-10-0-136-213 kubenswrapper[2554]: I0708 20:09:24.805407    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-svtnq_e715f486-90f1-47dd-84e1-b11d8ea3f690/kube-rbac-proxy/0.log"